-- Logs begin at Mon 2022-07-18 15:48:09 UTC, end at Mon 2022-07-18 17:15:00 UTC. -- Jul 18 16:28:02.647942 dv-cinder-837542-6-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 18 16:28:02.665060 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 18 16:28:02.665060 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 16:28:02 2022] *** Jul 18 16:28:02.665060 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 16:28:02.665060 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 16:28:02.665060 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: nodename: dv-cinder-837542-6-iscsi Jul 18 16:28:02.665060 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: machine: x86_64 Jul 18 16:28:02.665060 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: clock source: unix Jul 18 16:28:02.665060 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: pcre jit disabled Jul 18 16:28:02.665060 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: detected number of CPU cores: 4 Jul 18 16:28:02.665060 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: current working directory: / Jul 18 16:28:02.665060 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: detected binary path: /usr/bin/uwsgi-core Jul 18 16:28:02.665060 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: your processes number limit is 47680 Jul 18 16:28:02.665060 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: your memory page size is 4096 bytes Jul 18 16:28:02.665060 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: detected max file descriptor number: 2048 Jul 18 16:28:02.665060 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: lock engine: pthread robust mutexes Jul 18 16:28:02.665060 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: thunder lock: enabled Jul 18 16:28:02.665060 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 18 16:28:02.665060 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 16:28:02.701672 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: Python main interpreter initialized at 0x5621a6d219c0 Jul 18 16:28:02.701672 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: python threads support enabled Jul 18 16:28:02.701672 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: your server socket listen backlog is limited to 100 connections Jul 18 16:28:02.701672 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: your mercy for graceful operations on workers is 90 seconds Jul 18 16:28:02.702072 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 16:28:02.702150 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: *** Operational MODE: preforking *** Jul 18 16:28:02.702411 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: *** uWSGI is running in multiple interpreter mode *** Jul 18 16:28:02.702411 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: spawned uWSGI master process (pid: 80501) Jul 18 16:28:02.702698 dv-cinder-837542-6-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 18 16:28:02.703311 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: spawned uWSGI worker 1 (pid: 80507, cores: 1) Jul 18 16:28:02.704600 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: spawned uWSGI worker 2 (pid: 80508, cores: 1) Jul 18 16:28:02.704600 dv-cinder-837542-6-iscsi devstack@keystone.service[80501]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 16:28:08.311303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:28:08.311303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: from cryptography.utils import int_from_bytes Jul 18 16:28:08.312458 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:28:08.312458 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: from cryptography.utils import int_from_bytes Jul 18 16:28:08.322366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:28:08.322366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: from cryptography.utils import int_from_bytes Jul 18 16:28:08.322366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 16:28:08.322366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: from cryptography.utils import int_from_bytes Jul 18 16:28:08.361892 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 16:28:08.362097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 16:28:08.362267 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] command line args: [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 16:28:08.362539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 16:28:08.362718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ================================================================================ {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 16:28:08.363003 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] admin_token = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.363314 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] config_dir = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.363508 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.363736 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] config_source = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.363875 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] debug = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.364077 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.366015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.366015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.366015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.366015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.366015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] list_limit = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.366574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] log_config_append = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.366574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.366574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] log_dir = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.366574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] log_file = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.366951 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.367069 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.367264 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.367389 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 16:28:08.367516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.367604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 16:28:08.367684 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.367808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] command line args: [] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 16:28:08.367896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.368052 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 16:28:08.368137 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.368259 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ================================================================================ {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 16:28:08.368336 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.368479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] admin_token = **** {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.368565 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.368731 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] config_dir = [] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.368815 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.368937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.369047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.369137 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] config_source = [] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.369279 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] debug = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.369362 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.369483 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.369639 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.369729 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.369802 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.369874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.370085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.370167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.370372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.370593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.76/identity {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.370691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] list_limit = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.370790 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] publish_errors = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.370911 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] log_config_append = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.371001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.371083 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.371157 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] log_dir = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.371247 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.371346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] log_file = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.371420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.371626 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.371713 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.371792 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.371863 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.371976 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.372076 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] standard_threads = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.372226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.372378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.372453 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.372517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.372595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.372664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.372809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.372896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] use_journal = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.372995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] use_json = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.378365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.378521 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] use_stderr = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.378618 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.378747 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] use_syslog = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.378824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.378902 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.379136 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.379354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.379436 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.379508 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.379585 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.379663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.379742 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.380438 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.380576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.380705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.380705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.380865 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.76/identity {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.380934 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.381000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] publish_errors = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.381180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.381333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.381425 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.381499 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.381576 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.381654 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.381799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.381985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.382130 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.382256 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.382360 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.382449 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] standard_threads = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.382529 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.382602 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.382684 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.382773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.382773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.382986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.383094 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] use_journal = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.383217 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.383305 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] use_json = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.383385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.383463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] use_stderr = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.383463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] use_syslog = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.383598 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.383675 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 16:28:08.383763 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.383842 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.383914 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.383985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.384055 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.384131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.384257 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.384435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.384525 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.384688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.384813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.384900 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.385150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.385386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.385469 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.385548 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.385548 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.385684 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.385763 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.385846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.385981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.386085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.386219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.386313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.386395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.386469 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.386540 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.386611 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.386681 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.386752 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.386834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.386907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.387009 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.387090 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.387162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.387251 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.387391 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.387475 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.387554 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.387626 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.387703 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.387819 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.387819 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.388042 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.388265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.388433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.388553 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.388661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.388766 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.388895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.389043 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.389208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.389319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.389408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.389475 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.389549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.389669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.389798 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.389888 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.389975 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.390068 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.390152 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.390215 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.390279 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.390408 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.390488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.390560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.390687 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.390770 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.390843 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.390961 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.391043 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.391124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.391198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.391314 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.391390 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.391504 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.391580 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.391660 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.391734 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.391850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.391927 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.392041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.392124 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.392208 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.392282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.392404 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.392485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.392559 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.392676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.392752 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.392832 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.392906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.393050 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.393129 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.393246 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.393322 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.393482 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.393482 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.393667 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.393745 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.393816 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.393941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.394027 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.394106 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.394185 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.394185 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.394315 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.394315 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.394452 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.394452 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.394581 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.394581 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.394709 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.394709 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.394913 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.394913 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.395100 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.395100 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.395240 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.395240 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.395399 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.395399 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.395544 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.395544 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.395659 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.395659 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.395771 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.395837 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.395897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.395956 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.396019 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.396019 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.396309 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.396309 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.396485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.396603 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.396680 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.396680 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.396818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.396902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.396980 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.397071 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.397146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.397225 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.397297 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.397386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.397465 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.397537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.397609 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.397679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.397750 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.397829 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.397940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.398023 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.398211 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.398291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.398488 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.398580 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.398765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.398857 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.399051 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.399138 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.399331 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.399420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.399606 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.399692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.399918 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.399997 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.400194 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.400281 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.400462 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] auth.external = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.400545 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.400729 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.400814 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.401039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.401137 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.401323 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.401403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.401666 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] auth.password = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.401823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.401941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.402017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] auth.token = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.402158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.402238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.402395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.402508 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.402631 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.402797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.402876 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.403065 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.403144 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.403328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.403419 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.403570 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.403665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.403823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.403903 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.404065 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.404145 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] credential.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.404325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.404412 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.404589 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.404690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.404834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.404970 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.405097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] auth.external = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.405267 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.405364 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.405550 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.405630 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.405793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.405873 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.406068 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.406148 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] auth.password = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.406300 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] auth.token = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.406379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.406685 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.406783 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.406867 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.406942 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.407088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.407175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.407301 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.407377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.408044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.408132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.408207 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.408280 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.408361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.408579 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.408799 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] credential.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.408882 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.408956 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.409061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.409139 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.409212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.409298 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.409374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.409447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.409520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.409599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.409676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.409758 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.409838 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.409902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.409990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.410113 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.410230 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.410358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.410491 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.410616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.410731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.410907 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.411006 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.411248 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.411327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.411501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.411602 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.411752 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.411992 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.412068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.412229 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.412309 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.412480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.412562 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] federation.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.412713 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.412801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.412974 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.413077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.413256 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.413338 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.413490 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.413579 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.413739 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.413817 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.413974 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.414053 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.414209 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.414290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.414457 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.414539 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.414706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.414844 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.414957 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.415038 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.415183 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.415263 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.415425 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.415504 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.415679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.415775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.415932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.416013 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.416173 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.416254 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.416414 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.416495 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.416667 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.416790 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.416902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.416989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.421465 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.421600 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.421600 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.421803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.421868 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.421946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.422027 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.422101 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.422173 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.422245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.422316 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.422387 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.422466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.422539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.422610 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.422682 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.422753 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.422824 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.422902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.422975 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.423053 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.423126 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.423203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.423276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.423355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.423428 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.423507 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.423568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.423638 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.423751 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.423841 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.423916 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.423916 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.424045 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.424116 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.424187 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.424268 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.424386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.424469 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.424531 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.424592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.424660 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.424742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.424810 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.424869 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.424929 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.424994 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.425078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.425151 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.425212 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.425272 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.425330 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.425389 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.425447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.425513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.425574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.425633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.425692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.425751 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.425816 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.425882 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.425942 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.425942 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.426054 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.426112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.426170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.426236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.426296 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.426355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.426424 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.426424 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.426556 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.427175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.427258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.427331 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.427403 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.427486 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.427572 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.427662 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.427776 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.427881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.427959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.427959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.428299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.428299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.428479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.428560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.428656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.428656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.428793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.428891 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.428971 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.429063 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.429138 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.429209 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.429293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.429373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.429447 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.429518 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.429589 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.429748 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.429838 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.429989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.430071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.430225 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.430320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.430557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.430657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.430734 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.430806 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.430932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.431012 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.431166 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.431321 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.431419 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.431499 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.431663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.431742 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.431904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.431991 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.432153 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.432231 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.432429 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.432515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.432631 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.432717 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.432868 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.432946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.433133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.433213 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.433375 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.433466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.433616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.433697 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.433853 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.433931 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.434100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.434191 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.434353 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.434432 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.434593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.434678 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.434840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.434925 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.435076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.435155 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.435315 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.435393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.435559 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.435684 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] role.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.435800 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.435926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] role.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.436020 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.436101 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.436260 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.436349 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.436504 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.436583 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.436739 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.436817 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.436978 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.437156 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.437234 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] resource.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.437306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.437487 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.437566 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.437741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.437829 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.437981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.438063 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.438226 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.438304 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.438478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.438565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.438716 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.438794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.438966 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.439057 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.439209 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.439289 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.439448 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.439687 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.439765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] role.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.439937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.440033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] role.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.440159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.440235 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.440399 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.440477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.440654 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.440751 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.440903 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.440984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.441184 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.441264 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.441434 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.441524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.441686 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.441784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.441930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.442023 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.442179 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.442399 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.443041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.443239 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.443316 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.443392 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.443478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.443684 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.443753 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.443950 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.444029 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.444205 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.444282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.444453 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.444632 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.444711 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.444872 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.444950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] token.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.445153 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.445248 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.445408 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.445486 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.445649 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.445727 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.445898 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.445989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.446136 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.446215 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.446374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.446441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.446621 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.446690 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.446867 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.446944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.447104 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.447210 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.447350 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.447422 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.447585 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.447677 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.447822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.447892 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.448072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.448152 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.448322 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.448400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.448582 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.448666 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.448792 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.448872 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.449047 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.449119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.449295 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] token.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.449374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] database.connection = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.449537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.449625 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.449791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.449862 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.450030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.450098 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.450292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.450371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.450529 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.450608 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.450769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.450836 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.451008 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.451085 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.451246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.451325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.451503 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.451635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.451733 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.451811 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.451971 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.452050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.452210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.452289 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.452460 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.452537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.452699 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.452769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.452929 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.453001 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.453203 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.453289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.453434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.453500 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.453669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.453748 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] database.connection = **** {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.453829 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80508) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 16:28:08.454002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.454254 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.454497 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.454760 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.454978 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.455216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.455454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.456171 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.456171 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.456171 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.459371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.459371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.459371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.459371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.459371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.459371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.459371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.459371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 16:28:08.459371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 16:28:08.486037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.490455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.490455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.490648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.490648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.490648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.498613 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.498943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.528000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.528214 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.529355 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.546387 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.691877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.698594 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.743448 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.743691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.752636 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.752873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.811675 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.811900 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.812132 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.812351 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.812578 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.812663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.812848 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.812990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.813145 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.813308 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.813528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.813739 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.839746 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.840003 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.840192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.840418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.840636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.840769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.840900 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.841071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.841201 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.841342 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.841470 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.841595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.841786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.841998 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.852767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.853408 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.875581 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.875841 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.876055 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.876236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.876386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.876535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.876664 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.876802 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.876934 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.877080 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.877207 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.877360 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.877496 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80507) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.877639 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80508) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 18 16:28:08.895107 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.895902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 16:28:08.896215 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.896398 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.896564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 16:28:08.896657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 16:28:08.896857 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.896946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.897150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.897279 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 18 16:28:08.897423 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.897551 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.897694 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.897821 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.897948 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.898086 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.908689 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.908966 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.909213 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.909303 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.909493 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.912682 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.912798 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.912798 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.918676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:08.919511 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:08.922019 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:08.922302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.922587 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.922812 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:08.923001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.923100 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.923288 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.923411 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.923555 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.923830 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.923923 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.924108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.924190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.924366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.924447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.924632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.924723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.924901 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.924983 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.925195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.925469 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.925734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.956066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.956066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:08.956280 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.956356 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.956457 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:08.956457 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.959511 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:08.959787 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.960067 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.962051 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:08.962332 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.962608 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.967445 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:08.967731 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.969830 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:08.970111 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.972378 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:08.972672 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.972957 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.973269 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.974235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.974587 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.974834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.975105 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.975879 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:08.976165 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.976446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.976725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.976993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.977289 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.977554 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.977818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.993894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.994178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.997036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.997315 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:08.998845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.002289 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.002950 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.003381 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.007107 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.009623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.009732 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.012387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.012654 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.016337 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.016532 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.016649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.016941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.017270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.017561 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.017853 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.021227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.022169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.022495 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.022781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.023075 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.023359 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.038988 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.039403 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.039696 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.039975 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.043999 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.044415 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.044691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.045046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.049813 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.050070 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.050349 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.053686 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.053973 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.054060 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.054268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.054563 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.054845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.055737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.056010 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.059120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.059415 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.059702 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.059982 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.060273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.068880 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.069206 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.069496 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.069782 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.070065 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.070342 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.070638 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.075323 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.075618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.075897 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.076177 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.076456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.076736 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.077052 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.091678 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.095058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.098402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.098562 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.100747 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.102453 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.102737 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.103022 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.103636 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.107044 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.108657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.110334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.110614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.110706 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.110895 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.112403 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.115799 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.116094 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.116384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.116660 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.119263 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.120897 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.124237 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.124869 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.125158 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.125474 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.126401 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.126705 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.127001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.135108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80507) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.135397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.135686 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.135779 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.135964 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.136058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.136240 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.136334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.136534 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.136811 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.137111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.137389 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.137678 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.137968 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.138241 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.138509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.138774 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80507) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.144206 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80508) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 18 16:28:09.144483 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.144758 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.147487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.147487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.147487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.147487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.147487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.147791 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.147961 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.148239 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.148516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.148825 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.149123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80508) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 18 16:28:09.178782 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5621a6d219c0 pid: 80507 (default app) Jul 18 16:28:09.182394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce757104-8e49-4821-81f8-3cbb27c2c991 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:09.182695 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce757104-8e49-4821-81f8-3cbb27c2c991 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:09.183013 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce757104-8e49-4821-81f8-3cbb27c2c991 None None] PATH_INFO: `/v3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:09.187292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1/1] 10.222.0.76 () {50 vars in 791 bytes} [Mon Jul 18 16:28:09 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:09.188777 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5621a6d219c0 pid: 80508 (default app) Jul 18 16:28:18.270729 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf66683-7907-4036-a774-eb163aa9dfd9 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:18.271264 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf66683-7907-4036-a774-eb163aa9dfd9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:18.271347 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf66683-7907-4036-a774-eb163aa9dfd9 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:18.272689 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 2/2] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:28:18.280389 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb5743-ca61-41e0-81ea-cc2b13e21886 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:18.280848 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb5743-ca61-41e0-81ea-cc2b13e21886 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:18.280933 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb5743-ca61-41e0-81ea-cc2b13e21886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:18.351073 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: INFO dbcounter [None req-69cb5743-ca61-41e0-81ea-cc2b13e21886 None None] Registered counter for database keystone Jul 18 16:28:18.372625 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG oslo_db.sqlalchemy.engines [None req-69cb5743-ca61-41e0-81ea-cc2b13e21886 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80508) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:28:18.379845 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writer thread running {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:28:18.560948 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG passlib.handlers.bcrypt [None req-69cb5743-ca61-41e0-81ea-cc2b13e21886 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80508) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 18 16:28:18.561414 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG passlib.handlers.bcrypt [None req-69cb5743-ca61-41e0-81ea-cc2b13e21886 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80508) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 18 16:28:18.617754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-69cb5743-ca61-41e0-81ea-cc2b13e21886 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:18.619734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-69cb5743-ca61-41e0-81ea-cc2b13e21886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:18.748455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1/3] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 471 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 18 16:28:18.907730 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf66683-7907-4036-a774-eb163aa9dfd9 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:18.978442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: INFO dbcounter [None req-8cf66683-7907-4036-a774-eb163aa9dfd9 None None] Registered counter for database keystone Jul 18 16:28:18.997941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG oslo_db.sqlalchemy.engines [None req-8cf66683-7907-4036-a774-eb163aa9dfd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 16:28:19.005124 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writer thread running {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 16:28:19.128042 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf66683-7907-4036-a774-eb163aa9dfd9 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:19.133488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd9e16-e480-4a9e-b169-3d42048b37d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:19.134174 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd9e16-e480-4a9e-b169-3d42048b37d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:19.134462 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd9e16-e480-4a9e-b169-3d42048b37d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:19.134745 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd9e16-e480-4a9e-b169-3d42048b37d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:19.143616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd9e16-e480-4a9e-b169-3d42048b37d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:19.196949 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: WARNING keystone.common.rbac_enforcer.enforcer [None req-57dd9e16-e480-4a9e-b169-3d42048b37d7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 18 16:28:19.197365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd9e16-e480-4a9e-b169-3d42048b37d7 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:19.209051 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 3/4] 10.222.0.76 () {58 vars in 1324 bytes} [Mon Jul 18 16:28:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:28:19.215265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb5743-ca61-41e0-81ea-cc2b13e21886 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:19.233501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb5743-ca61-41e0-81ea-cc2b13e21886 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:19.238197 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b56fb-5b71-46b6-906e-7602e59e1080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:19.239364 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b56fb-5b71-46b6-906e-7602e59e1080 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:19.239658 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b56fb-5b71-46b6-906e-7602e59e1080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:19.239940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b56fb-5b71-46b6-906e-7602e59e1080 admin admin] PATH_INFO: `/v3/projects/0e39050787a54caf815f78d2aa8ec514` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:19.241477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b56fb-5b71-46b6-906e-7602e59e1080 admin admin] RBAC: Authorizing `identity:get_project(project_id=0e39050787a54caf815f78d2aa8ec514)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:19.294279 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f40b56fb-5b71-46b6-906e-7602e59e1080 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 18 16:28:19.294880 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b56fb-5b71-46b6-906e-7602e59e1080 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:19.299534 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 2/5] 10.222.0.76 () {56 vars in 1207 bytes} [Mon Jul 18 16:28:19 2022] GET /identity/v3/projects/0e39050787a54caf815f78d2aa8ec514 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:21.358051 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e8766-283e-4dc9-b842-b0e5ff8fa59e None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:21.358615 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e8766-283e-4dc9-b842-b0e5ff8fa59e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:21.358615 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65e8766-283e-4dc9-b842-b0e5ff8fa59e None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:21.362780 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 4/6] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:28:21.368421 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303f07e-c4de-406b-bf7c-ddbd6dfdac22 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:21.368838 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303f07e-c4de-406b-bf7c-ddbd6dfdac22 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:21.368981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303f07e-c4de-406b-bf7c-ddbd6dfdac22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:21.391164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6303f07e-c4de-406b-bf7c-ddbd6dfdac22 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:21.392710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6303f07e-c4de-406b-bf7c-ddbd6dfdac22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:21.401393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 3/7] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 18 16:28:21.423577 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e8766-283e-4dc9-b842-b0e5ff8fa59e None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:21.436635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65e8766-283e-4dc9-b842-b0e5ff8fa59e None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:21.440990 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169e69f-8838-4ec6-b8b1-3bef5f1e7779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:21.442524 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169e69f-8838-4ec6-b8b1-3bef5f1e7779 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:21.442524 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169e69f-8838-4ec6-b8b1-3bef5f1e7779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:21.442788 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169e69f-8838-4ec6-b8b1-3bef5f1e7779 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:21.450829 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169e69f-8838-4ec6-b8b1-3bef5f1e7779 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:21.452650 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8169e69f-8838-4ec6-b8b1-3bef5f1e7779 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:21.462444 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 5/8] 10.222.0.76 () {58 vars in 1324 bytes} [Mon Jul 18 16:28:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:28:21.468172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303f07e-c4de-406b-bf7c-ddbd6dfdac22 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:21.477684 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303f07e-c4de-406b-bf7c-ddbd6dfdac22 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:21.482192 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d75a9c-35ac-4725-8abd-061de645dc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:21.483060 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d75a9c-35ac-4725-8abd-061de645dc5b admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:21.483351 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d75a9c-35ac-4725-8abd-061de645dc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:21.483633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d75a9c-35ac-4725-8abd-061de645dc5b admin admin] PATH_INFO: `/v3/users/c740c2989cfd4a19b4bb2520a5d2cbf7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:21.485054 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d75a9c-35ac-4725-8abd-061de645dc5b admin admin] RBAC: Authorizing `identity:get_user(user_id=c740c2989cfd4a19b4bb2520a5d2cbf7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:21.486902 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d75a9c-35ac-4725-8abd-061de645dc5b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:21.488901 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 4/9] 10.222.0.76 () {56 vars in 1198 bytes} [Mon Jul 18 16:28:21 2022] GET /identity/v3/users/c740c2989cfd4a19b4bb2520a5d2cbf7 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:23.613716 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac3f11-4a2d-4529-929c-28408f980aad None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:23.614268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac3f11-4a2d-4529-929c-28408f980aad None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:23.614268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac3f11-4a2d-4529-929c-28408f980aad None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:23.615637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 6/10] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:23.621338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffa9c4-a013-4f91-8028-f98ca09aa680 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:23.621795 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffa9c4-a013-4f91-8028-f98ca09aa680 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:23.621885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffa9c4-a013-4f91-8028-f98ca09aa680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:23.636846 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61a5e0-c5aa-4567-a1f9-14ffa6f82477 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:23.637248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61a5e0-c5aa-4567-a1f9-14ffa6f82477 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:23.637532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef61a5e0-c5aa-4567-a1f9-14ffa6f82477 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:23.639140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 7/11] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:28:23.641222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-79ffa9c4-a013-4f91-8028-f98ca09aa680 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:23.642426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-79ffa9c4-a013-4f91-8028-f98ca09aa680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:23.647470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d657ef-cb00-4078-ada7-c885e9326e86 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:23.647852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d657ef-cb00-4078-ada7-c885e9326e86 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:23.648214 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d657ef-cb00-4078-ada7-c885e9326e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:23.691485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG passlib.handlers.bcrypt [None req-18d657ef-cb00-4078-ada7-c885e9326e86 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80507) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 18 16:28:23.691997 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG passlib.handlers.bcrypt [None req-18d657ef-cb00-4078-ada7-c885e9326e86 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80507) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 18 16:28:23.728344 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 5/12] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:28:23.739089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-18d657ef-cb00-4078-ada7-c885e9326e86 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:23.740737 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-18d657ef-cb00-4078-ada7-c885e9326e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:23.751673 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffa9c4-a013-4f91-8028-f98ca09aa680 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:23.775997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:23.850106 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 8/13] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:28:23.867241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffa9c4-a013-4f91-8028-f98ca09aa680 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:23.872280 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d657ef-cb00-4078-ada7-c885e9326e86 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:23.902850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d36540-f173-41c2-9b9b-dd0354122738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:23.903664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d36540-f173-41c2-9b9b-dd0354122738 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:23.903948 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d36540-f173-41c2-9b9b-dd0354122738 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:23.904225 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d36540-f173-41c2-9b9b-dd0354122738 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:23.916166 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d36540-f173-41c2-9b9b-dd0354122738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:23.927685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-42d36540-f173-41c2-9b9b-dd0354122738 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:23.927685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:23.927685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:23.927685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:23.927685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:23.927685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:23.927685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:23.927685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:23.927685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:23.927685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:23.927685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:23.927685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:23.927685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:23.927685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:23.927685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:23.927685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:23.928630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:23.928630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:23.928630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:23.928630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:23.928630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:23.928630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:23.928630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:23.928630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:23.928630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:23.928630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:23.928630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:23.928630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:23.928630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:23.928630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:23.928630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:23.928630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:23.929500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:23.929500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:23.929500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:23.929500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:23.929500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:23.929500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:23.929500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:23.929500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:23.929500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:23.929500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:23.929500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:23.929500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:28:23.929500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 6/14] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:28:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:23.934677 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d36540-f173-41c2-9b9b-dd0354122738 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:23.982036 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d657ef-cb00-4078-ada7-c885e9326e86 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:23.984470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:24.018006 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:24.020359 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51182d0e-0faf-40fe-84f6-e72bdd245904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:24.021290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51182d0e-0faf-40fe-84f6-e72bdd245904 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:24.021619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51182d0e-0faf-40fe-84f6-e72bdd245904 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:24.021940 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51182d0e-0faf-40fe-84f6-e72bdd245904 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:24.037392 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d36540-f173-41c2-9b9b-dd0354122738 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:24.072229 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bd578-eca1-4680-b205-3a0ca040355d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:24.072914 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bd578-eca1-4680-b205-3a0ca040355d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:24.073233 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bd578-eca1-4680-b205-3a0ca040355d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:24.073521 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884bd578-eca1-4680-b205-3a0ca040355d None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:24.074279 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884bd578-eca1-4680-b205-3a0ca040355d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:24.074590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884bd578-eca1-4680-b205-3a0ca040355d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:24.076000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884bd578-eca1-4680-b205-3a0ca040355d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:24.090444 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 7/15] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:24.096026 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51182d0e-0faf-40fe-84f6-e72bdd245904 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:24.096191 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bd578-eca1-4680-b205-3a0ca040355d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:24.098621 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51182d0e-0faf-40fe-84f6-e72bdd245904 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:24.208349 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884bd578-eca1-4680-b205-3a0ca040355d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:24.214477 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 9/16] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 16:28:24.220289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51182d0e-0faf-40fe-84f6-e72bdd245904 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:24.224106 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:24.244123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67f79a-5270-4d0e-8fe3-cfd387b66f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:24.245037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67f79a-5270-4d0e-8fe3-cfd387b66f80 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:24.245328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67f79a-5270-4d0e-8fe3-cfd387b66f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:24.245604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67f79a-5270-4d0e-8fe3-cfd387b66f80 None admin] PATH_INFO: `/v3/users/c740c2989cfd4a19b4bb2520a5d2cbf7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:24.246876 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67f79a-5270-4d0e-8fe3-cfd387b66f80 None admin] RBAC: Authorizing `identity:get_user(user_id=c740c2989cfd4a19b4bb2520a5d2cbf7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:24.248371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67f79a-5270-4d0e-8fe3-cfd387b66f80 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:24.250294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 8/17] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:24 2022] GET /identity/v3/users/c740c2989cfd4a19b4bb2520a5d2cbf7 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:24.256303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67f79a-5270-4d0e-8fe3-cfd387b66f80 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:24.271704 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:24.323589 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51182d0e-0faf-40fe-84f6-e72bdd245904 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:24.359295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67f79a-5270-4d0e-8fe3-cfd387b66f80 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:24.359882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e21474-f756-4cc2-afe2-593b01e20854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:24.360792 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e21474-f756-4cc2-afe2-593b01e20854 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:24.361113 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e21474-f756-4cc2-afe2-593b01e20854 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:24.361397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e21474-f756-4cc2-afe2-593b01e20854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:24.381848 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e21474-f756-4cc2-afe2-593b01e20854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:24.383366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e21474-f756-4cc2-afe2-593b01e20854 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:24.397471 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf47a31-9f80-4e39-9a16-8a2597e7f7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:24.398418 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf47a31-9f80-4e39-9a16-8a2597e7f7af None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:24.398707 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf47a31-9f80-4e39-9a16-8a2597e7f7af None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:24.398988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf47a31-9f80-4e39-9a16-8a2597e7f7af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:24.400170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf47a31-9f80-4e39-9a16-8a2597e7f7af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:24.401669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf47a31-9f80-4e39-9a16-8a2597e7f7af None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:24.403506 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 9/18] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:24.406851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-44e21474-f756-4cc2-afe2-593b01e20854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:24.406851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:24.406851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:24.406851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:24.406851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:24.406851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:24.406851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:24.406851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:24.406851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:24.406851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:24.406851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:24.406851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:24.406851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:24.406851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:24.406851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:24.407840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:24.407840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:24.407840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:24.407840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:24.407840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:24.407840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:24.407840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:24.407840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:24.407840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:24.407840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:24.407840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:24.407840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:24.407840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:24.407840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:24.407840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:24.407840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:24.407840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:24.408815 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:24.408815 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:24.408815 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:24.408815 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:28:24.408815 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 10/19] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:24.409525 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf47a31-9f80-4e39-9a16-8a2597e7f7af None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:24.415488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e21474-f756-4cc2-afe2-593b01e20854 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:24.473527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:24.493548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:24.512865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf47a31-9f80-4e39-9a16-8a2597e7f7af None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:24.518436 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e21474-f756-4cc2-afe2-593b01e20854 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:24.548707 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320fe31-45d5-45be-bd80-8fbb3e1bf49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:24.549404 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320fe31-45d5-45be-bd80-8fbb3e1bf49f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:24.549694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320fe31-45d5-45be-bd80-8fbb3e1bf49f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:24.549986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320fe31-45d5-45be-bd80-8fbb3e1bf49f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:24.551561 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320fe31-45d5-45be-bd80-8fbb3e1bf49f None admin] RBAC: Adding query filter params (role.id=c2d5d80485df4730903a874937d68aa3, scope.domain.id=default, user.id=c740c2989cfd4a19b4bb2520a5d2cbf7) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:24.551874 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320fe31-45d5-45be-bd80-8fbb3e1bf49f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:24.553358 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320fe31-45d5-45be-bd80-8fbb3e1bf49f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:24.561175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 10/20] 10.222.0.76 () {56 vars in 1322 bytes} [Mon Jul 18 16:28:24 2022] GET /identity/v3/role_assignments?user.id=c740c2989cfd4a19b4bb2520a5d2cbf7&scope.domain.id=default&role.id=c2d5d80485df4730903a874937d68aa3 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:24.565213 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2584dd7-cccf-4732-af88-a7b960d5efb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:24.566119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2584dd7-cccf-4732-af88-a7b960d5efb9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:24.566411 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2584dd7-cccf-4732-af88-a7b960d5efb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:24.566834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2584dd7-cccf-4732-af88-a7b960d5efb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:24.567906 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2584dd7-cccf-4732-af88-a7b960d5efb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:24.568221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2584dd7-cccf-4732-af88-a7b960d5efb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:24.569734 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2584dd7-cccf-4732-af88-a7b960d5efb9 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:24.590654 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 11/21] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:27.195536 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f124d-2b67-47ed-9da5-84fae9235f8b None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:27.196076 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f124d-2b67-47ed-9da5-84fae9235f8b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:27.196542 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f124d-2b67-47ed-9da5-84fae9235f8b None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:27.199329 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 11/22] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:27.206207 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dd1e7-0b4b-4394-b91e-ef8a033a88d0 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:27.208049 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dd1e7-0b4b-4394-b91e-ef8a033a88d0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:27.208782 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980dd1e7-0b4b-4394-b91e-ef8a033a88d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:27.246551 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-980dd1e7-0b4b-4394-b91e-ef8a033a88d0 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:27.247763 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-980dd1e7-0b4b-4394-b91e-ef8a033a88d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:27.347517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 12/23] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:27.382980 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f124d-2b67-47ed-9da5-84fae9235f8b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:27.554627 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f124d-2b67-47ed-9da5-84fae9235f8b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:27.609733 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94ffb5-074d-41e5-a11b-54763ca36e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:27.610450 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94ffb5-074d-41e5-a11b-54763ca36e66 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:27.610740 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94ffb5-074d-41e5-a11b-54763ca36e66 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:27.611017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94ffb5-074d-41e5-a11b-54763ca36e66 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:27.611789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94ffb5-074d-41e5-a11b-54763ca36e66 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:27.614057 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94ffb5-074d-41e5-a11b-54763ca36e66 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:27.653521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02172fab-f712-43e4-95dc-d6d4cd1f9096 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:27.653809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02172fab-f712-43e4-95dc-d6d4cd1f9096 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:27.654294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02172fab-f712-43e4-95dc-d6d4cd1f9096 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:27.655874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 13/24] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:28:27.661270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd149e0a-d749-4fae-9ff7-5fc6f6565c71 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:27.661766 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd149e0a-d749-4fae-9ff7-5fc6f6565c71 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:27.662221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd149e0a-d749-4fae-9ff7-5fc6f6565c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:27.687809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-cd149e0a-d749-4fae-9ff7-5fc6f6565c71 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:27.689349 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-cd149e0a-d749-4fae-9ff7-5fc6f6565c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:27.743978 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:27.771669 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 14/25] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:27.777338 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f721f-a795-48c9-be34-414c90b62ddc None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:27.777836 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f721f-a795-48c9-be34-414c90b62ddc None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:27.778311 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f721f-a795-48c9-be34-414c90b62ddc None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:27.779985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 15/26] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:27.781991 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e3681-32ae-4ca1-86ca-c58addd080be None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:27.782668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e3681-32ae-4ca1-86ca-c58addd080be None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:27.783326 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48e3681-32ae-4ca1-86ca-c58addd080be None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:27.785862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 16/27] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:27.787603 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee2985-0496-44df-8179-2cf860c94e52 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:27.788085 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee2985-0496-44df-8179-2cf860c94e52 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:27.788689 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee2985-0496-44df-8179-2cf860c94e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:27.821531 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-80ee2985-0496-44df-8179-2cf860c94e52 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:27.822988 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-80ee2985-0496-44df-8179-2cf860c94e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:27.844160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 12/28] 10.222.0.76 () {60 vars in 1131 bytes} [Mon Jul 18 16:28:27 2022] POST /identity/v3/roles => generated 219 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:27.847798 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57419b1e-cb6f-4d2f-815e-de07c4139b83 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:27.848378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57419b1e-cb6f-4d2f-815e-de07c4139b83 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:27.848865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57419b1e-cb6f-4d2f-815e-de07c4139b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:27.864228 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:27.890715 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-57419b1e-cb6f-4d2f-815e-de07c4139b83 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:27.895937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-57419b1e-cb6f-4d2f-815e-de07c4139b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:27.980583 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 17/29] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:27.981506 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee2985-0496-44df-8179-2cf860c94e52 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:28.058377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 13/30] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:28.060333 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57419b1e-cb6f-4d2f-815e-de07c4139b83 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:28.154027 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee2985-0496-44df-8179-2cf860c94e52 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:28.165126 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:28.199915 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677c3ea-fde9-4c82-978b-fc35d76fd67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:28.201046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677c3ea-fde9-4c82-978b-fc35d76fd67f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:28.201530 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677c3ea-fde9-4c82-978b-fc35d76fd67f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:28.202043 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677c3ea-fde9-4c82-978b-fc35d76fd67f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:28.209170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57419b1e-cb6f-4d2f-815e-de07c4139b83 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:28.214605 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677c3ea-fde9-4c82-978b-fc35d76fd67f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:28.216132 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677c3ea-fde9-4c82-978b-fc35d76fd67f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:28.238849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-b677c3ea-fde9-4c82-978b-fc35d76fd67f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:28.238849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:28.238849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:28.238849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:28.238849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:28.238849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:28.238849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:28.238849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:28.238849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:28.238849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:28.238849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:28.238849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:28.238849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:28:28.238849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:28:28.238849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:28:28.239735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:28:28.239735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:28.239735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:28.239735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:28.239735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:28.239735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:28.239735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:28.239735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:28.239735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:28.239735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:28.239735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:28.239735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:28.239735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:28.239735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:28.239735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:28.239735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:28.239735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:28.240553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:28:28.240553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:28:28.240553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:28:28.240553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:28:28.240553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 18/31] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:28.246313 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677c3ea-fde9-4c82-978b-fc35d76fd67f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:28.255703 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e3a12-7fcc-4fab-af8d-acafdf93cd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:28.256432 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e3a12-7fcc-4fab-af8d-acafdf93cd86 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:28.256735 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e3a12-7fcc-4fab-af8d-acafdf93cd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:28.257100 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e3a12-7fcc-4fab-af8d-acafdf93cd86 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:28.257821 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e3a12-7fcc-4fab-af8d-acafdf93cd86 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:28.260064 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9e3a12-7fcc-4fab-af8d-acafdf93cd86 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:28.263130 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:28.328126 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 14/32] 10.222.0.76 () {60 vars in 1131 bytes} [Mon Jul 18 16:28:28 2022] POST /identity/v3/roles => generated 225 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:28.328977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e3a12-7fcc-4fab-af8d-acafdf93cd86 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:28.393307 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677c3ea-fde9-4c82-978b-fc35d76fd67f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:28.445407 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9e3a12-7fcc-4fab-af8d-acafdf93cd86 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:28.450497 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde1ea4-0957-4984-867f-c51a36e8d8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:28.451643 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde1ea4-0957-4984-867f-c51a36e8d8d9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:28.452139 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde1ea4-0957-4984-867f-c51a36e8d8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:28.452616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde1ea4-0957-4984-867f-c51a36e8d8d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:28.480850 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde1ea4-0957-4984-867f-c51a36e8d8d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:28.491835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-ffde1ea4-0957-4984-867f-c51a36e8d8d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:28.491835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:28.491835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:28.491835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:28.491835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:28.491835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:28.491835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:28.491835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:28.491835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:28.491835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:28.491835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:28.491835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:28.491835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:28.491835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:28.491835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:28.491835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:28.492752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:28.492752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:28.492752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:28.492752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:28.492752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:28.492752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:28.492752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:28.492752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:28.492752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:28.492752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:28.492752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:28.492752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:28.492752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:28.492752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:28.492752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:28.492752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:28.493652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:28.493652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:28.493652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:28.493652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:28.493652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:28.493652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:28.493652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:28.493652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:28.493652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:28.493652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:28.493652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:28.493652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:28:28.493652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 19/33] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:28:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:28.502111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde1ea4-0957-4984-867f-c51a36e8d8d9 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:28.524457 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f0786-ae38-42eb-a2af-5fbe4d4e699a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:28.525659 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f0786-ae38-42eb-a2af-5fbe4d4e699a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:28.526203 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f0786-ae38-42eb-a2af-5fbe4d4e699a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:28.526692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f0786-ae38-42eb-a2af-5fbe4d4e699a None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:28.527812 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f0786-ae38-42eb-a2af-5fbe4d4e699a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:28.528964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f0786-ae38-42eb-a2af-5fbe4d4e699a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:28.536300 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f0786-ae38-42eb-a2af-5fbe4d4e699a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:28.560018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:28.575105 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 15/34] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:28.581283 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f0786-ae38-42eb-a2af-5fbe4d4e699a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:28.662115 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:28.682646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde1ea4-0957-4984-867f-c51a36e8d8d9 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:28.720984 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaad32-4a4d-4be0-8d88-8a19cb134cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:28.721821 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaad32-4a4d-4be0-8d88-8a19cb134cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:28.722165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaad32-4a4d-4be0-8d88-8a19cb134cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:28.723263 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbaad32-4a4d-4be0-8d88-8a19cb134cd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:28.724076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbaad32-4a4d-4be0-8d88-8a19cb134cd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:28.724378 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbaad32-4a4d-4be0-8d88-8a19cb134cd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:28.725896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbaad32-4a4d-4be0-8d88-8a19cb134cd1 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:28.728919 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f0786-ae38-42eb-a2af-5fbe4d4e699a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:28.739826 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 20/35] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:28.746699 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaad32-4a4d-4be0-8d88-8a19cb134cd1 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:28.770033 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c59d6-e050-4e14-8a69-85a18ba9cb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:28.771073 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c59d6-e050-4e14-8a69-85a18ba9cb92 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:28.771586 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c59d6-e050-4e14-8a69-85a18ba9cb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:28.772067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c59d6-e050-4e14-8a69-85a18ba9cb92 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:28.772998 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c59d6-e050-4e14-8a69-85a18ba9cb92 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:28.774848 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35c59d6-e050-4e14-8a69-85a18ba9cb92 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:28.852506 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:28.878173 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbaad32-4a4d-4be0-8d88-8a19cb134cd1 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:28.917037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 16/36] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 16:28:28 2022] POST /identity/v3/projects => generated 301 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:28.926604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4a3df-6c5e-485e-b68c-7cd7083a667b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:28.927598 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4a3df-6c5e-485e-b68c-7cd7083a667b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:28.927888 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4a3df-6c5e-485e-b68c-7cd7083a667b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:28.928167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4a3df-6c5e-485e-b68c-7cd7083a667b None admin] PATH_INFO: `/v3/users/c740c2989cfd4a19b4bb2520a5d2cbf7` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:28.929953 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4a3df-6c5e-485e-b68c-7cd7083a667b None admin] RBAC: Authorizing `identity:get_user(user_id=c740c2989cfd4a19b4bb2520a5d2cbf7)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:28.931559 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4a3df-6c5e-485e-b68c-7cd7083a667b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:28.933713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 21/37] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:28 2022] GET /identity/v3/users/c740c2989cfd4a19b4bb2520a5d2cbf7 => generated 247 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:28.939811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c59d6-e050-4e14-8a69-85a18ba9cb92 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:28.955511 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f9d9d-826f-4191-8ba7-d499a54b7dce None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:28.955838 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f9d9d-826f-4191-8ba7-d499a54b7dce None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:28.956091 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f9d9d-826f-4191-8ba7-d499a54b7dce None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:28.958518 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 22/38] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:28:28.964859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87fc80-6d7e-4d60-bab8-9f72229a7897 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:28.965208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87fc80-6d7e-4d60-bab8-9f72229a7897 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:28.965499 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d87fc80-6d7e-4d60-bab8-9f72229a7897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:28.984895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-6d87fc80-6d7e-4d60-bab8-9f72229a7897 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:28.986543 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6d87fc80-6d7e-4d60-bab8-9f72229a7897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:29.065448 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c59d6-e050-4e14-8a69-85a18ba9cb92 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:29.075874 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:29.088631 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 23/39] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:28:29.110562 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb92fed-bd5a-445c-bec6-931cac72ecb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:29.111422 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb92fed-bd5a-445c-bec6-931cac72ecb8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:29.111676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb92fed-bd5a-445c-bec6-931cac72ecb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:29.111970 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb92fed-bd5a-445c-bec6-931cac72ecb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:29.113395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87fc80-6d7e-4d60-bab8-9f72229a7897 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:29.113871 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb92fed-bd5a-445c-bec6-931cac72ecb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:29.115733 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb92fed-bd5a-445c-bec6-931cac72ecb8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:29.117540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 17/40] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:29.124426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb92fed-bd5a-445c-bec6-931cac72ecb8 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:29.230764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:29.257203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d87fc80-6d7e-4d60-bab8-9f72229a7897 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:29.272984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb92fed-bd5a-445c-bec6-931cac72ecb8 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:29.298659 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd1c9d-e11b-4e3a-9326-41c743be6314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:29.299719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd1c9d-e11b-4e3a-9326-41c743be6314 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:29.300676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd1c9d-e11b-4e3a-9326-41c743be6314 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:29.301094 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fd1c9d-e11b-4e3a-9326-41c743be6314 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:29.302743 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd1c9d-e11b-4e3a-9326-41c743be6314 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:29.305389 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fd1c9d-e11b-4e3a-9326-41c743be6314 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:29.320266 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7798ced-4c4d-43b4-8c59-5c517cbff990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:29.321260 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7798ced-4c4d-43b4-8c59-5c517cbff990 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:29.321574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7798ced-4c4d-43b4-8c59-5c517cbff990 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:29.321882 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7798ced-4c4d-43b4-8c59-5c517cbff990 None admin] PATH_INFO: `/v3/domains/default/users/c740c2989cfd4a19b4bb2520a5d2cbf7/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:29.324045 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7798ced-4c4d-43b4-8c59-5c517cbff990 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c740c2989cfd4a19b4bb2520a5d2cbf7, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:29.325661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7798ced-4c4d-43b4-8c59-5c517cbff990 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:29.426773 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 18/41] 10.222.0.76 () {58 vars in 1361 bytes} [Mon Jul 18 16:28:29 2022] PUT /identity/v3/domains/default/users/c740c2989cfd4a19b4bb2520a5d2cbf7/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:28:29.428544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fbd88-9044-41b7-ab38-b498fd79877c None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:29.428854 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fbd88-9044-41b7-ab38-b498fd79877c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:29.429206 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1fbd88-9044-41b7-ab38-b498fd79877c None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:29.431068 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 19/42] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:29.437513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43279728-ae5c-4de6-b560-1b29d6613186 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:29.437832 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43279728-ae5c-4de6-b560-1b29d6613186 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:29.438122 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43279728-ae5c-4de6-b560-1b29d6613186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:29.508045 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 24/43] 10.222.0.76 () {60 vars in 1131 bytes} [Mon Jul 18 16:28:29 2022] POST /identity/v3/roles => generated 223 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:28:29.576269 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-43279728-ae5c-4de6-b560-1b29d6613186 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:29.577720 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-43279728-ae5c-4de6-b560-1b29d6613186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:29.618665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:29.670499 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 20/44] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:28:29.695881 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd1c9d-e11b-4e3a-9326-41c743be6314 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:29.814656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fd1c9d-e11b-4e3a-9326-41c743be6314 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:29.851193 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c93604-9ffd-4759-a098-49aec96c7b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:29.852009 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c93604-9ffd-4759-a098-49aec96c7b15 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:29.852301 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c93604-9ffd-4759-a098-49aec96c7b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:29.852585 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c93604-9ffd-4759-a098-49aec96c7b15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:29.853901 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c93604-9ffd-4759-a098-49aec96c7b15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:29.855476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c93604-9ffd-4759-a098-49aec96c7b15 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:29.857216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 25/45] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:29.862949 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43279728-ae5c-4de6-b560-1b29d6613186 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:29.963519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43279728-ae5c-4de6-b560-1b29d6613186 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:29.997642 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57571105-270d-4d89-97f5-82cd7950a8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:29.998322 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57571105-270d-4d89-97f5-82cd7950a8b6 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:29.998872 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57571105-270d-4d89-97f5-82cd7950a8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:29.999168 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57571105-270d-4d89-97f5-82cd7950a8b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:29.999888 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57571105-270d-4d89-97f5-82cd7950a8b6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:30.001375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57571105-270d-4d89-97f5-82cd7950a8b6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:30.096010 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 21/46] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 16:28:29 2022] POST /identity/v3/projects => generated 312 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:31.533701 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa5ec4-7aed-4594-a8a2-2dd9a9ac6c54 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:31.534231 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa5ec4-7aed-4594-a8a2-2dd9a9ac6c54 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:31.534317 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa5ec4-7aed-4594-a8a2-2dd9a9ac6c54 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:31.535765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 26/47] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:31.541452 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999af0df-6b00-4609-b229-b5a4844148b7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:31.541940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999af0df-6b00-4609-b229-b5a4844148b7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:31.542032 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999af0df-6b00-4609-b229-b5a4844148b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:31.559468 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-999af0df-6b00-4609-b229-b5a4844148b7 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:31.560657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-999af0df-6b00-4609-b229-b5a4844148b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:31.571643 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:31.631133 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 22/48] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:31.654159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa5ec4-7aed-4594-a8a2-2dd9a9ac6c54 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:31.664046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:31.759446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa5ec4-7aed-4594-a8a2-2dd9a9ac6c54 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:31.797496 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224aeb7-28bc-4b31-8976-e047925f847d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:31.797496 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224aeb7-28bc-4b31-8976-e047925f847d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:31.797496 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224aeb7-28bc-4b31-8976-e047925f847d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:31.797496 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7224aeb7-28bc-4b31-8976-e047925f847d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:31.808215 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7224aeb7-28bc-4b31-8976-e047925f847d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:31.816676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-7224aeb7-28bc-4b31-8976-e047925f847d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:31.816676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:31.816676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:31.816676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:31.816676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:31.816676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:31.816676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:31.816676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:31.816676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:31.816676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:31.816676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:31.816676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:31.816676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:31.816676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:31.816676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:31.816676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:31.817779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:31.817779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:31.817779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:31.817779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:31.817779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:31.817779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:31.817779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:31.817779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:31.817779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:31.817779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:31.817779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:31.817779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:31.817779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:31.817779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:31.817779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:31.817779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:31.818918 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:31.818918 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:31.818918 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:31.818918 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:31.818918 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:31.818918 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:31.818918 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:31.818918 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:31.818918 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:31.818918 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:31.818918 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:31.818918 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:28:31.818918 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 27/49] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:28:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:31.824146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999af0df-6b00-4609-b229-b5a4844148b7 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:31.928926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999af0df-6b00-4609-b229-b5a4844148b7 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:31.962538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af168b8-cb8c-456f-8f14-b555d4e43e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:31.963218 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af168b8-cb8c-456f-8f14-b555d4e43e6e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:31.963508 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af168b8-cb8c-456f-8f14-b555d4e43e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:31.963793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af168b8-cb8c-456f-8f14-b555d4e43e6e None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:31.964548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af168b8-cb8c-456f-8f14-b555d4e43e6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:31.964864 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af168b8-cb8c-456f-8f14-b555d4e43e6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:31.966358 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af168b8-cb8c-456f-8f14-b555d4e43e6e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:31.975412 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 23/50] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:31.981169 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224aeb7-28bc-4b31-8976-e047925f847d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:32.047585 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:32.082353 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7224aeb7-28bc-4b31-8976-e047925f847d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:32.116447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddc5a4-5720-4cab-8ded-bb871a98fa6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:32.117345 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddc5a4-5720-4cab-8ded-bb871a98fa6d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:32.117635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddc5a4-5720-4cab-8ded-bb871a98fa6d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:32.117915 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faddc5a4-5720-4cab-8ded-bb871a98fa6d None admin] PATH_INFO: `/v3/users/c740c2989cfd4a19b4bb2520a5d2cbf7` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:32.118277 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa9433-0bb3-46e0-91aa-6a1d3f9e6c0d None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:32.118584 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa9433-0bb3-46e0-91aa-6a1d3f9e6c0d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:32.118870 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aa9433-0bb3-46e0-91aa-6a1d3f9e6c0d None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:32.119207 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddc5a4-5720-4cab-8ded-bb871a98fa6d None admin] RBAC: Authorizing `identity:get_user(user_id=c740c2989cfd4a19b4bb2520a5d2cbf7)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:32.120263 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 24/51] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:32.120667 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faddc5a4-5720-4cab-8ded-bb871a98fa6d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:32.122491 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 28/52] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:31 2022] GET /identity/v3/users/c740c2989cfd4a19b4bb2520a5d2cbf7 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:32.125612 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3f6f0-f034-4180-91c8-8c7b0902bbf4 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:32.125910 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3f6f0-f034-4180-91c8-8c7b0902bbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:32.126197 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d3f6f0-f034-4180-91c8-8c7b0902bbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:32.127811 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddc5a4-5720-4cab-8ded-bb871a98fa6d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:32.143088 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a1d3f6f0-f034-4180-91c8-8c7b0902bbf4 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:32.144314 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a1d3f6f0-f034-4180-91c8-8c7b0902bbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:32.146604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:32.215171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 25/53] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:32.239129 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3f6f0-f034-4180-91c8-8c7b0902bbf4 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:32.338674 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faddc5a4-5720-4cab-8ded-bb871a98fa6d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:32.351817 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d3f6f0-f034-4180-91c8-8c7b0902bbf4 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:32.373181 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b37cff-fe1e-44f1-8844-7053fb77b263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:32.374251 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b37cff-fe1e-44f1-8844-7053fb77b263 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:32.374542 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b37cff-fe1e-44f1-8844-7053fb77b263 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:32.374826 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b37cff-fe1e-44f1-8844-7053fb77b263 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:32.376091 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b37cff-fe1e-44f1-8844-7053fb77b263 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:32.377704 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b37cff-fe1e-44f1-8844-7053fb77b263 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:32.379322 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 29/54] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:32.385227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b37cff-fe1e-44f1-8844-7053fb77b263 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:32.386250 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39a3b9-74b9-480f-843c-1a1d3d8502fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:32.387084 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39a3b9-74b9-480f-843c-1a1d3d8502fe None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:32.387375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39a3b9-74b9-480f-843c-1a1d3d8502fe None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:32.387663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b39a3b9-74b9-480f-843c-1a1d3d8502fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:32.388040 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:32.389281 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39a3b9-74b9-480f-843c-1a1d3d8502fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:32.390824 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b39a3b9-74b9-480f-843c-1a1d3d8502fe None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:32.392459 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 26/55] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:32.398462 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39a3b9-74b9-480f-843c-1a1d3d8502fe None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:32.407431 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:32.486698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b37cff-fe1e-44f1-8844-7053fb77b263 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:32.503749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b39a3b9-74b9-480f-843c-1a1d3d8502fe None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:32.523182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227c3df-d888-4824-8e79-86d6c60dc347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:32.523978 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227c3df-d888-4824-8e79-86d6c60dc347 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:32.524338 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227c3df-d888-4824-8e79-86d6c60dc347 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:32.524630 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227c3df-d888-4824-8e79-86d6c60dc347 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:32.525513 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227c3df-d888-4824-8e79-86d6c60dc347 None admin] RBAC: Adding query filter params (role.id=c2d5d80485df4730903a874937d68aa3, scope.domain.id=default, user.id=c740c2989cfd4a19b4bb2520a5d2cbf7) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:32.525833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227c3df-d888-4824-8e79-86d6c60dc347 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:32.527292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3227c3df-d888-4824-8e79-86d6c60dc347 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:32.536731 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 30/56] 10.222.0.76 () {56 vars in 1322 bytes} [Mon Jul 18 16:28:32 2022] GET /identity/v3/role_assignments?user.id=c740c2989cfd4a19b4bb2520a5d2cbf7&scope.domain.id=default&role.id=c2d5d80485df4730903a874937d68aa3 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:32.541174 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5407ec-280a-4071-a6e9-0d74b6b8fca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:32.541867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5407ec-280a-4071-a6e9-0d74b6b8fca0 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:32.542390 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5407ec-280a-4071-a6e9-0d74b6b8fca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:32.542474 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5407ec-280a-4071-a6e9-0d74b6b8fca0 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:32.543314 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5407ec-280a-4071-a6e9-0d74b6b8fca0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:32.544835 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5407ec-280a-4071-a6e9-0d74b6b8fca0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:32.674016 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 27/57] 10.222.0.76 () {60 vars in 1140 bytes} [Mon Jul 18 16:28:32 2022] POST /identity/v3/projects => generated 298 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:34.697326 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34177d-7021-46ee-877d-1eca1750f1f5 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:34.697874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34177d-7021-46ee-877d-1eca1750f1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:34.697972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34177d-7021-46ee-877d-1eca1750f1f5 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:34.699298 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 31/58] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:34.704350 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8a81a-d973-4a57-9b94-82db2b724412 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:34.704772 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8a81a-d973-4a57-9b94-82db2b724412 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:34.704914 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8a81a-d973-4a57-9b94-82db2b724412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:34.722431 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a9a8a81a-d973-4a57-9b94-82db2b724412 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:34.723696 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a9a8a81a-d973-4a57-9b94-82db2b724412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:34.776633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:34.790914 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 28/59] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:34.816012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34177d-7021-46ee-877d-1eca1750f1f5 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:34.888540 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:34.926425 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34177d-7021-46ee-877d-1eca1750f1f5 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:34.959895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092fb16b-e979-4054-adb8-139b3e49b9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:34.960627 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fb16b-e979-4054-adb8-139b3e49b9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:34.960918 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fb16b-e979-4054-adb8-139b3e49b9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:34.961238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092fb16b-e979-4054-adb8-139b3e49b9a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:34.962433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fb16b-e979-4054-adb8-139b3e49b9a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:34.963896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092fb16b-e979-4054-adb8-139b3e49b9a4 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:34.965706 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 32/60] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:34.971395 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8a81a-d973-4a57-9b94-82db2b724412 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:35.072078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8a81a-d973-4a57-9b94-82db2b724412 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:35.107277 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7ad982-6c83-4f36-a86c-89a532e106cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:35.107954 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ad982-6c83-4f36-a86c-89a532e106cf None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:35.108246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ad982-6c83-4f36-a86c-89a532e106cf None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:35.108528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7ad982-6c83-4f36-a86c-89a532e106cf None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:35.109284 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ad982-6c83-4f36-a86c-89a532e106cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:35.110744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7ad982-6c83-4f36-a86c-89a532e106cf None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:35.220202 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 29/61] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 16:28:34 2022] POST /identity/v3/users => generated 275 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:38.283155 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76407231-53e7-42e2-a7d2-6f67513bfffd None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:38.284241 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76407231-53e7-42e2-a7d2-6f67513bfffd None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:38.284741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76407231-53e7-42e2-a7d2-6f67513bfffd None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:38.286397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 33/62] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:38.291888 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0afbd9-9c16-4c1c-9bf2-fadf3f484246 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:38.292735 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0afbd9-9c16-4c1c-9bf2-fadf3f484246 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:38.293265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0afbd9-9c16-4c1c-9bf2-fadf3f484246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:38.316238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6e0afbd9-9c16-4c1c-9bf2-fadf3f484246 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:38.317851 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6e0afbd9-9c16-4c1c-9bf2-fadf3f484246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:38.377177 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:38.410825 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 30/63] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:38.454996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76407231-53e7-42e2-a7d2-6f67513bfffd None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:38.576208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76407231-53e7-42e2-a7d2-6f67513bfffd None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:38.622153 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4e88b2-0096-4cf0-9bb4-df29e6e7d4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:38.622991 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e88b2-0096-4cf0-9bb4-df29e6e7d4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:38.623279 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e88b2-0096-4cf0-9bb4-df29e6e7d4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:38.623820 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4e88b2-0096-4cf0-9bb4-df29e6e7d4f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:38.629900 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:38.641896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4e88b2-0096-4cf0-9bb4-df29e6e7d4f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:38.650361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-1a4e88b2-0096-4cf0-9bb4-df29e6e7d4f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:28:38.650361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:38.650361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:38.650361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:38.650361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:38.650361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:38.650361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:38.650361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:38.650361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:38.650361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:38.650361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:38.650361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:38.650361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:38.650361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:38.650361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:38.650361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:38.652636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:38.652636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:38.652636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:38.652636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:38.652636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:38.652636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:38.652636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:38.652636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:38.652636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:38.652636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:38.652636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:38.652636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:38.652636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:38.652636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:38.652636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:38.652636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:38.653548 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:38.653548 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:38.653548 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:38.653548 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:38.653548 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:38.653548 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:38.653548 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:38.653548 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:38.653548 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:38.653548 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:38.653548 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:28:38.653548 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:28:38.653548 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 34/64] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:38.659844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0afbd9-9c16-4c1c-9bf2-fadf3f484246 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:38.662135 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecb39a-0aac-47e2-aaa1-30c72a6ade98 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:38.662435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecb39a-0aac-47e2-aaa1-30c72a6ade98 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:38.662730 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cecb39a-0aac-47e2-aaa1-30c72a6ade98 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:38.664267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 35/65] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:28:38.669415 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2204c0-0c30-4a15-8676-00ba30296f4f None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:38.669715 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2204c0-0c30-4a15-8676-00ba30296f4f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:38.670000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2204c0-0c30-4a15-8676-00ba30296f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:38.697599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-0f2204c0-0c30-4a15-8676-00ba30296f4f None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:38.700199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0f2204c0-0c30-4a15-8676-00ba30296f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:38.792393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0afbd9-9c16-4c1c-9bf2-fadf3f484246 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:38.855550 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 36/66] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:28:38.859623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d988b-c245-4521-9776-d40e17ffbc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:38.860556 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d988b-c245-4521-9776-d40e17ffbc8d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:38.861100 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d988b-c245-4521-9776-d40e17ffbc8d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:38.861612 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d988b-c245-4521-9776-d40e17ffbc8d None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:38.862698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b0ea0-1c71-4742-831b-3e684d1368dd None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:38.863034 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b0ea0-1c71-4742-831b-3e684d1368dd None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:38.863335 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b0ea0-1c71-4742-831b-3e684d1368dd None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:38.863852 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d988b-c245-4521-9776-d40e17ffbc8d None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:38.864377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d988b-c245-4521-9776-d40e17ffbc8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:38.864873 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 37/67] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:38.868794 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca705bf-7852-4cbd-9122-e1dcd4b42a8d None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:38.868794 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca705bf-7852-4cbd-9122-e1dcd4b42a8d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:38.868794 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca705bf-7852-4cbd-9122-e1dcd4b42a8d None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:38.870677 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d988b-c245-4521-9776-d40e17ffbc8d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:38.872169 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 38/68] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:38.873837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fe96a-8804-406f-b63b-0e1f0bb7b5a1 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:38.874197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fe96a-8804-406f-b63b-0e1f0bb7b5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:38.874497 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2fe96a-8804-406f-b63b-0e1f0bb7b5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:38.882597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 31/69] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:28:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:38.884201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74e0c9-78fb-462a-b8cb-a69c6a50b4d2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:38.884707 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74e0c9-78fb-462a-b8cb-a69c6a50b4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:38.885294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74e0c9-78fb-462a-b8cb-a69c6a50b4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:38.892350 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-3c2fe96a-8804-406f-b63b-0e1f0bb7b5a1 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:38.894155 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3c2fe96a-8804-406f-b63b-0e1f0bb7b5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:38.903825 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2f74e0c9-78fb-462a-b8cb-a69c6a50b4d2 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:38.905055 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2f74e0c9-78fb-462a-b8cb-a69c6a50b4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:38.936090 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:38.970832 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 39/70] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:38.971727 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fe96a-8804-406f-b63b-0e1f0bb7b5a1 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:38.984560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 32/71] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:38.985731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74e0c9-78fb-462a-b8cb-a69c6a50b4d2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:39.050811 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:39.099799 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2fe96a-8804-406f-b63b-0e1f0bb7b5a1 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:39.101524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74e0c9-78fb-462a-b8cb-a69c6a50b4d2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:39.135939 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a60346-e2ad-4e50-a01e-10dbe5c58ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:39.136752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a60346-e2ad-4e50-a01e-10dbe5c58ade None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:39.137081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a60346-e2ad-4e50-a01e-10dbe5c58ade None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:39.137362 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a60346-e2ad-4e50-a01e-10dbe5c58ade None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:39.140630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27789642-2f2b-4c36-8805-aa864b05bf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:39.141607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27789642-2f2b-4c36-8805-aa864b05bf8e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:39.141951 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27789642-2f2b-4c36-8805-aa864b05bf8e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:39.142328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27789642-2f2b-4c36-8805-aa864b05bf8e None admin] PATH_INFO: `/v3/users/99906ed469184f2280ab4490ea782efa` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:39.148826 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a60346-e2ad-4e50-a01e-10dbe5c58ade None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:39.156713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-e7a60346-e2ad-4e50-a01e-10dbe5c58ade None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:39.156713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:39.156713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:39.156713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:39.156713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:39.156713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:39.156713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:39.156713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:39.156713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:39.156713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:39.156713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:39.156713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:39.156713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:39.156713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:39.156713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:39.156713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:39.157661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:39.157661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:39.157661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:39.157661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:39.157661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:39.157661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:39.157661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:39.157661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:39.157661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:39.157661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:39.157661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:39.157661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:39.157661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:39.157661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:39.157661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:39.157661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:39.158471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:39.158471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:39.158471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:39.158471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:39.158471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:39.158471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:39.158471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:39.158471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:39.158471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:39.158471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:39.158471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:39.158471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:28:39.158471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 40/72] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:28:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:39.159212 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a60346-e2ad-4e50-a01e-10dbe5c58ade None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:39.161867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27789642-2f2b-4c36-8805-aa864b05bf8e None admin] RBAC: Authorizing `identity:get_user(user_id=99906ed469184f2280ab4490ea782efa)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:39.163456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27789642-2f2b-4c36-8805-aa864b05bf8e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:39.169559 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 33/73] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:38 2022] GET /identity/v3/users/99906ed469184f2280ab4490ea782efa => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:39.169559 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27789642-2f2b-4c36-8805-aa864b05bf8e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:39.198431 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:39.266756 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a60346-e2ad-4e50-a01e-10dbe5c58ade None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:39.275300 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27789642-2f2b-4c36-8805-aa864b05bf8e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:39.281474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:39.302948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99655fcb-d9dd-4fa5-86cb-62a2b06dc8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:39.304414 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99655fcb-d9dd-4fa5-86cb-62a2b06dc8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:39.304793 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99655fcb-d9dd-4fa5-86cb-62a2b06dc8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:39.305116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99655fcb-d9dd-4fa5-86cb-62a2b06dc8b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:39.310719 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65089251-885d-4a23-920b-2129c1e1bce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:39.311481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65089251-885d-4a23-920b-2129c1e1bce4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:39.311771 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65089251-885d-4a23-920b-2129c1e1bce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:39.312053 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65089251-885d-4a23-920b-2129c1e1bce4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:39.316321 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99655fcb-d9dd-4fa5-86cb-62a2b06dc8b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:39.322461 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65089251-885d-4a23-920b-2129c1e1bce4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:39.324656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-99655fcb-d9dd-4fa5-86cb-62a2b06dc8b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:28:39.324656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:39.324656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:39.324656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:39.324656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:39.324656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:39.324656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:39.324656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:39.324656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:39.324656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:39.324656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:39.324656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:39.324656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:39.324656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:39.324656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:39.324656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:39.325557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:39.325557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:39.325557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:39.325557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:39.325557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:39.325557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:39.325557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:39.325557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:39.325557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:39.325557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:39.325557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:39.325557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:39.325557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:39.325557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:39.325557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:39.325557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:39.326327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:39.326327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:39.326327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:39.326327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:39.326327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:39.326327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:39.326327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:39.326327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:39.326327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:39.326327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:39.326327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:28:39.326327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:28:39.326327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 41/74] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 16:28:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:39.332192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39114b6-01e1-460d-b76d-f209a3459c9c None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:39.332192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39114b6-01e1-460d-b76d-f209a3459c9c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:39.332192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39114b6-01e1-460d-b76d-f209a3459c9c None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:39.332192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 42/75] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:39.332524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-65089251-885d-4a23-920b-2129c1e1bce4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:28:39.332524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:39.332524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:39.332524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:39.332524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:39.332524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:39.332524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:39.332524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:39.332524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:39.332524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:39.332524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:39.332524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:39.332524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:39.332524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:39.332524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:39.332524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:39.333725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:39.333725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:39.333725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:39.333725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:39.333725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:39.333725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:39.333725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:39.333725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:39.333725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:39.333725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:39.333725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:39.333725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:39.333725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:39.333725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:39.333725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:39.333725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:39.334997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:39.334997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:39.334997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:39.334997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:39.334997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:39.334997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:39.334997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:39.334997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:39.334997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:39.334997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:39.334997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:28:39.334997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:28:39.334997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 34/76] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:39.334997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65089251-885d-4a23-920b-2129c1e1bce4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:39.335911 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39114b6-01e1-460d-b76d-f209a3459c9c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:39.422778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:39.439001 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65089251-885d-4a23-920b-2129c1e1bce4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:39.439727 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39114b6-01e1-460d-b76d-f209a3459c9c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:39.475288 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd452070-6d9b-4a0c-8a50-c8b6e041c324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:39.475718 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fedca5-94f5-472e-81e1-46e387dbc7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:39.475965 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd452070-6d9b-4a0c-8a50-c8b6e041c324 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:39.476347 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd452070-6d9b-4a0c-8a50-c8b6e041c324 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:39.476441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fedca5-94f5-472e-81e1-46e387dbc7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:39.476644 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd452070-6d9b-4a0c-8a50-c8b6e041c324 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:39.476752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fedca5-94f5-472e-81e1-46e387dbc7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:39.476949 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fedca5-94f5-472e-81e1-46e387dbc7f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:39.477753 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fedca5-94f5-472e-81e1-46e387dbc7f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:39.478063 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fedca5-94f5-472e-81e1-46e387dbc7f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:39.479462 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fedca5-94f5-472e-81e1-46e387dbc7f9 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:39.488469 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 43/77] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:39.489957 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fedca5-94f5-472e-81e1-46e387dbc7f9 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:39.525943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:39.553087 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd452070-6d9b-4a0c-8a50-c8b6e041c324 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:39.554513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd452070-6d9b-4a0c-8a50-c8b6e041c324 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:39.592343 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fedca5-94f5-472e-81e1-46e387dbc7f9 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:39.628495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846bd518-d68a-4211-80b8-49131bc7dec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:39.629341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846bd518-d68a-4211-80b8-49131bc7dec3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:39.629647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846bd518-d68a-4211-80b8-49131bc7dec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:39.629926 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846bd518-d68a-4211-80b8-49131bc7dec3 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:39.630743 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846bd518-d68a-4211-80b8-49131bc7dec3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:39.631054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846bd518-d68a-4211-80b8-49131bc7dec3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:39.632462 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846bd518-d68a-4211-80b8-49131bc7dec3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:39.638542 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:39.640575 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 44/78] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:39.645461 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde98d83-424a-4d07-bf74-564ea0bd6358 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:39.645461 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde98d83-424a-4d07-bf74-564ea0bd6358 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:39.645461 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde98d83-424a-4d07-bf74-564ea0bd6358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:39.655147 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 35/79] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:39.656080 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd452070-6d9b-4a0c-8a50-c8b6e041c324 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:39.660259 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-bde98d83-424a-4d07-bf74-564ea0bd6358 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:39.661568 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-bde98d83-424a-4d07-bf74-564ea0bd6358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:39.730220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 45/80] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:39.731080 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde98d83-424a-4d07-bf74-564ea0bd6358 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:39.759381 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:39.760834 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd452070-6d9b-4a0c-8a50-c8b6e041c324 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:39.800982 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e6c78-d48a-488e-9de8-a85b9a1de391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:39.801705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e6c78-d48a-488e-9de8-a85b9a1de391 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:39.802062 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e6c78-d48a-488e-9de8-a85b9a1de391 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:39.802276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9e6c78-d48a-488e-9de8-a85b9a1de391 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:39.803042 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e6c78-d48a-488e-9de8-a85b9a1de391 None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:39.807576 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e6c78-d48a-488e-9de8-a85b9a1de391 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:39.807576 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9e6c78-d48a-488e-9de8-a85b9a1de391 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:39.813457 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 36/81] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:28:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:39.814267 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e6c78-d48a-488e-9de8-a85b9a1de391 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:39.836833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde98d83-424a-4d07-bf74-564ea0bd6358 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:39.868339 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:39.872502 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bc353-5a4e-4a82-b47e-0d16a8b7c885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:39.873700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bc353-5a4e-4a82-b47e-0d16a8b7c885 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:39.873989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bc353-5a4e-4a82-b47e-0d16a8b7c885 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:39.874281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95bc353-5a4e-4a82-b47e-0d16a8b7c885 None admin] PATH_INFO: `/v3/users/c740c2989cfd4a19b4bb2520a5d2cbf7` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:39.875530 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bc353-5a4e-4a82-b47e-0d16a8b7c885 None admin] RBAC: Authorizing `identity:get_user(user_id=c740c2989cfd4a19b4bb2520a5d2cbf7)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:39.877083 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95bc353-5a4e-4a82-b47e-0d16a8b7c885 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:39.878931 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 46/82] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:39 2022] GET /identity/v3/users/c740c2989cfd4a19b4bb2520a5d2cbf7 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:39.879702 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bc353-5a4e-4a82-b47e-0d16a8b7c885 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:39.935757 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9e6c78-d48a-488e-9de8-a85b9a1de391 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:39.970885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a052e-1beb-43f4-902a-e61c657aba0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:39.972469 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a052e-1beb-43f4-902a-e61c657aba0d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:39.972761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a052e-1beb-43f4-902a-e61c657aba0d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:39.973075 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a052e-1beb-43f4-902a-e61c657aba0d None admin] PATH_INFO: `/v3/users/99906ed469184f2280ab4490ea782efa` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:39.974286 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a052e-1beb-43f4-902a-e61c657aba0d None admin] RBAC: Authorizing `identity:get_user(user_id=99906ed469184f2280ab4490ea782efa)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:39.975725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3a052e-1beb-43f4-902a-e61c657aba0d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:39.976402 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:39.977599 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 37/83] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:39 2022] GET /identity/v3/users/99906ed469184f2280ab4490ea782efa => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:39.978227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a052e-1beb-43f4-902a-e61c657aba0d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:39.982697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95bc353-5a4e-4a82-b47e-0d16a8b7c885 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:40.017484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64204bb9-6e3d-47ca-90d4-c01f1eb5fc98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:40.019229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64204bb9-6e3d-47ca-90d4-c01f1eb5fc98 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:40.019708 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64204bb9-6e3d-47ca-90d4-c01f1eb5fc98 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:40.020313 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64204bb9-6e3d-47ca-90d4-c01f1eb5fc98 None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:40.021581 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64204bb9-6e3d-47ca-90d4-c01f1eb5fc98 None admin] RBAC: Authorizing `identity:get_project(project_id=927eca8521754c2ebbb30dec8ac82458)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:40.023048 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64204bb9-6e3d-47ca-90d4-c01f1eb5fc98 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:40.024765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 47/84] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:28:39 2022] GET /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:40.025559 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64204bb9-6e3d-47ca-90d4-c01f1eb5fc98 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:40.087109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a052e-1beb-43f4-902a-e61c657aba0d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:40.100749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:40.120852 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f123e7-444c-47a9-85d0-548bb54f3c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:40.121761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f123e7-444c-47a9-85d0-548bb54f3c26 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:40.122011 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f123e7-444c-47a9-85d0-548bb54f3c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:40.122303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f123e7-444c-47a9-85d0-548bb54f3c26 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:40.123730 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f123e7-444c-47a9-85d0-548bb54f3c26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:40.125215 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f123e7-444c-47a9-85d0-548bb54f3c26 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:40.126839 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 38/85] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:40.128015 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64204bb9-6e3d-47ca-90d4-c01f1eb5fc98 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:40.128142 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f123e7-444c-47a9-85d0-548bb54f3c26 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:40.165443 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393989a2-4a3e-41c2-b428-dfd6d5d9b7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:40.166425 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393989a2-4a3e-41c2-b428-dfd6d5d9b7fa None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:40.166720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393989a2-4a3e-41c2-b428-dfd6d5d9b7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:40.167004 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393989a2-4a3e-41c2-b428-dfd6d5d9b7fa None admin] PATH_INFO: `/v3/users/99906ed469184f2280ab4490ea782efa` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:40.169646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393989a2-4a3e-41c2-b428-dfd6d5d9b7fa None admin] RBAC: Authorizing `identity:get_user(user_id=99906ed469184f2280ab4490ea782efa)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:40.169961 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393989a2-4a3e-41c2-b428-dfd6d5d9b7fa None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:40.171642 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 48/86] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:40 2022] GET /identity/v3/users/99906ed469184f2280ab4490ea782efa => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:40.172453 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393989a2-4a3e-41c2-b428-dfd6d5d9b7fa None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:40.214952 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:40.242553 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f123e7-444c-47a9-85d0-548bb54f3c26 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:40.279737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bec84-2b42-4d4e-bd7b-4679660f4e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:40.280396 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bec84-2b42-4d4e-bd7b-4679660f4e2d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:40.280684 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bec84-2b42-4d4e-bd7b-4679660f4e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:40.280967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bec84-2b42-4d4e-bd7b-4679660f4e2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:40.285001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393989a2-4a3e-41c2-b428-dfd6d5d9b7fa None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:40.320186 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8511f8-033e-4925-985e-81e91df91aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:40.320866 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8511f8-033e-4925-985e-81e91df91aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:40.321189 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8511f8-033e-4925-985e-81e91df91aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:40.321491 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8511f8-033e-4925-985e-81e91df91aa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:40.332499 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:40.352062 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bec84-2b42-4d4e-bd7b-4679660f4e2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:40.353627 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383bec84-2b42-4d4e-bd7b-4679660f4e2d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:40.394056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8511f8-033e-4925-985e-81e91df91aa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:40.395584 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8511f8-033e-4925-985e-81e91df91aa4 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:40.426284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:40.456959 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 39/87] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:40.458051 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bec84-2b42-4d4e-bd7b-4679660f4e2d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:40.496955 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 49/88] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:40.497690 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8511f8-033e-4925-985e-81e91df91aa4 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:40.545944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:40.565004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bec84-2b42-4d4e-bd7b-4679660f4e2d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:40.602525 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938b7ea-3578-477a-8e33-9f1eae2a5496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:40.603065 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938b7ea-3578-477a-8e33-9f1eae2a5496 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:40.603376 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938b7ea-3578-477a-8e33-9f1eae2a5496 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:40.603645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938b7ea-3578-477a-8e33-9f1eae2a5496 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:40.604111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8511f8-033e-4925-985e-81e91df91aa4 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:40.604483 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938b7ea-3578-477a-8e33-9f1eae2a5496 None admin] RBAC: Adding query filter params (role.id=38ab22e38dfd483dbd2f224b3088f16e, scope.project.id=927eca8521754c2ebbb30dec8ac82458, user.id=99906ed469184f2280ab4490ea782efa) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:40.604800 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938b7ea-3578-477a-8e33-9f1eae2a5496 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:40.606322 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938b7ea-3578-477a-8e33-9f1eae2a5496 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:40.611965 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 40/89] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:40 2022] GET /identity/v3/role_assignments?user.id=99906ed469184f2280ab4490ea782efa&scope.project.id=927eca8521754c2ebbb30dec8ac82458&role.id=38ab22e38dfd483dbd2f224b3088f16e => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:40.612976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938b7ea-3578-477a-8e33-9f1eae2a5496 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:40.639855 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:40.645820 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42148451-55e2-40c5-845e-3a051bf17ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:40.646560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42148451-55e2-40c5-845e-3a051bf17ee2 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:40.646851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42148451-55e2-40c5-845e-3a051bf17ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:40.647135 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42148451-55e2-40c5-845e-3a051bf17ee2 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:40.647884 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42148451-55e2-40c5-845e-3a051bf17ee2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:40.649427 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42148451-55e2-40c5-845e-3a051bf17ee2 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:40.727379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938b7ea-3578-477a-8e33-9f1eae2a5496 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:40.761671 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 50/90] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 16:28:40 2022] POST /identity/v3/users => generated 289 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:40.762808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42148451-55e2-40c5-845e-3a051bf17ee2 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:40.773350 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e79b5-1839-4cdb-bb5e-09a92d9c34e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:40.774055 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e79b5-1839-4cdb-bb5e-09a92d9c34e8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:40.774351 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e79b5-1839-4cdb-bb5e-09a92d9c34e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:40.774638 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e79b5-1839-4cdb-bb5e-09a92d9c34e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:40.797197 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:40.872748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e79b5-1839-4cdb-bb5e-09a92d9c34e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:40.874927 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22e79b5-1839-4cdb-bb5e-09a92d9c34e8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:40.921254 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42148451-55e2-40c5-845e-3a051bf17ee2 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:40.976420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e492d-cb9b-40bf-ad3f-28973314d1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:40.977604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e492d-cb9b-40bf-ad3f-28973314d1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:40.977907 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e492d-cb9b-40bf-ad3f-28973314d1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:40.978193 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34e492d-cb9b-40bf-ad3f-28973314d1b6 None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:40.979890 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e492d-cb9b-40bf-ad3f-28973314d1b6 None admin] RBAC: Authorizing `identity:get_project(project_id=927eca8521754c2ebbb30dec8ac82458)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:40.984118 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34e492d-cb9b-40bf-ad3f-28973314d1b6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:40.984118 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 51/91] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:28:40 2022] GET /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:40.986692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e492d-cb9b-40bf-ad3f-28973314d1b6 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:41.001242 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 41/92] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:41.002197 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e79b5-1839-4cdb-bb5e-09a92d9c34e8 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:41.058281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:41.060665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:41.136403 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34e492d-cb9b-40bf-ad3f-28973314d1b6 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:41.139595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e79b5-1839-4cdb-bb5e-09a92d9c34e8 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:41.187196 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacd9c3-0b19-4608-8929-6d0be0842141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:41.187878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacd9c3-0b19-4608-8929-6d0be0842141 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:41.188172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacd9c3-0b19-4608-8929-6d0be0842141 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:41.188457 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdacd9c3-0b19-4608-8929-6d0be0842141 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:41.188651 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279372b6-c053-4280-991b-0d0bf16a9e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:41.189345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdacd9c3-0b19-4608-8929-6d0be0842141 None admin] RBAC: Adding query filter params (role.id=c2d5d80485df4730903a874937d68aa3, scope.project.id=927eca8521754c2ebbb30dec8ac82458, user.id=c740c2989cfd4a19b4bb2520a5d2cbf7) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:41.189664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdacd9c3-0b19-4608-8929-6d0be0842141 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:41.190424 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279372b6-c053-4280-991b-0d0bf16a9e1b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:41.190994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279372b6-c053-4280-991b-0d0bf16a9e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:41.191234 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdacd9c3-0b19-4608-8929-6d0be0842141 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:41.191663 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279372b6-c053-4280-991b-0d0bf16a9e1b None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:41.193408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279372b6-c053-4280-991b-0d0bf16a9e1b None admin] RBAC: Authorizing `identity:get_project(project_id=927eca8521754c2ebbb30dec8ac82458)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:41.195604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279372b6-c053-4280-991b-0d0bf16a9e1b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:41.197908 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 52/93] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:28:40 2022] GET /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:41.198197 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 42/94] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:41 2022] GET /identity/v3/role_assignments?user.id=c740c2989cfd4a19b4bb2520a5d2cbf7&scope.project.id=927eca8521754c2ebbb30dec8ac82458&role.id=c2d5d80485df4730903a874937d68aa3 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:41.199118 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279372b6-c053-4280-991b-0d0bf16a9e1b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:41.208566 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacd9c3-0b19-4608-8929-6d0be0842141 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:41.321882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279372b6-c053-4280-991b-0d0bf16a9e1b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:41.365841 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:41.389479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e18cc7-b49c-4598-979a-ac2f15ddbbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:41.390455 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e18cc7-b49c-4598-979a-ac2f15ddbbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:41.390753 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e18cc7-b49c-4598-979a-ac2f15ddbbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:41.391043 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e18cc7-b49c-4598-979a-ac2f15ddbbf7 None admin] PATH_INFO: `/v3/projects/da77290b02e84154bac8193f225afe3e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:41.397469 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e18cc7-b49c-4598-979a-ac2f15ddbbf7 None admin] RBAC: Authorizing `identity:get_project(project_id=da77290b02e84154bac8193f225afe3e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:41.398990 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e18cc7-b49c-4598-979a-ac2f15ddbbf7 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:41.401300 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 53/95] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:28:41 2022] GET /identity/v3/projects/da77290b02e84154bac8193f225afe3e => generated 312 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:41.407078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e18cc7-b49c-4598-979a-ac2f15ddbbf7 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:41.417236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdacd9c3-0b19-4608-8929-6d0be0842141 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:41.436714 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:41.480019 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963a861c-aaa4-48f1-811a-19057ed7d85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:41.481086 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a861c-aaa4-48f1-811a-19057ed7d85e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:41.481881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a861c-aaa4-48f1-811a-19057ed7d85e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:41.482364 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963a861c-aaa4-48f1-811a-19057ed7d85e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:41.483912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a861c-aaa4-48f1-811a-19057ed7d85e None admin] RBAC: Adding query filter params (role.id=e92acb6fd9834582bb4fd34409b37f94, scope.project.id=927eca8521754c2ebbb30dec8ac82458, user.id=99906ed469184f2280ab4490ea782efa) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:41.484454 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a861c-aaa4-48f1-811a-19057ed7d85e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:41.486563 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963a861c-aaa4-48f1-811a-19057ed7d85e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:41.502204 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 43/96] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:41 2022] GET /identity/v3/role_assignments?user.id=99906ed469184f2280ab4490ea782efa&scope.project.id=927eca8521754c2ebbb30dec8ac82458&role.id=e92acb6fd9834582bb4fd34409b37f94 => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:41.563932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e18cc7-b49c-4598-979a-ac2f15ddbbf7 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:41.624092 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08827ed-d6ce-495e-8ba8-69472f911401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:41.624831 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08827ed-d6ce-495e-8ba8-69472f911401 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:41.625147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08827ed-d6ce-495e-8ba8-69472f911401 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:41.625452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08827ed-d6ce-495e-8ba8-69472f911401 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:41.626391 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08827ed-d6ce-495e-8ba8-69472f911401 None admin] RBAC: Adding query filter params (role.id=38ab22e38dfd483dbd2f224b3088f16e, scope.project.id=da77290b02e84154bac8193f225afe3e, user.id=99906ed469184f2280ab4490ea782efa) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:41.626704 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08827ed-d6ce-495e-8ba8-69472f911401 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:41.628378 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08827ed-d6ce-495e-8ba8-69472f911401 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:41.637821 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 54/97] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:41 2022] GET /identity/v3/role_assignments?user.id=99906ed469184f2280ab4490ea782efa&scope.project.id=da77290b02e84154bac8193f225afe3e&role.id=38ab22e38dfd483dbd2f224b3088f16e => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:43.341818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc641e0d-91ad-4ce5-a699-78690bae7a70 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:43.342847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc641e0d-91ad-4ce5-a699-78690bae7a70 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:43.343346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc641e0d-91ad-4ce5-a699-78690bae7a70 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:43.344969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 44/98] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:43.350420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60275657-b5e7-4fd0-a676-6d8a3234a2b0 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:43.350830 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60275657-b5e7-4fd0-a676-6d8a3234a2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:43.350986 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60275657-b5e7-4fd0-a676-6d8a3234a2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:43.377359 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-60275657-b5e7-4fd0-a676-6d8a3234a2b0 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:43.379018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-60275657-b5e7-4fd0-a676-6d8a3234a2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:43.453704 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:43.477527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 55/99] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:43.512763 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc641e0d-91ad-4ce5-a699-78690bae7a70 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:43.659042 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc641e0d-91ad-4ce5-a699-78690bae7a70 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:43.709834 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f19d0-3a8f-4d23-a322-e397f65da60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:43.711087 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f19d0-3a8f-4d23-a322-e397f65da60a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:43.711583 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f19d0-3a8f-4d23-a322-e397f65da60a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:43.712063 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f19d0-3a8f-4d23-a322-e397f65da60a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:43.724397 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f19d0-3a8f-4d23-a322-e397f65da60a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:43.735756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-309f19d0-3a8f-4d23-a322-e397f65da60a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:28:43.735756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:43.735756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:43.735756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:43.735756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:43.735756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:43.735756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:43.735756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:43.735756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:43.735756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:43.735756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:43.735756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:43.735756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:43.735756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:43.735756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:43.735756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:43.736712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:43.736712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:43.736712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:43.736712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:43.736712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:43.736712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:43.736712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:43.736712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:43.736712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:43.736712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:43.736712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:43.736712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:43.736712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:43.736712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:43.736712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:43.736712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:43.737704 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:43.737704 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:43.737704 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:43.737704 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:43.737704 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:43.737704 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:43.737704 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:43.737704 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:43.737704 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:43.737704 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:43.737704 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:28:43.737704 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:28:43.740103 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 45/100] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:43.750116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60275657-b5e7-4fd0-a676-6d8a3234a2b0 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:43.887692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60275657-b5e7-4fd0-a676-6d8a3234a2b0 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:43.910594 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128fbe8-1f98-4945-8e32-f473a09ad120 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:43.911251 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128fbe8-1f98-4945-8e32-f473a09ad120 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:43.911841 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128fbe8-1f98-4945-8e32-f473a09ad120 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:43.915077 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 46/101] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:43.919959 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df685181-96df-4904-9914-a79dc2f45eae None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:43.920516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df685181-96df-4904-9914-a79dc2f45eae None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:43.921072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df685181-96df-4904-9914-a79dc2f45eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:43.923774 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab45ed-e017-4cfa-9f6c-985d3e725201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:43.924511 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab45ed-e017-4cfa-9f6c-985d3e725201 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:43.924797 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab45ed-e017-4cfa-9f6c-985d3e725201 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:43.925213 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab45ed-e017-4cfa-9f6c-985d3e725201 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:43.926096 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab45ed-e017-4cfa-9f6c-985d3e725201 None admin] RBAC: Adding query filter params (name=member) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:43.926519 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab45ed-e017-4cfa-9f6c-985d3e725201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:43.928047 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cab45ed-e017-4cfa-9f6c-985d3e725201 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:43.936963 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 56/102] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:28:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:43.942757 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-df685181-96df-4904-9914-a79dc2f45eae None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:43.943336 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab45ed-e017-4cfa-9f6c-985d3e725201 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:43.944592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-df685181-96df-4904-9914-a79dc2f45eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:43.977097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:44.053147 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 47/103] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:28:44.062802 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:44.102878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df685181-96df-4904-9914-a79dc2f45eae None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:44.166120 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cab45ed-e017-4cfa-9f6c-985d3e725201 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:44.220831 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df685181-96df-4904-9914-a79dc2f45eae None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:44.263655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38947213-1ef8-4c52-be90-203f29601dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:44.265512 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38947213-1ef8-4c52-be90-203f29601dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:44.265805 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38947213-1ef8-4c52-be90-203f29601dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:44.266091 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38947213-1ef8-4c52-be90-203f29601dd0 None admin] PATH_INFO: `/v3/users/99906ed469184f2280ab4490ea782efa` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:44.267811 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38947213-1ef8-4c52-be90-203f29601dd0 None admin] RBAC: Authorizing `identity:get_user(user_id=99906ed469184f2280ab4490ea782efa)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:44.269325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38947213-1ef8-4c52-be90-203f29601dd0 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:44.273512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81763a-ddd8-4a60-a86d-87de866312d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:44.274321 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81763a-ddd8-4a60-a86d-87de866312d1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:44.274609 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81763a-ddd8-4a60-a86d-87de866312d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:44.274891 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81763a-ddd8-4a60-a86d-87de866312d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:44.276219 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81763a-ddd8-4a60-a86d-87de866312d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:44.277711 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81763a-ddd8-4a60-a86d-87de866312d1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:44.279334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 48/105] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:44.280506 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ca39-9360-423b-8d7a-95be6fbd650c None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:44.280678 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 57/105] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:43 2022] GET /identity/v3/users/99906ed469184f2280ab4490ea782efa => generated 275 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:44.281667 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38947213-1ef8-4c52-be90-203f29601dd0 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:44.282443 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ca39-9360-423b-8d7a-95be6fbd650c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:44.283241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ca39-9360-423b-8d7a-95be6fbd650c None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:44.286607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 49/106] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:44.288285 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76ca39-9360-423b-8d7a-95be6fbd650c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:44.351325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:44.431234 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38947213-1ef8-4c52-be90-203f29601dd0 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:44.439747 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd76ca39-9360-423b-8d7a-95be6fbd650c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:44.450168 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:44.472424 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad2e48-13eb-4fcf-8e58-96678a4d0e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:44.473345 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad2e48-13eb-4fcf-8e58-96678a4d0e1e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:44.473640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad2e48-13eb-4fcf-8e58-96678a4d0e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:44.473927 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad2e48-13eb-4fcf-8e58-96678a4d0e1e None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:44.475138 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad2e48-13eb-4fcf-8e58-96678a4d0e1e None admin] RBAC: Authorizing `identity:get_project(project_id=927eca8521754c2ebbb30dec8ac82458)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:44.476677 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad2e48-13eb-4fcf-8e58-96678a4d0e1e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:44.478649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 58/107] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:28:44 2022] GET /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:44.479612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819a980-9a39-4c79-9cda-f72cba89dd63 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:44.479907 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819a980-9a39-4c79-9cda-f72cba89dd63 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:44.480191 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819a980-9a39-4c79-9cda-f72cba89dd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:44.484479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756bcfd7-bbae-446d-950e-92d1a85802b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:44.485178 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bcfd7-bbae-446d-950e-92d1a85802b3 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:44.485483 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bcfd7-bbae-446d-950e-92d1a85802b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:44.485751 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756bcfd7-bbae-446d-950e-92d1a85802b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:44.486471 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bcfd7-bbae-446d-950e-92d1a85802b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:44.488216 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756bcfd7-bbae-446d-950e-92d1a85802b3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:44.498583 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-2819a980-9a39-4c79-9cda-f72cba89dd63 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:44.499779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2819a980-9a39-4c79-9cda-f72cba89dd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:44.581167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 59/108] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:44.581167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cd741-8293-4ddd-80d8-e6be76b71c5d None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:44.581167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cd741-8293-4ddd-80d8-e6be76b71c5d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:44.581167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cd741-8293-4ddd-80d8-e6be76b71c5d None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:44.581167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 60/109] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:44.581167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20897f50-8c14-4842-9923-b622cc1c8cfb None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:44.581167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20897f50-8c14-4842-9923-b622cc1c8cfb None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:44.581684 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20897f50-8c14-4842-9923-b622cc1c8cfb None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:44.581684 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 61/110] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:44.581684 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20897f50-8c14-4842-9923-b622cc1c8cfb None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:44.591099 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 50/111] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 16:28:44 2022] POST /identity/v3/projects => generated 302 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:44.592376 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5ee50-d770-4f8c-8afa-c0673067a3c8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:44.592667 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5ee50-d770-4f8c-8afa-c0673067a3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:44.592950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5ee50-d770-4f8c-8afa-c0673067a3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:44.617664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d8a5ee50-d770-4f8c-8afa-c0673067a3c8 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:44.618851 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d8a5ee50-d770-4f8c-8afa-c0673067a3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:44.752931 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20897f50-8c14-4842-9923-b622cc1c8cfb None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:44.754355 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 51/112] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:44.755859 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88363364-1f90-4088-aca2-9630626da69f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:44.756410 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88363364-1f90-4088-aca2-9630626da69f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:44.756884 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88363364-1f90-4088-aca2-9630626da69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:44.768878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:44.774802 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-88363364-1f90-4088-aca2-9630626da69f None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:44.776250 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-88363364-1f90-4088-aca2-9630626da69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:44.787800 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:44.796266 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6908f4-c75c-4bf8-ab66-9277e0179588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:44.797253 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6908f4-c75c-4bf8-ab66-9277e0179588 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:44.797545 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6908f4-c75c-4bf8-ab66-9277e0179588 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:44.797828 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6908f4-c75c-4bf8-ab66-9277e0179588 None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458/users/99906ed469184f2280ab4490ea782efa/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:44.800900 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6908f4-c75c-4bf8-ab66-9277e0179588 None admin] RBAC: Authorizing `identity:create_grant(project_id=927eca8521754c2ebbb30dec8ac82458, user_id=99906ed469184f2280ab4490ea782efa, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:44.802895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6908f4-c75c-4bf8-ab66-9277e0179588 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:44.858032 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 52/113] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:44.858775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88363364-1f90-4088-aca2-9630626da69f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:44.923356 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 62/114] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:28:44 2022] PUT /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458/users/99906ed469184f2280ab4490ea782efa/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:28:44.924736 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6908f4-c75c-4bf8-ab66-9277e0179588 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:44.988759 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88363364-1f90-4088-aca2-9630626da69f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:45.039646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9be89-aae3-4e27-b711-aca6047a8477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:45.040792 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9be89-aae3-4e27-b711-aca6047a8477 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:45.041041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9be89-aae3-4e27-b711-aca6047a8477 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:45.045042 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9be89-aae3-4e27-b711-aca6047a8477 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:45.053882 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9be89-aae3-4e27-b711-aca6047a8477 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:45.062132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-52d9be89-aae3-4e27-b711-aca6047a8477 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:45.062132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:45.062132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:45.062132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:45.062132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:45.062132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:45.062132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:45.062132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:45.062132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:45.062132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:45.062132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:45.062132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:45.062132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:45.062132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:45.062132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:45.062132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:45.063058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:45.063058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:45.063058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:45.063058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:45.063058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:45.063058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:45.063058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:45.063058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:45.063058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:45.063058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:45.063058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:45.063058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:45.063058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:45.063058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:45.063058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:45.063058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:45.063843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:45.063843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:45.063843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:45.063843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:45.063843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:45.063843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:45.063843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:45.063843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:45.063843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:45.063843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:45.063843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:45.063843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:28:45.063843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 53/115] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:28:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:45.064540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9be89-aae3-4e27-b711-aca6047a8477 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:45.071831 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6908f4-c75c-4bf8-ab66-9277e0179588 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:45.072853 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:45.113071 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f9eb9-f695-4057-ba14-a6ca75fce862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:45.113837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f9eb9-f695-4057-ba14-a6ca75fce862 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:45.114127 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f9eb9-f695-4057-ba14-a6ca75fce862 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:45.114412 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f9eb9-f695-4057-ba14-a6ca75fce862 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:45.128652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f9eb9-f695-4057-ba14-a6ca75fce862 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:45.137233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-b04f9eb9-f695-4057-ba14-a6ca75fce862 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:28:45.137233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:45.137233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:45.137233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:45.137233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:45.137233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:45.137233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:45.137233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:45.137233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:45.137233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:45.137233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:45.137233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:45.137233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:45.137233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:45.137233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:45.137233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:45.138156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:45.138156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:45.138156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:45.138156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:45.138156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:45.138156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:45.138156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:45.138156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:45.138156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:45.138156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:45.138156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:45.138156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:45.138156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:45.138156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:45.138156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:45.138156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:45.139073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:45.139073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:45.139073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:45.139073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:45.139073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:45.139073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:45.139073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:45.139073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:45.139073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:45.139073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:45.139073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:28:45.139073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:28:45.139073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 63/116] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 16:28:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:45.145349 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dc8c3-afeb-444a-82f4-d75037dd6d03 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:45.145642 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dc8c3-afeb-444a-82f4-d75037dd6d03 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:45.145938 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79dc8c3-afeb-444a-82f4-d75037dd6d03 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:45.147785 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 64/117] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:45.148570 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dc8c3-afeb-444a-82f4-d75037dd6d03 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:45.205532 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9be89-aae3-4e27-b711-aca6047a8477 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:45.221788 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:45.246215 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cdd58-34fd-4701-916c-3677c93a4489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:45.247034 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cdd58-34fd-4701-916c-3677c93a4489 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:45.247336 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cdd58-34fd-4701-916c-3677c93a4489 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:45.247725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cdd58-34fd-4701-916c-3677c93a4489 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:45.260608 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cdd58-34fd-4701-916c-3677c93a4489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:45.268828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-678cdd58-34fd-4701-916c-3677c93a4489 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:28:45.268828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:45.268828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:45.268828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:45.268828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:45.268828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:45.268828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:45.268828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:45.268828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:45.268828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:45.268828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:45.268828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:45.268828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:45.268828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:45.268828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:45.268828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:45.272354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:45.272354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:45.272354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:45.272354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:45.272354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:45.272354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:45.272354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:45.272354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:45.272354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:45.272354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:45.272354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:45.272354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:45.272354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:45.272354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:45.272354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:45.272354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:45.273236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:45.273236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:45.273236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:45.273236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:45.273236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:45.273236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:45.273236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:45.273236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:45.273236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:45.273236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:45.273236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:28:45.273236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:28:45.273236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 54/118] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:45.273236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cdd58-34fd-4701-916c-3677c93a4489 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:45.308211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79dc8c3-afeb-444a-82f4-d75037dd6d03 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:45.354077 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:45.360240 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bb574-6522-4b1c-8e1b-e1acb6173cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:45.361463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bb574-6522-4b1c-8e1b-e1acb6173cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:45.361987 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bb574-6522-4b1c-8e1b-e1acb6173cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:45.362481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bb574-6522-4b1c-8e1b-e1acb6173cc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:45.363664 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bb574-6522-4b1c-8e1b-e1acb6173cc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:45.364955 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bb574-6522-4b1c-8e1b-e1acb6173cc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:45.366599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bb574-6522-4b1c-8e1b-e1acb6173cc1 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:45.380371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 65/119] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:45.382792 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de28ab-9d25-42de-98a4-3d49ac9aa9a3 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:45.383302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de28ab-9d25-42de-98a4-3d49ac9aa9a3 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:45.383760 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de28ab-9d25-42de-98a4-3d49ac9aa9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:45.399379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cdd58-34fd-4701-916c-3677c93a4489 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:45.405595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-08de28ab-9d25-42de-98a4-3d49ac9aa9a3 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:45.407515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-08de28ab-9d25-42de-98a4-3d49ac9aa9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:45.438020 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a22bc1-9ca7-4381-a616-c35d99e75d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:45.438881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a22bc1-9ca7-4381-a616-c35d99e75d48 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:45.439244 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a22bc1-9ca7-4381-a616-c35d99e75d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:45.440411 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a22bc1-9ca7-4381-a616-c35d99e75d48 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:45.441177 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a22bc1-9ca7-4381-a616-c35d99e75d48 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:45.441736 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a22bc1-9ca7-4381-a616-c35d99e75d48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:45.443330 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a22bc1-9ca7-4381-a616-c35d99e75d48 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:45.457581 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 55/120] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:45.457581 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a22bc1-9ca7-4381-a616-c35d99e75d48 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:45.508744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 66/121] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:45.509856 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de28ab-9d25-42de-98a4-3d49ac9aa9a3 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:45.560774 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:45.585595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a22bc1-9ca7-4381-a616-c35d99e75d48 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:45.619378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:45.631327 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28afe2-a2d6-4067-b487-f21e8767b9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:45.632727 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28afe2-a2d6-4067-b487-f21e8767b9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:45.633275 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28afe2-a2d6-4067-b487-f21e8767b9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:45.633851 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c28afe2-a2d6-4067-b487-f21e8767b9f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:45.634868 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28afe2-a2d6-4067-b487-f21e8767b9f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:45.635336 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28afe2-a2d6-4067-b487-f21e8767b9f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:45.637631 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c28afe2-a2d6-4067-b487-f21e8767b9f2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:45.646458 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de28ab-9d25-42de-98a4-3d49ac9aa9a3 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:45.650853 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 56/122] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:28:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:45.651997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28afe2-a2d6-4067-b487-f21e8767b9f2 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:45.685244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d7dc2-23dd-41df-ab1f-3e349bd07727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:45.686138 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d7dc2-23dd-41df-ab1f-3e349bd07727 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:45.686425 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d7dc2-23dd-41df-ab1f-3e349bd07727 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:45.686704 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d7dc2-23dd-41df-ab1f-3e349bd07727 None admin] PATH_INFO: `/v3/users/c740c2989cfd4a19b4bb2520a5d2cbf7` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:45.687951 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d7dc2-23dd-41df-ab1f-3e349bd07727 None admin] RBAC: Authorizing `identity:get_user(user_id=c740c2989cfd4a19b4bb2520a5d2cbf7)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:45.689510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d7dc2-23dd-41df-ab1f-3e349bd07727 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:45.695863 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 67/123] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:45 2022] GET /identity/v3/users/c740c2989cfd4a19b4bb2520a5d2cbf7 => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:45.695863 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d7dc2-23dd-41df-ab1f-3e349bd07727 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:45.872959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:45.876895 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c28afe2-a2d6-4067-b487-f21e8767b9f2 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:45.881529 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d7dc2-23dd-41df-ab1f-3e349bd07727 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:45.919772 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddcad4-78c4-4426-828a-c63cb60ef9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:45.920966 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddcad4-78c4-4426-828a-c63cb60ef9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:45.921643 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddcad4-78c4-4426-828a-c63cb60ef9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:45.922191 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddcad4-78c4-4426-828a-c63cb60ef9c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:45.925498 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b569f-ff16-4e78-a91b-197c60f6b10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:45.926868 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b569f-ff16-4e78-a91b-197c60f6b10e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:45.927234 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b569f-ff16-4e78-a91b-197c60f6b10e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:45.927615 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22b569f-ff16-4e78-a91b-197c60f6b10e None admin] PATH_INFO: `/v3/users/99906ed469184f2280ab4490ea782efa` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:45.928936 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b569f-ff16-4e78-a91b-197c60f6b10e None admin] RBAC: Authorizing `identity:get_user(user_id=99906ed469184f2280ab4490ea782efa)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:45.931085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22b569f-ff16-4e78-a91b-197c60f6b10e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:45.937092 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 57/124] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:45 2022] GET /identity/v3/users/99906ed469184f2280ab4490ea782efa => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:45.938457 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b569f-ff16-4e78-a91b-197c60f6b10e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:45.939167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddcad4-78c4-4426-828a-c63cb60ef9c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:45.947527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-b1ddcad4-78c4-4426-828a-c63cb60ef9c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:28:45.947527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:45.947527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:45.947527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:45.947527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:45.947527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:45.947527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:45.947527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:45.947527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:45.947527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:45.947527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:45.947527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:45.947527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:45.947527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:45.947527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:45.947527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:45.948456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:45.948456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:45.948456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:45.948456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:45.948456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:45.948456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:45.948456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:45.948456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:45.948456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:45.948456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:45.948456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:45.948456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:45.948456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:45.948456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:45.948456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:45.948456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:45.949285 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:45.949285 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:45.949285 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:45.949285 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:45.949285 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:45.949285 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:45.949285 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:45.949285 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:45.949285 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:45.949285 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:45.949285 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:28:45.949285 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:28:45.949285 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 68/125] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:45.949938 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddcad4-78c4-4426-828a-c63cb60ef9c9 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:46.023633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:46.062408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddcad4-78c4-4426-828a-c63cb60ef9c9 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:46.084655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22b569f-ff16-4e78-a91b-197c60f6b10e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:46.099338 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cfef6-0a0d-40fc-9b08-a9a951bafb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:46.100217 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cfef6-0a0d-40fc-9b08-a9a951bafb97 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:46.100507 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cfef6-0a0d-40fc-9b08-a9a951bafb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:46.100791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354cfef6-0a0d-40fc-9b08-a9a951bafb97 None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:46.103816 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354cfef6-0a0d-40fc-9b08-a9a951bafb97 None admin] RBAC: Authorizing `identity:get_project(project_id=927eca8521754c2ebbb30dec8ac82458)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:46.105911 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354cfef6-0a0d-40fc-9b08-a9a951bafb97 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:46.109083 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 69/126] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:28:45 2022] GET /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:46.110276 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cfef6-0a0d-40fc-9b08-a9a951bafb97 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:46.137820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08731e-0911-4a0c-b7a8-864d529c34e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:46.138630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08731e-0911-4a0c-b7a8-864d529c34e2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:46.138918 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08731e-0911-4a0c-b7a8-864d529c34e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:46.139198 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08731e-0911-4a0c-b7a8-864d529c34e2 None admin] PATH_INFO: `/v3/users/fa3f29169f5b4f1e80505039d26e92c6` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:46.143966 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:46.155172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08731e-0911-4a0c-b7a8-864d529c34e2 None admin] RBAC: Authorizing `identity:get_user(user_id=fa3f29169f5b4f1e80505039d26e92c6)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:46.156956 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08731e-0911-4a0c-b7a8-864d529c34e2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:46.159174 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 58/127] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:45 2022] GET /identity/v3/users/fa3f29169f5b4f1e80505039d26e92c6 => generated 289 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:46.159957 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08731e-0911-4a0c-b7a8-864d529c34e2 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:46.249355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354cfef6-0a0d-40fc-9b08-a9a951bafb97 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:46.278557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08731e-0911-4a0c-b7a8-864d529c34e2 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:46.288501 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86ae02-4f01-4e66-8bdc-ae0ecdba83c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:46.289430 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86ae02-4f01-4e66-8bdc-ae0ecdba83c7 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:46.289717 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86ae02-4f01-4e66-8bdc-ae0ecdba83c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:46.290002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c86ae02-4f01-4e66-8bdc-ae0ecdba83c7 None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:46.291255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86ae02-4f01-4e66-8bdc-ae0ecdba83c7 None admin] RBAC: Authorizing `identity:get_project(project_id=927eca8521754c2ebbb30dec8ac82458)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:46.292897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c86ae02-4f01-4e66-8bdc-ae0ecdba83c7 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:46.299610 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 70/128] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:28:46 2022] GET /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:46.300212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:46.301321 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86ae02-4f01-4e66-8bdc-ae0ecdba83c7 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:46.320164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acef46-42bf-4e04-bf49-ed6dad315a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:46.321278 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acef46-42bf-4e04-bf49-ed6dad315a0c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:46.321791 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acef46-42bf-4e04-bf49-ed6dad315a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:46.322286 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83acef46-42bf-4e04-bf49-ed6dad315a0c None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:46.323246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83acef46-42bf-4e04-bf49-ed6dad315a0c None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:46.323794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83acef46-42bf-4e04-bf49-ed6dad315a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:46.325607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83acef46-42bf-4e04-bf49-ed6dad315a0c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:46.335410 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 59/129] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:28:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:46.336503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acef46-42bf-4e04-bf49-ed6dad315a0c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:46.416615 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:46.430283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c86ae02-4f01-4e66-8bdc-ae0ecdba83c7 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:46.447207 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83acef46-42bf-4e04-bf49-ed6dad315a0c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:46.479040 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588e3f7-6b7b-4f4a-a87c-53fd580519aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:46.480195 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588e3f7-6b7b-4f4a-a87c-53fd580519aa None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:46.480489 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588e3f7-6b7b-4f4a-a87c-53fd580519aa None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:46.480777 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588e3f7-6b7b-4f4a-a87c-53fd580519aa None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458/users/c740c2989cfd4a19b4bb2520a5d2cbf7/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:46.483522 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588e3f7-6b7b-4f4a-a87c-53fd580519aa None admin] RBAC: Authorizing `identity:create_grant(project_id=927eca8521754c2ebbb30dec8ac82458, user_id=c740c2989cfd4a19b4bb2520a5d2cbf7, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:46.485724 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7588e3f7-6b7b-4f4a-a87c-53fd580519aa None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:46.491491 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8244347-3806-420e-b0c4-4811f7b06130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:46.492287 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8244347-3806-420e-b0c4-4811f7b06130 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:46.492756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8244347-3806-420e-b0c4-4811f7b06130 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:46.493199 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8244347-3806-420e-b0c4-4811f7b06130 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:46.544690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:46.569936 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8244347-3806-420e-b0c4-4811f7b06130 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:46.571430 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8244347-3806-420e-b0c4-4811f7b06130 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:46.622258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 71/130] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:28:46 2022] PUT /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458/users/c740c2989cfd4a19b4bb2520a5d2cbf7/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:28:46.624428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588e3f7-6b7b-4f4a-a87c-53fd580519aa None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:46.745057 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 60/131] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:46.745665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8244347-3806-420e-b0c4-4811f7b06130 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:46.843497 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588e3f7-6b7b-4f4a-a87c-53fd580519aa None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:46.890859 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:46.900322 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939fd398-f70d-4e2d-8977-1566189c54da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:46.901276 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fd398-f70d-4e2d-8977-1566189c54da None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:46.901567 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fd398-f70d-4e2d-8977-1566189c54da None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:46.902077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939fd398-f70d-4e2d-8977-1566189c54da None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458/users/99906ed469184f2280ab4490ea782efa/roles/e92acb6fd9834582bb4fd34409b37f94` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:46.907713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fd398-f70d-4e2d-8977-1566189c54da None admin] RBAC: Authorizing `identity:create_grant(project_id=927eca8521754c2ebbb30dec8ac82458, user_id=99906ed469184f2280ab4490ea782efa, role_id=e92acb6fd9834582bb4fd34409b37f94)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:46.907713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939fd398-f70d-4e2d-8977-1566189c54da None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:46.922113 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8244347-3806-420e-b0c4-4811f7b06130 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:46.957151 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36deeb02-f228-451d-9304-a1fe2882673a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:46.958479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36deeb02-f228-451d-9304-a1fe2882673a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:46.963067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36deeb02-f228-451d-9304-a1fe2882673a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:46.963067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36deeb02-f228-451d-9304-a1fe2882673a None admin] PATH_INFO: `/v3/users/99906ed469184f2280ab4490ea782efa` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:46.963067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36deeb02-f228-451d-9304-a1fe2882673a None admin] RBAC: Authorizing `identity:get_user(user_id=99906ed469184f2280ab4490ea782efa)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:46.963067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36deeb02-f228-451d-9304-a1fe2882673a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:46.964401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 61/132] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:46 2022] GET /identity/v3/users/99906ed469184f2280ab4490ea782efa => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:46.969065 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36deeb02-f228-451d-9304-a1fe2882673a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:47.026314 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 72/133] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:28:46 2022] PUT /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458/users/99906ed469184f2280ab4490ea782efa/roles/e92acb6fd9834582bb4fd34409b37f94 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:28:47.031720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df6b58-b3f2-4d62-9c82-205823d5263e None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:47.031720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df6b58-b3f2-4d62-9c82-205823d5263e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:47.031720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df6b58-b3f2-4d62-9c82-205823d5263e None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:47.031720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 73/134] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:47.031720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df6b58-b3f2-4d62-9c82-205823d5263e None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:47.052181 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:47.159524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36deeb02-f228-451d-9304-a1fe2882673a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:47.207824 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c87527-3d27-4baa-b571-8bdeb5987bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:47.209229 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c87527-3d27-4baa-b571-8bdeb5987bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:47.211410 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c87527-3d27-4baa-b571-8bdeb5987bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:47.211724 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c87527-3d27-4baa-b571-8bdeb5987bc3 None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:47.213754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c87527-3d27-4baa-b571-8bdeb5987bc3 None admin] RBAC: Authorizing `identity:get_project(project_id=927eca8521754c2ebbb30dec8ac82458)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:47.215570 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c87527-3d27-4baa-b571-8bdeb5987bc3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:47.218551 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 62/135] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:28:46 2022] GET /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:47.219830 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c0702-09a2-4f26-a124-28d0f85e58cc None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:47.220130 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c0702-09a2-4f26-a124-28d0f85e58cc None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:47.220421 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c0702-09a2-4f26-a124-28d0f85e58cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:47.226740 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df6b58-b3f2-4d62-9c82-205823d5263e None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:47.243190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1b8c0702-09a2-4f26-a124-28d0f85e58cc None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:47.244439 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1b8c0702-09a2-4f26-a124-28d0f85e58cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:47.255149 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:47.278998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9593ca8-9bd4-4852-a3aa-c7781fd6e0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:47.280199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9593ca8-9bd4-4852-a3aa-c7781fd6e0eb None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:47.280748 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9593ca8-9bd4-4852-a3aa-c7781fd6e0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:47.281203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9593ca8-9bd4-4852-a3aa-c7781fd6e0eb None admin] PATH_INFO: `/v3/projects/da77290b02e84154bac8193f225afe3e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:47.283023 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9593ca8-9bd4-4852-a3aa-c7781fd6e0eb None admin] RBAC: Authorizing `identity:get_project(project_id=da77290b02e84154bac8193f225afe3e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:47.285470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9593ca8-9bd4-4852-a3aa-c7781fd6e0eb None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:47.287355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 74/136] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:28:47 2022] GET /identity/v3/projects/da77290b02e84154bac8193f225afe3e => generated 312 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:47.288617 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204af54-c9aa-4a60-b45b-936038bb5ec3 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:47.288879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204af54-c9aa-4a60-b45b-936038bb5ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:47.289202 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c204af54-c9aa-4a60-b45b-936038bb5ec3 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:47.290578 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 75/137] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:47.291255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204af54-c9aa-4a60-b45b-936038bb5ec3 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:47.341219 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 63/138] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:47.342972 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cf123-77ca-4b49-8f5c-bcda758972c8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:47.343413 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cf123-77ca-4b49-8f5c-bcda758972c8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:47.343868 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cf123-77ca-4b49-8f5c-bcda758972c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:47.365996 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-346cf123-77ca-4b49-8f5c-bcda758972c8 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:47.367561 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-346cf123-77ca-4b49-8f5c-bcda758972c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:47.411596 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:47.436840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c204af54-c9aa-4a60-b45b-936038bb5ec3 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:47.459991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 64/139] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:47.460832 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346cf123-77ca-4b49-8f5c-bcda758972c8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:47.485310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1967224-7481-4c85-a9d5-8c04a08e74d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:47.486836 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1967224-7481-4c85-a9d5-8c04a08e74d2 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:47.487343 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1967224-7481-4c85-a9d5-8c04a08e74d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:47.487921 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1967224-7481-4c85-a9d5-8c04a08e74d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:47.488992 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1967224-7481-4c85-a9d5-8c04a08e74d2 None admin] RBAC: Adding query filter params (role.id=2b96b81e91b549b8b94f331c2772c9de, scope.project.id=927eca8521754c2ebbb30dec8ac82458, user.id=fa3f29169f5b4f1e80505039d26e92c6) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:47.489581 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1967224-7481-4c85-a9d5-8c04a08e74d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:47.491324 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1967224-7481-4c85-a9d5-8c04a08e74d2 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:47.497990 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 76/140] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:47 2022] GET /identity/v3/role_assignments?user.id=fa3f29169f5b4f1e80505039d26e92c6&scope.project.id=927eca8521754c2ebbb30dec8ac82458&role.id=2b96b81e91b549b8b94f331c2772c9de => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:47.499571 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1967224-7481-4c85-a9d5-8c04a08e74d2 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:47.608214 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:47.667879 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346cf123-77ca-4b49-8f5c-bcda758972c8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:47.713316 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1967224-7481-4c85-a9d5-8c04a08e74d2 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:47.734305 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ded01-0775-4434-a62c-ffd0ac6bac26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:47.735229 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ded01-0775-4434-a62c-ffd0ac6bac26 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:47.735519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ded01-0775-4434-a62c-ffd0ac6bac26 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:47.735831 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ded01-0775-4434-a62c-ffd0ac6bac26 None admin] PATH_INFO: `/v3/projects/da77290b02e84154bac8193f225afe3e/users/99906ed469184f2280ab4490ea782efa/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:47.737960 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ded01-0775-4434-a62c-ffd0ac6bac26 None admin] RBAC: Authorizing `identity:create_grant(project_id=da77290b02e84154bac8193f225afe3e, user_id=99906ed469184f2280ab4490ea782efa, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:47.739462 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ded01-0775-4434-a62c-ffd0ac6bac26 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:47.753139 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef275d83-cead-410e-82cb-ca917ec3ef1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:47.754372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef275d83-cead-410e-82cb-ca917ec3ef1d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:47.754879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef275d83-cead-410e-82cb-ca917ec3ef1d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:47.755370 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef275d83-cead-410e-82cb-ca917ec3ef1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:47.756824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef275d83-cead-410e-82cb-ca917ec3ef1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:47.758821 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef275d83-cead-410e-82cb-ca917ec3ef1d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:47.761138 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 77/141] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:47.768888 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef275d83-cead-410e-82cb-ca917ec3ef1d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:47.794678 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:47.839504 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 65/142] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:28:47 2022] PUT /identity/v3/projects/da77290b02e84154bac8193f225afe3e/users/99906ed469184f2280ab4490ea782efa/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:28:47.840085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ded01-0775-4434-a62c-ffd0ac6bac26 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:47.876611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef275d83-cead-410e-82cb-ca917ec3ef1d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:47.917662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e1237-71a3-4b3b-96d3-ad1c6c2b2ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:47.918951 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e1237-71a3-4b3b-96d3-ad1c6c2b2ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:47.919475 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e1237-71a3-4b3b-96d3-ad1c6c2b2ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:47.919952 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e1237-71a3-4b3b-96d3-ad1c6c2b2ee2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:47.934376 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e1237-71a3-4b3b-96d3-ad1c6c2b2ee2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:47.951604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-562e1237-71a3-4b3b-96d3-ad1c6c2b2ee2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:28:47.951604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:47.951604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:47.951604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:47.951604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:47.951604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:47.951604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:47.951604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:47.951604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:47.951604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:47.951604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:47.951604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:47.951604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:47.951604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:47.951604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:47.951604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:47.952546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:47.952546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:47.952546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:47.952546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:47.952546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:47.952546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:47.952546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:47.952546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:47.952546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:47.952546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:47.952546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:47.952546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:47.952546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:47.952546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:47.952546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:47.952546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:47.953373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:47.953373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:47.953373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:47.953373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:47.953373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:47.953373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:47.953373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:47.953373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:47.953373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:47.953373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:47.953373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:28:47.953373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:28:47.958205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 78/143] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:47.964294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e1237-71a3-4b3b-96d3-ad1c6c2b2ee2 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:48.085437 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:48.108678 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e1237-71a3-4b3b-96d3-ad1c6c2b2ee2 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:48.156245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd1457-10ef-466d-b1ba-f2a0a2c1eac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:48.157328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd1457-10ef-466d-b1ba-f2a0a2c1eac5 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:48.157817 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd1457-10ef-466d-b1ba-f2a0a2c1eac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:48.158349 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd1457-10ef-466d-b1ba-f2a0a2c1eac5 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:48.159883 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd1457-10ef-466d-b1ba-f2a0a2c1eac5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:48.160452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd1457-10ef-466d-b1ba-f2a0a2c1eac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:48.162719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd1457-10ef-466d-b1ba-f2a0a2c1eac5 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:48.173150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 79/144] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:28:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:48.181903 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd1457-10ef-466d-b1ba-f2a0a2c1eac5 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:48.184181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ded01-0775-4434-a62c-ffd0ac6bac26 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:48.247009 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:48.258166 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae9068-1048-4428-b122-1745c8df4982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:48.258854 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae9068-1048-4428-b122-1745c8df4982 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:48.259148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae9068-1048-4428-b122-1745c8df4982 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:48.259433 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae9068-1048-4428-b122-1745c8df4982 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:48.260159 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae9068-1048-4428-b122-1745c8df4982 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:48.261649 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae9068-1048-4428-b122-1745c8df4982 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:48.362485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd1457-10ef-466d-b1ba-f2a0a2c1eac5 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:48.381912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 66/145] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 16:28:47 2022] POST /identity/v3/users => generated 283 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:48.426830 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:48.434141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b988b1-5bdd-4604-bda2-1424389c3fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:48.435117 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b988b1-5bdd-4604-bda2-1424389c3fda None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:48.435402 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b988b1-5bdd-4604-bda2-1424389c3fda None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:48.435724 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b988b1-5bdd-4604-bda2-1424389c3fda None admin] PATH_INFO: `/v3/users/99906ed469184f2280ab4490ea782efa` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:48.437234 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b988b1-5bdd-4604-bda2-1424389c3fda None admin] RBAC: Authorizing `identity:get_user(user_id=99906ed469184f2280ab4490ea782efa)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:48.438743 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b988b1-5bdd-4604-bda2-1424389c3fda None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:48.442196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 80/146] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:48 2022] GET /identity/v3/users/99906ed469184f2280ab4490ea782efa => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:48.447914 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae9068-1048-4428-b122-1745c8df4982 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:48.592819 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae9068-1048-4428-b122-1745c8df4982 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:48.646963 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba99e4-aa9c-49fe-89bb-29b105584c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:48.647682 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba99e4-aa9c-49fe-89bb-29b105584c61 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:48.647974 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba99e4-aa9c-49fe-89bb-29b105584c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:48.648259 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba99e4-aa9c-49fe-89bb-29b105584c61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:48.736074 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:48.752566 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba99e4-aa9c-49fe-89bb-29b105584c61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:48.754262 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba99e4-aa9c-49fe-89bb-29b105584c61 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:48.874788 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 67/147] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:48.881766 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b988b1-5bdd-4604-bda2-1424389c3fda None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:49.018983 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b988b1-5bdd-4604-bda2-1424389c3fda None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:49.060745 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729bc80-6524-4ffd-b103-77e63fc1b25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:49.062036 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729bc80-6524-4ffd-b103-77e63fc1b25c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:49.062578 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729bc80-6524-4ffd-b103-77e63fc1b25c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:49.063050 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729bc80-6524-4ffd-b103-77e63fc1b25c None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:49.064560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729bc80-6524-4ffd-b103-77e63fc1b25c None admin] RBAC: Authorizing `identity:get_project(project_id=927eca8521754c2ebbb30dec8ac82458)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:49.066291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729bc80-6524-4ffd-b103-77e63fc1b25c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:49.068502 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 81/148] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:28:48 2022] GET /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:49.077056 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba99e4-aa9c-49fe-89bb-29b105584c61 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:49.309810 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:49.334496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba99e4-aa9c-49fe-89bb-29b105584c61 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:49.387594 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f9a18-ed08-4ce6-9c1b-3767a94052a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:49.388635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f9a18-ed08-4ce6-9c1b-3767a94052a9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:49.389182 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f9a18-ed08-4ce6-9c1b-3767a94052a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:49.389734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f9a18-ed08-4ce6-9c1b-3767a94052a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:49.390787 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f9a18-ed08-4ce6-9c1b-3767a94052a9 None admin] RBAC: Adding query filter params (role.id=38ab22e38dfd483dbd2f224b3088f16e, scope.project.id=927eca8521754c2ebbb30dec8ac82458, user.id=99906ed469184f2280ab4490ea782efa) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:49.391302 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f9a18-ed08-4ce6-9c1b-3767a94052a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:49.394305 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f9a18-ed08-4ce6-9c1b-3767a94052a9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:49.401558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 68/149] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:49 2022] GET /identity/v3/role_assignments?user.id=99906ed469184f2280ab4490ea782efa&scope.project.id=927eca8521754c2ebbb30dec8ac82458&role.id=38ab22e38dfd483dbd2f224b3088f16e => generated 608 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:49.493544 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f26376-6eff-42e1-85ea-e3b70c92c2f8 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:49.493859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f26376-6eff-42e1-85ea-e3b70c92c2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:49.494125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f26376-6eff-42e1-85ea-e3b70c92c2f8 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:49.495520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 82/150] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:49.501254 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc209097-6cc7-4822-97b9-562da185aa70 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:49.501550 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc209097-6cc7-4822-97b9-562da185aa70 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:49.501828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc209097-6cc7-4822-97b9-562da185aa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:49.524306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-cc209097-6cc7-4822-97b9-562da185aa70 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:49.525599 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cc209097-6cc7-4822-97b9-562da185aa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:49.535691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0800be-4f76-4eb7-a7f4-d415c3ee67a6 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:49.535691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0800be-4f76-4eb7-a7f4-d415c3ee67a6 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:49.535691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0800be-4f76-4eb7-a7f4-d415c3ee67a6 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:49.537335 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 83/151] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:49.542627 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95851fd7-3616-4554-950d-a6fe83be290f None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:49.543013 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95851fd7-3616-4554-950d-a6fe83be290f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:49.543205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95851fd7-3616-4554-950d-a6fe83be290f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:49.574867 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-95851fd7-3616-4554-950d-a6fe83be290f None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:49.576038 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-95851fd7-3616-4554-950d-a6fe83be290f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:49.656315 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 69/152] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:49.690269 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc209097-6cc7-4822-97b9-562da185aa70 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:49.725551 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:49.735282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 84/153] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:28:49.778196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95851fd7-3616-4554-950d-a6fe83be290f None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:49.793401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:49.811478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc209097-6cc7-4822-97b9-562da185aa70 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:49.852037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bc520-b97b-452b-8d32-17857d5639d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:49.852867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bc520-b97b-452b-8d32-17857d5639d7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:49.853178 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bc520-b97b-452b-8d32-17857d5639d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:49.853453 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bc520-b97b-452b-8d32-17857d5639d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:49.876356 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9bc520-b97b-452b-8d32-17857d5639d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:49.887865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-6f9bc520-b97b-452b-8d32-17857d5639d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:28:49.887865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:49.887865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:49.887865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:49.887865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:49.887865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:49.887865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:49.887865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:49.887865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:49.887865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:49.887865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:49.887865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:49.887865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:49.887865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:49.887865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:49.887865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:49.888774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:49.888774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:49.888774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:49.888774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:49.888774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:49.888774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:49.888774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:49.888774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:49.888774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:49.888774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:49.888774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:49.888774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:49.888774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:49.888774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:49.888774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:49.888774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:49.889811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:49.889811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:49.889811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:49.889811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:49.889811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:49.889811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:49.889811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:49.889811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:49.889811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:49.889811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:49.889811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:28:49.889811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:28:49.897147 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 70/154] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 16:28:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:49.900154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bc520-b97b-452b-8d32-17857d5639d7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:49.993631 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95851fd7-3616-4554-950d-a6fe83be290f None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:50.011942 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bc520-b97b-452b-8d32-17857d5639d7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:50.057040 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece56ea-e823-4fdc-9532-8a770a98b978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:50.058066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece56ea-e823-4fdc-9532-8a770a98b978 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:50.058353 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece56ea-e823-4fdc-9532-8a770a98b978 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:50.058624 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece56ea-e823-4fdc-9532-8a770a98b978 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:50.059459 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac19371-3f09-45be-a1ea-70cca1b7e05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:50.060356 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac19371-3f09-45be-a1ea-70cca1b7e05c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:50.060842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac19371-3f09-45be-a1ea-70cca1b7e05c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:50.061386 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac19371-3f09-45be-a1ea-70cca1b7e05c None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:50.062349 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac19371-3f09-45be-a1ea-70cca1b7e05c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:50.062871 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac19371-3f09-45be-a1ea-70cca1b7e05c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:50.064905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac19371-3f09-45be-a1ea-70cca1b7e05c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:50.074938 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 71/155] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:50.081851 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac19371-3f09-45be-a1ea-70cca1b7e05c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:50.082862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece56ea-e823-4fdc-9532-8a770a98b978 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:50.086974 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:50.098076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-8ece56ea-e823-4fdc-9532-8a770a98b978 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:50.098076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:50.098076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:50.098076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:50.098076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:50.098076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:50.098076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:50.098076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:50.098076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:50.098076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:50.098076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:50.098076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:50.098076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:50.098076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:50.098076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:50.098076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:50.099723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:50.099723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:50.099723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:50.099723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:50.099723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:50.099723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:50.099723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:50.099723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:50.099723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:50.099723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:50.099723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:50.099723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:50.099723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:50.099723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:50.099723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:50.099723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:50.100520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:50.100520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:50.100520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:50.100520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:50.100520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:50.100520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:50.100520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:50.100520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:50.100520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:50.100520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:50.100520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:50.100520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:28:50.107136 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 85/156] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:28:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:50.116301 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece56ea-e823-4fdc-9532-8a770a98b978 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:50.206827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac19371-3f09-45be-a1ea-70cca1b7e05c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:50.241462 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:50.258642 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358965e3-f80d-4177-9549-6759ee9b82b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:50.259556 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358965e3-f80d-4177-9549-6759ee9b82b0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:50.265081 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358965e3-f80d-4177-9549-6759ee9b82b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:50.265081 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358965e3-f80d-4177-9549-6759ee9b82b0 None admin] PATH_INFO: `/v3/users/99906ed469184f2280ab4490ea782efa` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:50.265081 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358965e3-f80d-4177-9549-6759ee9b82b0 None admin] RBAC: Authorizing `identity:get_user(user_id=99906ed469184f2280ab4490ea782efa)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:50.265081 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358965e3-f80d-4177-9549-6759ee9b82b0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:50.265631 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 72/157] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:50 2022] GET /identity/v3/users/99906ed469184f2280ab4490ea782efa => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:50.271744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358965e3-f80d-4177-9549-6759ee9b82b0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:50.323457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece56ea-e823-4fdc-9532-8a770a98b978 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:50.383630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:50.428168 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358965e3-f80d-4177-9549-6759ee9b82b0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:50.449767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fd361b-26e7-4810-ae3c-192e36748dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:50.450808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd361b-26e7-4810-ae3c-192e36748dfa None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:50.451356 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd361b-26e7-4810-ae3c-192e36748dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:50.451888 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fd361b-26e7-4810-ae3c-192e36748dfa None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:50.452860 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd361b-26e7-4810-ae3c-192e36748dfa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:50.453391 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd361b-26e7-4810-ae3c-192e36748dfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:50.455059 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fd361b-26e7-4810-ae3c-192e36748dfa None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:50.472210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 86/158] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:50.473901 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6704f68-d32d-41e9-8bc9-d508b60a9ac2 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:50.474393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6704f68-d32d-41e9-8bc9-d508b60a9ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:50.474903 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6704f68-d32d-41e9-8bc9-d508b60a9ac2 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:50.476372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 87/159] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:50.481730 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a297e-943c-4b99-9291-d87c34f407e3 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:50.482274 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a297e-943c-4b99-9291-d87c34f407e3 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:50.482747 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186a297e-943c-4b99-9291-d87c34f407e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:50.490336 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5050d8-0962-4dd3-9311-358707700da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:50.491014 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5050d8-0962-4dd3-9311-358707700da2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:50.491303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5050d8-0962-4dd3-9311-358707700da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:50.491589 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5050d8-0962-4dd3-9311-358707700da2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:50.522077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-186a297e-943c-4b99-9291-d87c34f407e3 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:50.523639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-186a297e-943c-4b99-9291-d87c34f407e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:50.620923 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5050d8-0962-4dd3-9311-358707700da2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:50.622454 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5050d8-0962-4dd3-9311-358707700da2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:50.722600 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 88/160] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:50.723851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a297e-943c-4b99-9291-d87c34f407e3 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:50.744105 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:50.795885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 73/161] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:50.797175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5050d8-0962-4dd3-9311-358707700da2 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:50.858151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:50.985795 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5050d8-0962-4dd3-9311-358707700da2 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:50.998632 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186a297e-943c-4b99-9291-d87c34f407e3 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:51.044422 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42830d8a-978c-44b7-9a88-3cfbe2c404e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:51.045508 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42830d8a-978c-44b7-9a88-3cfbe2c404e2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:51.046102 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42830d8a-978c-44b7-9a88-3cfbe2c404e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:51.047135 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42830d8a-978c-44b7-9a88-3cfbe2c404e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:51.065883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42830d8a-978c-44b7-9a88-3cfbe2c404e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:51.070610 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e76d5-04d7-4e6b-b4f1-e0f0cab7c1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:51.071676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e76d5-04d7-4e6b-b4f1-e0f0cab7c1bd None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:51.072142 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e76d5-04d7-4e6b-b4f1-e0f0cab7c1bd None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:51.072576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e76d5-04d7-4e6b-b4f1-e0f0cab7c1bd None admin] PATH_INFO: `/v3/users/c740c2989cfd4a19b4bb2520a5d2cbf7` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:51.079221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-42830d8a-978c-44b7-9a88-3cfbe2c404e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:28:51.079221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:51.079221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:51.079221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:51.079221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:51.079221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:51.079221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:51.079221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:51.079221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:51.079221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:51.079221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:51.079221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:51.079221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:51.079221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:51.079221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:51.079221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:51.081173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:51.081173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:51.081173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:51.081173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:51.081173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:51.081173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:51.081173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:51.081173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:51.081173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:51.081173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:51.081173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:51.081173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:51.081173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:51.081173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:51.081173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:51.081173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:51.082027 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:51.082027 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:51.082027 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:51.082027 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:51.082027 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:51.082027 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:51.082027 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:51.082027 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:51.082027 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:51.082027 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:51.082027 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:28:51.082027 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:28:51.083443 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e76d5-04d7-4e6b-b4f1-e0f0cab7c1bd None admin] RBAC: Authorizing `identity:get_user(user_id=c740c2989cfd4a19b4bb2520a5d2cbf7)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:51.085298 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e76d5-04d7-4e6b-b4f1-e0f0cab7c1bd None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:51.087300 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 89/162] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:50 2022] GET /identity/v3/users/c740c2989cfd4a19b4bb2520a5d2cbf7 => generated 247 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:51.088353 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e76d5-04d7-4e6b-b4f1-e0f0cab7c1bd None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:51.090215 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 74/163] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:51.094350 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500f11f-4085-4c62-bf9c-6eb34af7d314 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:51.096295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500f11f-4085-4c62-bf9c-6eb34af7d314 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:51.096804 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500f11f-4085-4c62-bf9c-6eb34af7d314 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:51.098503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 75/164] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:51.103580 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500f11f-4085-4c62-bf9c-6eb34af7d314 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:51.159468 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:51.291203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e76d5-04d7-4e6b-b4f1-e0f0cab7c1bd None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:51.296395 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500f11f-4085-4c62-bf9c-6eb34af7d314 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:51.326126 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:51.357041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda3513-c81f-4b60-8f47-c0ed2e34a872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:51.358185 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda3513-c81f-4b60-8f47-c0ed2e34a872 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:51.358731 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda3513-c81f-4b60-8f47-c0ed2e34a872 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:51.359298 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda3513-c81f-4b60-8f47-c0ed2e34a872 None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:51.361217 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda3513-c81f-4b60-8f47-c0ed2e34a872 None admin] RBAC: Authorizing `identity:get_project(project_id=927eca8521754c2ebbb30dec8ac82458)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:51.361817 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36d9006-c06c-40de-b1f2-57d66445f6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:51.362518 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d9006-c06c-40de-b1f2-57d66445f6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:51.362812 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d9006-c06c-40de-b1f2-57d66445f6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:51.363095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36d9006-c06c-40de-b1f2-57d66445f6b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:51.363636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda3513-c81f-4b60-8f47-c0ed2e34a872 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:51.365536 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 90/165] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:28:51 2022] GET /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:51.366496 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda3513-c81f-4b60-8f47-c0ed2e34a872 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:51.442174 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d9006-c06c-40de-b1f2-57d66445f6b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:51.443904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36d9006-c06c-40de-b1f2-57d66445f6b1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:51.476104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:51.544921 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda3513-c81f-4b60-8f47-c0ed2e34a872 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:51.552435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 76/166] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:51.554088 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d68f15-1943-4d0e-bea0-09d35f4a050e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:51.554551 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d68f15-1943-4d0e-bea0-09d35f4a050e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:51.554992 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d68f15-1943-4d0e-bea0-09d35f4a050e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:51.574449 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-26d68f15-1943-4d0e-bea0-09d35f4a050e None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:51.575895 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-26d68f15-1943-4d0e-bea0-09d35f4a050e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:51.624523 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45af895-cf8a-43f8-a039-0bca82881a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:51.625490 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45af895-cf8a-43f8-a039-0bca82881a64 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:51.625946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45af895-cf8a-43f8-a039-0bca82881a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:51.626365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45af895-cf8a-43f8-a039-0bca82881a64 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:51.627395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45af895-cf8a-43f8-a039-0bca82881a64 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:51.627950 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45af895-cf8a-43f8-a039-0bca82881a64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:51.629554 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45af895-cf8a-43f8-a039-0bca82881a64 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:51.639468 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 91/167] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:28:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:51.640755 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45af895-cf8a-43f8-a039-0bca82881a64 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:51.654722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 77/168] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:51.655591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d68f15-1943-4d0e-bea0-09d35f4a050e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:51.695908 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:51.721394 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:51.762702 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d68f15-1943-4d0e-bea0-09d35f4a050e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:51.801944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fff95-0973-4c81-afdb-b12de3a25ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:51.802751 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fff95-0973-4c81-afdb-b12de3a25ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:51.803042 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fff95-0973-4c81-afdb-b12de3a25ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:51.803325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4fff95-0973-4c81-afdb-b12de3a25ed0 None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:51.804538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fff95-0973-4c81-afdb-b12de3a25ed0 None admin] RBAC: Authorizing `identity:get_project(project_id=927eca8521754c2ebbb30dec8ac82458)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:51.806044 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4fff95-0973-4c81-afdb-b12de3a25ed0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:51.807795 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 78/169] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:28:51 2022] GET /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:51.808563 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fff95-0973-4c81-afdb-b12de3a25ed0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:51.827384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45af895-cf8a-43f8-a039-0bca82881a64 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:51.905810 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ae031-ca89-4677-852b-95d77b601e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:51.906498 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ae031-ca89-4677-852b-95d77b601e7d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:51.906783 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ae031-ca89-4677-852b-95d77b601e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:51.907060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ae031-ca89-4677-852b-95d77b601e7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:51.907900 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ae031-ca89-4677-852b-95d77b601e7d None admin] RBAC: Adding query filter params (role.id=e92acb6fd9834582bb4fd34409b37f94, scope.project.id=927eca8521754c2ebbb30dec8ac82458, user.id=99906ed469184f2280ab4490ea782efa) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:51.908276 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ae031-ca89-4677-852b-95d77b601e7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:51.910455 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ae031-ca89-4677-852b-95d77b601e7d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:51.916085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4fff95-0973-4c81-afdb-b12de3a25ed0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:51.927497 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 92/170] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:51 2022] GET /identity/v3/role_assignments?user.id=99906ed469184f2280ab4490ea782efa&scope.project.id=927eca8521754c2ebbb30dec8ac82458&role.id=e92acb6fd9834582bb4fd34409b37f94 => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:51.928149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ae031-ca89-4677-852b-95d77b601e7d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:51.963201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:51.973480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f263a55-9d9a-4de7-b4d7-ed695e5cc6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:51.974531 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f263a55-9d9a-4de7-b4d7-ed695e5cc6ca None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:51.974822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f263a55-9d9a-4de7-b4d7-ed695e5cc6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:51.975099 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f263a55-9d9a-4de7-b4d7-ed695e5cc6ca None admin] PATH_INFO: `/v3/users/fa3f29169f5b4f1e80505039d26e92c6` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:51.977983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f263a55-9d9a-4de7-b4d7-ed695e5cc6ca None admin] RBAC: Authorizing `identity:get_user(user_id=fa3f29169f5b4f1e80505039d26e92c6)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:51.977983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f263a55-9d9a-4de7-b4d7-ed695e5cc6ca None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:51.979624 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 79/171] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:51 2022] GET /identity/v3/users/fa3f29169f5b4f1e80505039d26e92c6 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:51.980399 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f263a55-9d9a-4de7-b4d7-ed695e5cc6ca None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:52.138627 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ae031-ca89-4677-852b-95d77b601e7d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:52.153035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f263a55-9d9a-4de7-b4d7-ed695e5cc6ca None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:52.175346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:52.232967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc31ef-b229-4ec8-b5a4-953a0927e49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:52.234093 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc31ef-b229-4ec8-b5a4-953a0927e49e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:52.234623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc31ef-b229-4ec8-b5a4-953a0927e49e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:52.235110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc31ef-b229-4ec8-b5a4-953a0927e49e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:52.236269 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc31ef-b229-4ec8-b5a4-953a0927e49e None admin] RBAC: Adding query filter params (role.id=c2d5d80485df4730903a874937d68aa3, scope.project.id=927eca8521754c2ebbb30dec8ac82458, user.id=c740c2989cfd4a19b4bb2520a5d2cbf7) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:52.236817 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc31ef-b229-4ec8-b5a4-953a0927e49e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:52.238557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc31ef-b229-4ec8-b5a4-953a0927e49e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:52.252961 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 80/172] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:51 2022] GET /identity/v3/role_assignments?user.id=c740c2989cfd4a19b4bb2520a5d2cbf7&scope.project.id=927eca8521754c2ebbb30dec8ac82458&role.id=c2d5d80485df4730903a874937d68aa3 => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:52.254334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc31ef-b229-4ec8-b5a4-953a0927e49e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:52.261853 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe6bcef-1dc2-449b-98ec-cf9ec4b7d342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:52.262693 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6bcef-1dc2-449b-98ec-cf9ec4b7d342 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:52.262979 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6bcef-1dc2-449b-98ec-cf9ec4b7d342 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:52.263249 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe6bcef-1dc2-449b-98ec-cf9ec4b7d342 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:52.285257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe6bcef-1dc2-449b-98ec-cf9ec4b7d342 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:52.301860 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-ebe6bcef-1dc2-449b-98ec-cf9ec4b7d342 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:28:52.301860 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:52.301860 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:52.301860 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:52.301860 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:52.301860 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:52.301860 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:52.301860 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:52.301860 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:52.301860 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:52.301860 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:52.301860 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:52.301860 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:52.301860 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:52.301860 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:52.301860 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:52.302824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:52.302824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:52.302824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:52.302824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:52.302824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:52.302824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:52.302824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:52.302824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:52.302824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:52.302824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:52.302824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:52.302824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:52.302824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:52.302824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:52.302824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:52.302824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:52.304229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:52.304229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:52.304229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:52.304229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:52.304229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:52.304229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:52.304229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:52.304229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:52.304229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:52.304229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:52.304229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:28:52.304229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:28:52.304229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 93/173] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:52.308180 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e53f8a-1bc8-4e26-a41a-297bf05d218e None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:52.308473 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e53f8a-1bc8-4e26-a41a-297bf05d218e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:52.308746 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e53f8a-1bc8-4e26-a41a-297bf05d218e None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:52.310245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 94/174] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:28:52.310951 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e53f8a-1bc8-4e26-a41a-297bf05d218e None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:52.338142 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:52.384290 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc31ef-b229-4ec8-b5a4-953a0927e49e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:52.423098 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819af052-1ff4-4396-8cad-4a07b17af63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:52.424461 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819af052-1ff4-4396-8cad-4a07b17af63f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:52.424744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819af052-1ff4-4396-8cad-4a07b17af63f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:52.425048 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819af052-1ff4-4396-8cad-4a07b17af63f None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:52.426331 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819af052-1ff4-4396-8cad-4a07b17af63f None admin] RBAC: Authorizing `identity:get_project(project_id=927eca8521754c2ebbb30dec8ac82458)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:52.427833 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819af052-1ff4-4396-8cad-4a07b17af63f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:52.429640 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 81/175] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:28:52 2022] GET /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:52.430887 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da83af-4446-47a3-b0f0-6c588ff0ae56 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:52.431240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da83af-4446-47a3-b0f0-6c588ff0ae56 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:52.431533 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da83af-4446-47a3-b0f0-6c588ff0ae56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:52.450044 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d0da83af-4446-47a3-b0f0-6c588ff0ae56 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:52.451275 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d0da83af-4446-47a3-b0f0-6c588ff0ae56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:52.531418 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 82/176] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:52.532361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da83af-4446-47a3-b0f0-6c588ff0ae56 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:52.540959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e53f8a-1bc8-4e26-a41a-297bf05d218e None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:52.588615 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274b7b1-2473-45a2-ba12-1ef8fa460c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:52.589303 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274b7b1-2473-45a2-ba12-1ef8fa460c63 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:52.589584 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274b7b1-2473-45a2-ba12-1ef8fa460c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:52.589861 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274b7b1-2473-45a2-ba12-1ef8fa460c63 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:52.590631 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274b7b1-2473-45a2-ba12-1ef8fa460c63 None admin] RBAC: Adding query filter params (name=member) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:52.590937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274b7b1-2473-45a2-ba12-1ef8fa460c63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:52.593797 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274b7b1-2473-45a2-ba12-1ef8fa460c63 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:52.613001 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:52.615051 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 95/177] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:28:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:52.618811 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274b7b1-2473-45a2-ba12-1ef8fa460c63 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:52.682743 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:52.683163 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da83af-4446-47a3-b0f0-6c588ff0ae56 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:52.733218 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cc8a1-7ac2-4504-ba17-d1d16f1559cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:52.734559 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cc8a1-7ac2-4504-ba17-d1d16f1559cc None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:52.735049 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cc8a1-7ac2-4504-ba17-d1d16f1559cc None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:52.736392 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5cc8a1-7ac2-4504-ba17-d1d16f1559cc None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458/users/fa3f29169f5b4f1e80505039d26e92c6/roles/2b96b81e91b549b8b94f331c2772c9de` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:52.739248 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cc8a1-7ac2-4504-ba17-d1d16f1559cc None admin] RBAC: Authorizing `identity:create_grant(project_id=927eca8521754c2ebbb30dec8ac82458, user_id=fa3f29169f5b4f1e80505039d26e92c6, role_id=2b96b81e91b549b8b94f331c2772c9de)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:52.741882 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5cc8a1-7ac2-4504-ba17-d1d16f1559cc None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:52.769405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274b7b1-2473-45a2-ba12-1ef8fa460c63 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:52.812809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2945348-30dd-4a6b-b1cc-ea4b021bd2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:52.813671 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2945348-30dd-4a6b-b1cc-ea4b021bd2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:52.813956 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2945348-30dd-4a6b-b1cc-ea4b021bd2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:52.814415 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2945348-30dd-4a6b-b1cc-ea4b021bd2f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:52.817133 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 83/178] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:28:52 2022] PUT /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458/users/fa3f29169f5b4f1e80505039d26e92c6/roles/2b96b81e91b549b8b94f331c2772c9de => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:28:52.818868 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cc8a1-7ac2-4504-ba17-d1d16f1559cc None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:52.828310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2945348-30dd-4a6b-b1cc-ea4b021bd2f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:52.837102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-a2945348-30dd-4a6b-b1cc-ea4b021bd2f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:52.837102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:52.837102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:52.837102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:52.837102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:52.837102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:52.837102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:52.837102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:52.837102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:52.837102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:52.837102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:52.837102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:52.837102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:52.837102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:52.837102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:52.837102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:52.838243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:52.838243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:52.838243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:52.838243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:52.838243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:52.838243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:52.838243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:52.838243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:52.838243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:52.838243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:52.838243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:52.838243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:52.838243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:52.838243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:52.838243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:52.838243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:52.839054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:52.839054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:52.839054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:52.839054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:52.839054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:52.839054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:52.839054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:52.839054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:52.839054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:52.839054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:52.839054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:52.839054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:28:52.839683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 96/179] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:28:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:52.846355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2945348-30dd-4a6b-b1cc-ea4b021bd2f8 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:52.952872 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5cc8a1-7ac2-4504-ba17-d1d16f1559cc None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:52.982698 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:52.995189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18832f2-37da-459a-8e87-bad6cc0aef62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:52.998188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18832f2-37da-459a-8e87-bad6cc0aef62 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:52.998188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18832f2-37da-459a-8e87-bad6cc0aef62 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:52.998188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18832f2-37da-459a-8e87-bad6cc0aef62 None admin] PATH_INFO: `/v3/users/99906ed469184f2280ab4490ea782efa` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:52.999509 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18832f2-37da-459a-8e87-bad6cc0aef62 None admin] RBAC: Authorizing `identity:get_user(user_id=99906ed469184f2280ab4490ea782efa)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:53.002366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18832f2-37da-459a-8e87-bad6cc0aef62 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:53.004332 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 84/180] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:52 2022] GET /identity/v3/users/99906ed469184f2280ab4490ea782efa => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:53.005672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b796f-ff1b-467f-907d-01edd2a8c289 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:53.005964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b796f-ff1b-467f-907d-01edd2a8c289 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:53.006314 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b796f-ff1b-467f-907d-01edd2a8c289 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:53.007797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 85/181] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:53.008908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca42a52-89b0-4087-ad1c-e576096032c6 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:53.009222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca42a52-89b0-4087-ad1c-e576096032c6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:53.009541 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca42a52-89b0-4087-ad1c-e576096032c6 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:53.010906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 86/182] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:53.012797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca42a52-89b0-4087-ad1c-e576096032c6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:53.036900 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:53.043640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2945348-30dd-4a6b-b1cc-ea4b021bd2f8 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:53.084078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0d5a1-dbd5-4ab4-a434-d1970dfe9139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:53.084833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0d5a1-dbd5-4ab4-a434-d1970dfe9139 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:53.085171 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0d5a1-dbd5-4ab4-a434-d1970dfe9139 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:53.085673 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0d5a1-dbd5-4ab4-a434-d1970dfe9139 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:53.086668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0d5a1-dbd5-4ab4-a434-d1970dfe9139 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:53.087467 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0d5a1-dbd5-4ab4-a434-d1970dfe9139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:53.088850 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0d5a1-dbd5-4ab4-a434-d1970dfe9139 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:53.098945 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 97/183] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:53.099999 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980d7ae-304e-4131-8ed2-d30036195b08 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:53.100373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980d7ae-304e-4131-8ed2-d30036195b08 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:53.100652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d980d7ae-304e-4131-8ed2-d30036195b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:53.119194 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d980d7ae-304e-4131-8ed2-d30036195b08 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:53.120382 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d980d7ae-304e-4131-8ed2-d30036195b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:53.142162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca42a52-89b0-4087-ad1c-e576096032c6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:53.182261 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c409ef8-ea71-4b6d-81d9-2ec7ef212901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:53.182931 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c409ef8-ea71-4b6d-81d9-2ec7ef212901 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:53.183220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c409ef8-ea71-4b6d-81d9-2ec7ef212901 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:53.183500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c409ef8-ea71-4b6d-81d9-2ec7ef212901 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:53.203648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 98/184] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:53.206875 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2956591-6a67-4b85-8ebd-e6bb2eebc3e7 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:53.206875 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2956591-6a67-4b85-8ebd-e6bb2eebc3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:53.206875 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2956591-6a67-4b85-8ebd-e6bb2eebc3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:53.230569 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c2956591-6a67-4b85-8ebd-e6bb2eebc3e7 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:53.231762 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c2956591-6a67-4b85-8ebd-e6bb2eebc3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:53.257258 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:53.271028 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c409ef8-ea71-4b6d-81d9-2ec7ef212901 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:53.272508 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c409ef8-ea71-4b6d-81d9-2ec7ef212901 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:53.310436 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 99/185] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:53.311290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2956591-6a67-4b85-8ebd-e6bb2eebc3e7 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:53.338920 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:53.389070 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 87/186] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:53.390292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c409ef8-ea71-4b6d-81d9-2ec7ef212901 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:53.434634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2956591-6a67-4b85-8ebd-e6bb2eebc3e7 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:53.474364 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269debc4-0426-4697-874f-d807e0143407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:53.475604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269debc4-0426-4697-874f-d807e0143407 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:53.475890 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269debc4-0426-4697-874f-d807e0143407 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:53.476169 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269debc4-0426-4697-874f-d807e0143407 None admin] PATH_INFO: `/v3/users/20db34ba53644b309ff728ff065a221c` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:53.488886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:53.493624 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269debc4-0426-4697-874f-d807e0143407 None admin] RBAC: Authorizing `identity:get_user(user_id=20db34ba53644b309ff728ff065a221c)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:53.495080 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269debc4-0426-4697-874f-d807e0143407 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:53.502128 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 100/187] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:53 2022] GET /identity/v3/users/20db34ba53644b309ff728ff065a221c => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:53.502695 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c409ef8-ea71-4b6d-81d9-2ec7ef212901 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:53.502877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269debc4-0426-4697-874f-d807e0143407 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:53.541363 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6a241-f8ed-4957-8807-240662ec8047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:53.542279 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6a241-f8ed-4957-8807-240662ec8047 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:53.542574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6a241-f8ed-4957-8807-240662ec8047 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:53.542855 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6a241-f8ed-4957-8807-240662ec8047 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:53.553941 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6a241-f8ed-4957-8807-240662ec8047 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:53.562017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-59d6a241-f8ed-4957-8807-240662ec8047 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:28:53.562017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:53.562017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:53.562017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:53.562017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:53.562017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:53.562017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:53.562017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:53.562017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:53.562017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:53.562017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:53.562017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:53.562017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:53.562017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:53.562017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:53.562017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:53.563084 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:53.563084 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:53.563084 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:53.563084 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:53.563084 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:53.563084 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:53.563084 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:53.563084 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:53.563084 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:53.563084 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:53.563084 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:53.563084 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:53.563084 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:53.563084 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:53.563084 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:53.563084 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:53.564633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:53.564633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:53.564633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:53.564633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:53.564633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:53.564633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:53.564633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:53.564633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:53.564633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:53.564633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:53.564633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:28:53.564633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:28:53.568680 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 88/188] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 16:28:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:53.569620 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6a241-f8ed-4957-8807-240662ec8047 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:53.590399 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:53.617292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269debc4-0426-4697-874f-d807e0143407 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:53.654412 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73033080-0037-4c93-980f-14da4b23ff4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:53.655235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73033080-0037-4c93-980f-14da4b23ff4f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:53.655575 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73033080-0037-4c93-980f-14da4b23ff4f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:53.655943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73033080-0037-4c93-980f-14da4b23ff4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:53.657167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73033080-0037-4c93-980f-14da4b23ff4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:53.659316 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73033080-0037-4c93-980f-14da4b23ff4f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:53.661025 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 101/189] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:53.661806 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73033080-0037-4c93-980f-14da4b23ff4f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:53.688957 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6a241-f8ed-4957-8807-240662ec8047 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:53.725784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee784a-fc58-4fdd-8ef0-6c50eef301aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:53.726586 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee784a-fc58-4fdd-8ef0-6c50eef301aa None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:53.726876 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee784a-fc58-4fdd-8ef0-6c50eef301aa None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:53.727157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee784a-fc58-4fdd-8ef0-6c50eef301aa None admin] PATH_INFO: `/v3/projects/da77290b02e84154bac8193f225afe3e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:53.728384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee784a-fc58-4fdd-8ef0-6c50eef301aa None admin] RBAC: Authorizing `identity:get_project(project_id=da77290b02e84154bac8193f225afe3e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:53.729871 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee784a-fc58-4fdd-8ef0-6c50eef301aa None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:53.736873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 89/190] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:28:53 2022] GET /identity/v3/projects/da77290b02e84154bac8193f225afe3e => generated 312 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:53.736873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee784a-fc58-4fdd-8ef0-6c50eef301aa None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:53.751212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:53.779532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73033080-0037-4c93-980f-14da4b23ff4f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:53.819468 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39831885-827a-4381-81d6-682d94da0ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:53.821331 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39831885-827a-4381-81d6-682d94da0ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:53.821963 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39831885-827a-4381-81d6-682d94da0ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:53.822396 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39831885-827a-4381-81d6-682d94da0ed1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:53.837846 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:53.848420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee784a-fc58-4fdd-8ef0-6c50eef301aa None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:53.891438 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91c56d-f997-4b61-af24-bb8508d1733e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:53.892175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91c56d-f997-4b61-af24-bb8508d1733e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:53.892469 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91c56d-f997-4b61-af24-bb8508d1733e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:53.892726 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b91c56d-f997-4b61-af24-bb8508d1733e None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:53.893673 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91c56d-f997-4b61-af24-bb8508d1733e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:53.893985 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91c56d-f997-4b61-af24-bb8508d1733e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:53.895392 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b91c56d-f997-4b61-af24-bb8508d1733e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:53.896885 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39831885-827a-4381-81d6-682d94da0ed1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:53.898399 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39831885-827a-4381-81d6-682d94da0ed1 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:53.904692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 90/191] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:53.909556 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91c56d-f997-4b61-af24-bb8508d1733e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:53.996946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:54.006713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 102/192] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:54.007823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39831885-827a-4381-81d6-682d94da0ed1 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:54.027730 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b91c56d-f997-4b61-af24-bb8508d1733e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:54.057590 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:54.063807 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d05def-f8c6-4ca5-8adc-67c65b6e28b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:54.064975 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d05def-f8c6-4ca5-8adc-67c65b6e28b4 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:54.065716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d05def-f8c6-4ca5-8adc-67c65b6e28b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:54.066383 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d05def-f8c6-4ca5-8adc-67c65b6e28b4 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:54.067833 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d05def-f8c6-4ca5-8adc-67c65b6e28b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:54.069223 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d05def-f8c6-4ca5-8adc-67c65b6e28b4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:54.115857 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39831885-827a-4381-81d6-682d94da0ed1 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:54.151559 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd0feb-3f8e-4c22-aa63-38c5b48b799b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:54.152229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd0feb-3f8e-4c22-aa63-38c5b48b799b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:54.152517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd0feb-3f8e-4c22-aa63-38c5b48b799b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:54.152795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd0feb-3f8e-4c22-aa63-38c5b48b799b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:54.153674 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd0feb-3f8e-4c22-aa63-38c5b48b799b None admin] RBAC: Adding query filter params (role.id=38ab22e38dfd483dbd2f224b3088f16e, scope.project.id=da77290b02e84154bac8193f225afe3e, user.id=99906ed469184f2280ab4490ea782efa) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:54.153986 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd0feb-3f8e-4c22-aa63-38c5b48b799b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:54.155437 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd0feb-3f8e-4c22-aa63-38c5b48b799b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:54.162371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 103/193] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:54 2022] GET /identity/v3/role_assignments?user.id=99906ed469184f2280ab4490ea782efa&scope.project.id=da77290b02e84154bac8193f225afe3e&role.id=38ab22e38dfd483dbd2f224b3088f16e => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:54.162371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd0feb-3f8e-4c22-aa63-38c5b48b799b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:54.232753 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 91/194] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 16:28:53 2022] POST /identity/v3/users => generated 297 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:54.233922 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d05def-f8c6-4ca5-8adc-67c65b6e28b4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:54.315859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd0feb-3f8e-4c22-aa63-38c5b48b799b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:54.326233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:54.364111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401f8ef-f2d8-48f7-9204-2d5551a789e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:54.367589 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401f8ef-f2d8-48f7-9204-2d5551a789e5 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:54.368206 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401f8ef-f2d8-48f7-9204-2d5551a789e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:54.369834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401f8ef-f2d8-48f7-9204-2d5551a789e5 None admin] PATH_INFO: `/v3/users/20db34ba53644b309ff728ff065a221c` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:54.371524 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401f8ef-f2d8-48f7-9204-2d5551a789e5 None admin] RBAC: Authorizing `identity:get_user(user_id=20db34ba53644b309ff728ff065a221c)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:54.379857 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401f8ef-f2d8-48f7-9204-2d5551a789e5 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:54.389609 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 104/195] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:54 2022] GET /identity/v3/users/20db34ba53644b309ff728ff065a221c => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:54.402293 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401f8ef-f2d8-48f7-9204-2d5551a789e5 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:54.479281 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d05def-f8c6-4ca5-8adc-67c65b6e28b4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:54.536742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570932b-7bab-4fae-b501-c6486b179308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:54.537652 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570932b-7bab-4fae-b501-c6486b179308 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:54.537948 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570932b-7bab-4fae-b501-c6486b179308 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:54.538246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570932b-7bab-4fae-b501-c6486b179308 None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:54.540038 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570932b-7bab-4fae-b501-c6486b179308 None admin] RBAC: Authorizing `identity:get_project(project_id=fe62d682160e40e48208c627043f6ee5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:54.541750 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570932b-7bab-4fae-b501-c6486b179308 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:54.544441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 92/196] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:28:54 2022] GET /identity/v3/projects/fe62d682160e40e48208c627043f6ee5 => generated 302 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:54.553215 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570932b-7bab-4fae-b501-c6486b179308 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:54.561490 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401f8ef-f2d8-48f7-9204-2d5551a789e5 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:54.570614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:54.611149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d669263-867a-4674-bfd1-01fe2e514806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:54.613065 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d669263-867a-4674-bfd1-01fe2e514806 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:54.613065 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d669263-867a-4674-bfd1-01fe2e514806 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:54.613065 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d669263-867a-4674-bfd1-01fe2e514806 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:54.675898 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:54.710660 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d669263-867a-4674-bfd1-01fe2e514806 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:54.712167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d669263-867a-4674-bfd1-01fe2e514806 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:54.799086 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570932b-7bab-4fae-b501-c6486b179308 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:54.869359 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3999efd-582f-409f-814b-ef95d1b71156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:54.869967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3999efd-582f-409f-814b-ef95d1b71156 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:54.870045 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3999efd-582f-409f-814b-ef95d1b71156 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:54.870420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3999efd-582f-409f-814b-ef95d1b71156 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:54.871359 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3999efd-582f-409f-814b-ef95d1b71156 None admin] RBAC: Adding query filter params (role.id=c2d5d80485df4730903a874937d68aa3, scope.project.id=fe62d682160e40e48208c627043f6ee5, user.id=20db34ba53644b309ff728ff065a221c) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:54.871748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3999efd-582f-409f-814b-ef95d1b71156 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:54.873628 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3999efd-582f-409f-814b-ef95d1b71156 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:54.881284 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 93/197] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:54 2022] GET /identity/v3/role_assignments?user.id=20db34ba53644b309ff728ff065a221c&scope.project.id=fe62d682160e40e48208c627043f6ee5&role.id=c2d5d80485df4730903a874937d68aa3 => generated 259 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:54.902979 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 105/198] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:54.910033 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3999efd-582f-409f-814b-ef95d1b71156 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:55.049929 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:55.080875 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba67bb-5a57-433f-bce3-fd156b7736cb None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:55.081718 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba67bb-5a57-433f-bce3-fd156b7736cb None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:55.082203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba67bb-5a57-433f-bce3-fd156b7736cb None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:55.089397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 106/199] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:55 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:55.091197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf8573-63c2-4556-9df8-069cbbbbac05 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:55.091685 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf8573-63c2-4556-9df8-069cbbbbac05 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:55.092182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf8573-63c2-4556-9df8-069cbbbbac05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:55.105085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3999efd-582f-409f-814b-ef95d1b71156 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:55.132998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-addf8573-63c2-4556-9df8-069cbbbbac05 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:55.134749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-addf8573-63c2-4556-9df8-069cbbbbac05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:55.213753 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fca21-7910-417a-922a-240907b19c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:55.214967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fca21-7910-417a-922a-240907b19c52 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:55.215444 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fca21-7910-417a-922a-240907b19c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:55.215930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fca21-7910-417a-922a-240907b19c52 None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:55.217452 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fca21-7910-417a-922a-240907b19c52 None admin] RBAC: Authorizing `identity:get_project(project_id=fe62d682160e40e48208c627043f6ee5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:55.219169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fca21-7910-417a-922a-240907b19c52 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:55.221547 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 94/200] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:28:54 2022] GET /identity/v3/projects/fe62d682160e40e48208c627043f6ee5 => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:55.227192 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fca21-7910-417a-922a-240907b19c52 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:55.257343 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 107/201] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:55.327799 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf8573-63c2-4556-9df8-069cbbbbac05 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:55.331738 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:55.435143 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fca21-7910-417a-922a-240907b19c52 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:55.461338 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf8573-63c2-4556-9df8-069cbbbbac05 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:55.518035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cda1c1-6fbe-46f5-ab2d-c73ba032968e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:55.521145 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cda1c1-6fbe-46f5-ab2d-c73ba032968e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:55.521457 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cda1c1-6fbe-46f5-ab2d-c73ba032968e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:55.521743 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cda1c1-6fbe-46f5-ab2d-c73ba032968e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:55.522811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cda1c1-6fbe-46f5-ab2d-c73ba032968e None admin] RBAC: Adding query filter params (role.id=e92acb6fd9834582bb4fd34409b37f94, scope.project.id=fe62d682160e40e48208c627043f6ee5, user.id=20db34ba53644b309ff728ff065a221c) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:55.523214 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cda1c1-6fbe-46f5-ab2d-c73ba032968e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:55.526675 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cda1c1-6fbe-46f5-ab2d-c73ba032968e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:55.528873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:55.536084 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca2091-4865-4ba8-89ae-deda6e45970c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:55.540128 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca2091-4865-4ba8-89ae-deda6e45970c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:55.540128 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca2091-4865-4ba8-89ae-deda6e45970c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:55.540128 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca2091-4865-4ba8-89ae-deda6e45970c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:55.541979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 95/202] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:55 2022] GET /identity/v3/role_assignments?user.id=20db34ba53644b309ff728ff065a221c&scope.project.id=fe62d682160e40e48208c627043f6ee5&role.id=e92acb6fd9834582bb4fd34409b37f94 => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:55.553329 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca2091-4865-4ba8-89ae-deda6e45970c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:55.563000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-fbca2091-4865-4ba8-89ae-deda6e45970c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:28:55.563000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:55.563000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:55.563000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:55.563000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:55.563000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:55.563000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:55.563000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:55.563000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:55.563000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:55.563000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:55.563000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:55.563000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:55.563000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:55.563000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:55.563000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:55.564658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:55.564658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:55.564658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:55.564658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:55.564658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:55.564658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:55.564658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:55.564658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:55.564658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:55.564658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:55.564658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:55.564658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:55.564658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:55.564658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:55.564658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:55.564658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:55.565613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:55.565613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:55.565613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:55.565613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:55.565613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:55.565613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:55.565613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:55.565613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:55.565613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:55.565613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:55.565613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:28:55.565613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:28:55.565613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 108/203] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:55.574219 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cda1c1-6fbe-46f5-ab2d-c73ba032968e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:55.706570 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cda1c1-6fbe-46f5-ab2d-c73ba032968e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:55.763056 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3480613-cff7-4cb7-88fb-804d109d8f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:55.764080 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3480613-cff7-4cb7-88fb-804d109d8f59 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:55.764366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3480613-cff7-4cb7-88fb-804d109d8f59 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:55.764645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3480613-cff7-4cb7-88fb-804d109d8f59 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:55.765454 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3480613-cff7-4cb7-88fb-804d109d8f59 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:55.765765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3480613-cff7-4cb7-88fb-804d109d8f59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:55.767284 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3480613-cff7-4cb7-88fb-804d109d8f59 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:55.778231 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 96/204] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:28:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:55.784772 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca2091-4865-4ba8-89ae-deda6e45970c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:55.877737 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:55.925322 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca2091-4865-4ba8-89ae-deda6e45970c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:55.972742 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c73519-7a5f-4467-a7a2-6311464b5c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:55.974132 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c73519-7a5f-4467-a7a2-6311464b5c20 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:55.974633 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c73519-7a5f-4467-a7a2-6311464b5c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:55.975114 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c73519-7a5f-4467-a7a2-6311464b5c20 None admin] PATH_INFO: `/v3/users/fa3f29169f5b4f1e80505039d26e92c6` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:55.981984 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c73519-7a5f-4467-a7a2-6311464b5c20 None admin] RBAC: Authorizing `identity:get_user(user_id=fa3f29169f5b4f1e80505039d26e92c6)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:55.984242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c73519-7a5f-4467-a7a2-6311464b5c20 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:55.986880 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 109/205] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:55 2022] GET /identity/v3/users/fa3f29169f5b4f1e80505039d26e92c6 => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:55.993323 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3480613-cff7-4cb7-88fb-804d109d8f59 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:56.102527 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:56.175718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3480613-cff7-4cb7-88fb-804d109d8f59 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:56.233796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50f93e-65b4-4cc8-9d06-94f37e2d3f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:56.234389 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50f93e-65b4-4cc8-9d06-94f37e2d3f17 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:56.234686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50f93e-65b4-4cc8-9d06-94f37e2d3f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:56.234983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50f93e-65b4-4cc8-9d06-94f37e2d3f17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:56.329345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50f93e-65b4-4cc8-9d06-94f37e2d3f17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:56.331526 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50f93e-65b4-4cc8-9d06-94f37e2d3f17 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:56.403591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:56.463371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 97/206] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:56.469291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c73519-7a5f-4467-a7a2-6311464b5c20 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:56.636818 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c73519-7a5f-4467-a7a2-6311464b5c20 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:56.711481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:56.716809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2424b3-615e-4b4e-8fa6-655adde70174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:56.717762 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2424b3-615e-4b4e-8fa6-655adde70174 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:56.718044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2424b3-615e-4b4e-8fa6-655adde70174 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:56.718398 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2424b3-615e-4b4e-8fa6-655adde70174 None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:56.725736 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2424b3-615e-4b4e-8fa6-655adde70174 None admin] RBAC: Authorizing `identity:get_project(project_id=927eca8521754c2ebbb30dec8ac82458)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:56.727277 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2424b3-615e-4b4e-8fa6-655adde70174 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:56.729344 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 110/207] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:28:56 2022] GET /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:56.735366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50f93e-65b4-4cc8-9d06-94f37e2d3f17 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:56.903636 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50f93e-65b4-4cc8-9d06-94f37e2d3f17 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:56.965735 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee3061-3467-4497-8b55-2b832e9790e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:56.966416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee3061-3467-4497-8b55-2b832e9790e3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:56.966709 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee3061-3467-4497-8b55-2b832e9790e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:56.966996 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee3061-3467-4497-8b55-2b832e9790e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:56.967865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee3061-3467-4497-8b55-2b832e9790e3 None admin] RBAC: Adding query filter params (role.id=2b96b81e91b549b8b94f331c2772c9de, scope.project.id=927eca8521754c2ebbb30dec8ac82458, user.id=fa3f29169f5b4f1e80505039d26e92c6) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:56.968186 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee3061-3467-4497-8b55-2b832e9790e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:56.969677 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee3061-3467-4497-8b55-2b832e9790e3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:56.976550 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 98/208] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:56 2022] GET /identity/v3/role_assignments?user.id=fa3f29169f5b4f1e80505039d26e92c6&scope.project.id=927eca8521754c2ebbb30dec8ac82458&role.id=2b96b81e91b549b8b94f331c2772c9de => generated 608 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:57.133378 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649c8f1-0e4c-4ae2-af91-d6142e73404e None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:57.133751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649c8f1-0e4c-4ae2-af91-d6142e73404e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:57.133929 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649c8f1-0e4c-4ae2-af91-d6142e73404e None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:57.135382 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 111/209] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:57.150873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641a989-6efd-449e-b121-39a18fe7594f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:57.151374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641a989-6efd-449e-b121-39a18fe7594f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:57.151446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641a989-6efd-449e-b121-39a18fe7594f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:57.178474 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8641a989-6efd-449e-b121-39a18fe7594f None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:57.179705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8641a989-6efd-449e-b121-39a18fe7594f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:57.199363 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26768eb2-a2cf-433f-b616-e4c91e3b446b None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:57.199649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26768eb2-a2cf-433f-b616-e4c91e3b446b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:57.199920 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26768eb2-a2cf-433f-b616-e4c91e3b446b None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:57.201356 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 112/210] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:28:57.203433 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:57.207536 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc272f3d-8c42-4e37-a276-963044598905 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:57.207826 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc272f3d-8c42-4e37-a276-963044598905 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:57.208110 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc272f3d-8c42-4e37-a276-963044598905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:57.229638 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-dc272f3d-8c42-4e37-a276-963044598905 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:57.230841 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-dc272f3d-8c42-4e37-a276-963044598905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:57.263646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 99/211] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:57.292330 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641a989-6efd-449e-b121-39a18fe7594f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:57.309763 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 113/212] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:57.346066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc272f3d-8c42-4e37-a276-963044598905 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:57.412759 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641a989-6efd-449e-b121-39a18fe7594f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:57.460723 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f5e45-66c9-41e8-b7f9-05ac9340113b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:57.461521 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f5e45-66c9-41e8-b7f9-05ac9340113b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:57.461812 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f5e45-66c9-41e8-b7f9-05ac9340113b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:57.462096 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31f5e45-66c9-41e8-b7f9-05ac9340113b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:57.463517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f5e45-66c9-41e8-b7f9-05ac9340113b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:57.465214 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31f5e45-66c9-41e8-b7f9-05ac9340113b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:57.467307 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 100/213] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:28:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:28:57.473474 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f5e45-66c9-41e8-b7f9-05ac9340113b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:57.473787 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc272f3d-8c42-4e37-a276-963044598905 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:57.503740 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:57.512301 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:57.519616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98696fa5-d784-456e-a3ea-072ec1d954dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:57.520650 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98696fa5-d784-456e-a3ea-072ec1d954dc None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:57.529636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98696fa5-d784-456e-a3ea-072ec1d954dc None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:57.529636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98696fa5-d784-456e-a3ea-072ec1d954dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:57.531985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98696fa5-d784-456e-a3ea-072ec1d954dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:57.540773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-98696fa5-d784-456e-a3ea-072ec1d954dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:28:57.540773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:57.540773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:57.540773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:57.540773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:57.540773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:57.540773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:57.540773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:57.540773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:57.540773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:57.540773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:57.540773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:57.540773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:57.540773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:57.540773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:57.540773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:57.541688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:57.541688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:57.541688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:57.541688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:57.541688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:57.541688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:57.541688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:57.541688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:57.541688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:57.541688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:57.541688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:57.541688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:57.541688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:57.541688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:57.541688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:57.541688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:57.542720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:57.542720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:57.542720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:57.542720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:57.542720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:57.542720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:57.542720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:57.542720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:57.542720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:57.542720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:57.542720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:28:57.542720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:28:57.542720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 114/214] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:57.543786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf4dec-faba-41ae-bfe4-85b4da71db03 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:57.543786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf4dec-faba-41ae-bfe4-85b4da71db03 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:57.543914 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf4dec-faba-41ae-bfe4-85b4da71db03 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:57.545225 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 115/215] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:57.550434 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf4dec-faba-41ae-bfe4-85b4da71db03 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:57.597023 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31f5e45-66c9-41e8-b7f9-05ac9340113b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:57.639301 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034f027-ac41-4da6-a7e4-3bf3f0fe72fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:57.640815 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034f027-ac41-4da6-a7e4-3bf3f0fe72fc None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:57.641554 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034f027-ac41-4da6-a7e4-3bf3f0fe72fc None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:57.642051 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034f027-ac41-4da6-a7e4-3bf3f0fe72fc None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:57.643265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034f027-ac41-4da6-a7e4-3bf3f0fe72fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:57.644899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034f027-ac41-4da6-a7e4-3bf3f0fe72fc None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:57.664574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf4dec-faba-41ae-bfe4-85b4da71db03 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:57.699475 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cc7ab-8659-4cae-b156-5ac6fb1f9e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:57.700151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cc7ab-8659-4cae-b156-5ac6fb1f9e71 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:57.700434 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cc7ab-8659-4cae-b156-5ac6fb1f9e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:57.700712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cc7ab-8659-4cae-b156-5ac6fb1f9e71 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:57.701499 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4cc7ab-8659-4cae-b156-5ac6fb1f9e71 None admin] RBAC: Adding query filter params (name=member) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:57.701810 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4cc7ab-8659-4cae-b156-5ac6fb1f9e71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:57.703194 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4cc7ab-8659-4cae-b156-5ac6fb1f9e71 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:57.712514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 116/216] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:28:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:57.713708 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715350f-fb9a-4795-af75-cc7984ef1b6e None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:57.713996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715350f-fb9a-4795-af75-cc7984ef1b6e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:57.714268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715350f-fb9a-4795-af75-cc7984ef1b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:57.732994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a715350f-fb9a-4795-af75-cc7984ef1b6e None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:57.734254 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a715350f-fb9a-4795-af75-cc7984ef1b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:57.782742 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:57.803661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 101/217] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 16:28:57 2022] POST /identity/v3/users => generated 297 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:28:57.805937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034f027-ac41-4da6-a7e4-3bf3f0fe72fc None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:57.818975 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 117/218] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:57.847641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715350f-fb9a-4795-af75-cc7984ef1b6e None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:57.933336 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:57.974496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034f027-ac41-4da6-a7e4-3bf3f0fe72fc None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:57.975316 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715350f-fb9a-4795-af75-cc7984ef1b6e None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:58.021352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ff1cd-4ffb-4511-a5be-74191c7b2b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:58.022591 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b83ef7-37c7-4529-94bd-7ab10cd284f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:58.022712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ff1cd-4ffb-4511-a5be-74191c7b2b1d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:58.022938 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ff1cd-4ffb-4511-a5be-74191c7b2b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:58.023223 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ff1cd-4ffb-4511-a5be-74191c7b2b1d None admin] PATH_INFO: `/v3/users/805a8d3b9b1b4ac9999ee4778e7d048e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:58.023402 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83ef7-37c7-4529-94bd-7ab10cd284f5 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:58.023693 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83ef7-37c7-4529-94bd-7ab10cd284f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:58.025411 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83ef7-37c7-4529-94bd-7ab10cd284f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:58.040696 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b83ef7-37c7-4529-94bd-7ab10cd284f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:58.045742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ff1cd-4ffb-4511-a5be-74191c7b2b1d None admin] RBAC: Authorizing `identity:get_user(user_id=805a8d3b9b1b4ac9999ee4778e7d048e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:58.047383 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ff1cd-4ffb-4511-a5be-74191c7b2b1d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:58.050343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 102/219] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:57 2022] GET /identity/v3/users/805a8d3b9b1b4ac9999ee4778e7d048e => generated 297 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:58.055108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-f1b83ef7-37c7-4529-94bd-7ab10cd284f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:58.055108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:58.055108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:58.055108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:58.055108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:58.055108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:58.055108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:58.055108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:58.055108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:58.055108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:58.055108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:58.055108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:58.055108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:58.055108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:58.055108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:58.055108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:58.056809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:58.056809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:58.056809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:58.056809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:58.056809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:58.056809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:58.056809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:58.056809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:58.056809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:58.056809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:58.056809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:58.056809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:58.056809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:58.056809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:58.056809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:58.056809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:58.058640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:58.058640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:58.058640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:58.058640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:58.058640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:58.058640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:58.058640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:58.058640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:58.058640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:58.058640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:58.058640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:28:58.058640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:28:58.059463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ff1cd-4ffb-4511-a5be-74191c7b2b1d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:58.059536 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 118/220] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:28:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:28:58.062857 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b83ef7-37c7-4529-94bd-7ab10cd284f5 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:58.119576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:58.173106 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ff1cd-4ffb-4511-a5be-74191c7b2b1d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:58.193159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b83ef7-37c7-4529-94bd-7ab10cd284f5 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:58.223818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f737f-91ad-40cc-9efd-5d79d8d2ec38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:58.225226 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f737f-91ad-40cc-9efd-5d79d8d2ec38 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:58.225993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f737f-91ad-40cc-9efd-5d79d8d2ec38 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:58.226931 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f737f-91ad-40cc-9efd-5d79d8d2ec38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:58.232615 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:58.234967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6b94c-d726-4f36-bbd1-b129a878b6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:58.236323 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6b94c-d726-4f36-bbd1-b129a878b6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:58.236614 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6b94c-d726-4f36-bbd1-b129a878b6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:58.236891 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6b94c-d726-4f36-bbd1-b129a878b6f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:58.237786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6b94c-d726-4f36-bbd1-b129a878b6f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:58.238093 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6b94c-d726-4f36-bbd1-b129a878b6f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:58.239513 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6b94c-d726-4f36-bbd1-b129a878b6f8 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:58.255639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 119/221] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:28:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:58.255639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0576780-bf3b-4a57-90d1-d88e88d5d917 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:58.255639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0576780-bf3b-4a57-90d1-d88e88d5d917 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:58.255639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0576780-bf3b-4a57-90d1-d88e88d5d917 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:58.259538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 120/222] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:28:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:28:58.260071 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0576780-bf3b-4a57-90d1-d88e88d5d917 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:58.333592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f737f-91ad-40cc-9efd-5d79d8d2ec38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:58.336239 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f737f-91ad-40cc-9efd-5d79d8d2ec38 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:58.373721 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0576780-bf3b-4a57-90d1-d88e88d5d917 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:58.377914 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:58.411438 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214fd05f-1dd9-4cb7-9f86-da13c1684b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:58.412406 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fd05f-1dd9-4cb7-9f86-da13c1684b8f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:58.412728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fd05f-1dd9-4cb7-9f86-da13c1684b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:58.412936 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214fd05f-1dd9-4cb7-9f86-da13c1684b8f None admin] PATH_INFO: `/v3/users/20db34ba53644b309ff728ff065a221c` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:58.414289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214fd05f-1dd9-4cb7-9f86-da13c1684b8f None admin] RBAC: Authorizing `identity:get_user(user_id=20db34ba53644b309ff728ff065a221c)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:58.415661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214fd05f-1dd9-4cb7-9f86-da13c1684b8f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:58.422056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 121/223] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:58 2022] GET /identity/v3/users/20db34ba53644b309ff728ff065a221c => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:58.422056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141c679-884c-440d-ac71-24993eebe27d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:58.422056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141c679-884c-440d-ac71-24993eebe27d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:58.422056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9141c679-884c-440d-ac71-24993eebe27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:58.443504 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-9141c679-884c-440d-ac71-24993eebe27d None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:28:58.444775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9141c679-884c-440d-ac71-24993eebe27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:28:58.482630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 103/224] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:28:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:28:58.483321 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f737f-91ad-40cc-9efd-5d79d8d2ec38 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:58.528092 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:58.538824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 122/225] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:28:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:28:58.540495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141c679-884c-440d-ac71-24993eebe27d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:58.621256 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f737f-91ad-40cc-9efd-5d79d8d2ec38 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:58.661874 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808fda9-a226-4dc1-859a-34027d8e58b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:58.663143 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808fda9-a226-4dc1-859a-34027d8e58b4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:58.663451 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808fda9-a226-4dc1-859a-34027d8e58b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:58.663730 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a808fda9-a226-4dc1-859a-34027d8e58b4 None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:58.676125 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808fda9-a226-4dc1-859a-34027d8e58b4 None admin] RBAC: Authorizing `identity:get_project(project_id=fe62d682160e40e48208c627043f6ee5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:58.676125 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a808fda9-a226-4dc1-859a-34027d8e58b4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:58.676125 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 104/226] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:28:58 2022] GET /identity/v3/projects/fe62d682160e40e48208c627043f6ee5 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:58.676125 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808fda9-a226-4dc1-859a-34027d8e58b4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:58.678137 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9141c679-884c-440d-ac71-24993eebe27d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:58.680476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:58.730135 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf7d1d-9a86-4426-9083-c880d139e739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:58.731653 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf7d1d-9a86-4426-9083-c880d139e739 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:58.732158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf7d1d-9a86-4426-9083-c880d139e739 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:58.732730 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cf7d1d-9a86-4426-9083-c880d139e739 None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:58.734399 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf7d1d-9a86-4426-9083-c880d139e739 None admin] RBAC: Authorizing `identity:get_project(project_id=fe62d682160e40e48208c627043f6ee5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:58.736560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cf7d1d-9a86-4426-9083-c880d139e739 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:58.738604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 123/227] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:28:58 2022] GET /identity/v3/projects/fe62d682160e40e48208c627043f6ee5 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:58.739951 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf7d1d-9a86-4426-9083-c880d139e739 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:58.813661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a808fda9-a226-4dc1-859a-34027d8e58b4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:58.817382 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:58.852607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01800df7-2c2a-4115-a234-6cc6f4bc53e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:58.853712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01800df7-2c2a-4115-a234-6cc6f4bc53e3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:58.854140 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01800df7-2c2a-4115-a234-6cc6f4bc53e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:58.854557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01800df7-2c2a-4115-a234-6cc6f4bc53e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:58.867133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cf7d1d-9a86-4426-9083-c880d139e739 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:58.868050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01800df7-2c2a-4115-a234-6cc6f4bc53e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:28:58.878154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-01800df7-2c2a-4115-a234-6cc6f4bc53e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:28:58.878154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:28:58.878154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:28:58.878154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:28:58.878154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:28:58.878154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:28:58.878154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:28:58.878154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:28:58.878154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:28:58.878154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:28:58.878154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:28:58.878154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:28:58.878154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:28:58.878154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:28:58.878154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:28:58.878154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:28:58.879246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:28:58.879246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:28:58.879246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:28:58.879246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:28:58.879246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:28:58.879246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:28:58.879246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:28:58.879246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:28:58.879246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:28:58.879246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:28:58.879246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:28:58.879246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:28:58.879246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:28:58.879246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:28:58.879246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:28:58.879246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:28:58.880128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:28:58.880128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:28:58.880128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:28:58.880128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:28:58.880128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:28:58.880128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:28:58.880128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:28:58.880128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:28:58.880128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:28:58.880128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:28:58.880128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:28:58.880128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:28:58.887353 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 105/228] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 16:28:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:28:58.888651 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01800df7-2c2a-4115-a234-6cc6f4bc53e3 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:58.909995 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58202c9-fae3-483b-86ce-7e1bb00fff73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:58.911196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58202c9-fae3-483b-86ce-7e1bb00fff73 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:58.911534 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58202c9-fae3-483b-86ce-7e1bb00fff73 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:58.911818 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58202c9-fae3-483b-86ce-7e1bb00fff73 None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5/users/20db34ba53644b309ff728ff065a221c/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:58.914233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58202c9-fae3-483b-86ce-7e1bb00fff73 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe62d682160e40e48208c627043f6ee5, user_id=20db34ba53644b309ff728ff065a221c, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:58.916214 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58202c9-fae3-483b-86ce-7e1bb00fff73 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:59.000371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01800df7-2c2a-4115-a234-6cc6f4bc53e3 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:59.004855 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 124/229] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:28:58 2022] PUT /identity/v3/projects/fe62d682160e40e48208c627043f6ee5/users/20db34ba53644b309ff728ff065a221c/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:28:59.011460 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58202c9-fae3-483b-86ce-7e1bb00fff73 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:59.068774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f1e95-74f2-434a-befd-fad099dc129d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:59.070025 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f1e95-74f2-434a-befd-fad099dc129d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:59.071343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f1e95-74f2-434a-befd-fad099dc129d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:59.073269 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f1e95-74f2-434a-befd-fad099dc129d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:59.074498 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f1e95-74f2-434a-befd-fad099dc129d None admin] RBAC: Adding query filter params (role.id=38ab22e38dfd483dbd2f224b3088f16e, scope.project.id=fe62d682160e40e48208c627043f6ee5, user.id=805a8d3b9b1b4ac9999ee4778e7d048e) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:59.075419 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f1e95-74f2-434a-befd-fad099dc129d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:59.079130 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f1e95-74f2-434a-befd-fad099dc129d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:59.084144 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:59.093927 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 106/230] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:28:58 2022] GET /identity/v3/role_assignments?user.id=805a8d3b9b1b4ac9999ee4778e7d048e&scope.project.id=fe62d682160e40e48208c627043f6ee5&role.id=38ab22e38dfd483dbd2f224b3088f16e => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:59.200568 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58202c9-fae3-483b-86ce-7e1bb00fff73 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:59.260868 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a9e47-3fa2-4ed6-97ea-7ce2d2113e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:59.261603 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a9e47-3fa2-4ed6-97ea-7ce2d2113e3e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:59.261888 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a9e47-3fa2-4ed6-97ea-7ce2d2113e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:59.262157 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a9e47-3fa2-4ed6-97ea-7ce2d2113e3e None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:59.262934 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a9e47-3fa2-4ed6-97ea-7ce2d2113e3e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:28:59.263240 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a9e47-3fa2-4ed6-97ea-7ce2d2113e3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:59.264654 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825a9e47-3fa2-4ed6-97ea-7ce2d2113e3e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:59.275398 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 125/231] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:28:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:59.281170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f1e95-74f2-434a-befd-fad099dc129d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:59.319191 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:59.403526 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f1e95-74f2-434a-befd-fad099dc129d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:59.440540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181ac8b-5a71-474e-8d6f-c5c8f4d84a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:59.441466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181ac8b-5a71-474e-8d6f-c5c8f4d84a18 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:59.441753 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181ac8b-5a71-474e-8d6f-c5c8f4d84a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:59.442030 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7181ac8b-5a71-474e-8d6f-c5c8f4d84a18 None admin] PATH_INFO: `/v3/users/20db34ba53644b309ff728ff065a221c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:59.443269 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181ac8b-5a71-474e-8d6f-c5c8f4d84a18 None admin] RBAC: Authorizing `identity:get_user(user_id=20db34ba53644b309ff728ff065a221c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:59.444727 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7181ac8b-5a71-474e-8d6f-c5c8f4d84a18 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:59.446779 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 107/232] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:28:59 2022] GET /identity/v3/users/20db34ba53644b309ff728ff065a221c => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:59.452088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a9e47-3fa2-4ed6-97ea-7ce2d2113e3e None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:59.593055 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:59.603344 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a9e47-3fa2-4ed6-97ea-7ce2d2113e3e None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:59.656735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55b3e79-f592-4878-af82-f5e692c2395e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:59.657739 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b3e79-f592-4878-af82-f5e692c2395e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:59.658105 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b3e79-f592-4878-af82-f5e692c2395e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:59.658389 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55b3e79-f592-4878-af82-f5e692c2395e None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:59.665779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b3e79-f592-4878-af82-f5e692c2395e None admin] RBAC: Authorizing `identity:get_project(project_id=fe62d682160e40e48208c627043f6ee5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:59.667260 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55b3e79-f592-4878-af82-f5e692c2395e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:28:59.669538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 126/233] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:28:59 2022] GET /identity/v3/projects/fe62d682160e40e48208c627043f6ee5 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:28:59.675136 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181ac8b-5a71-474e-8d6f-c5c8f4d84a18 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:28:59.842153 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:28:59.853413 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7181ac8b-5a71-474e-8d6f-c5c8f4d84a18 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:28:59.905984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22de80cc-f383-4588-8df9-56d5b622843f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:28:59.907237 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de80cc-f383-4588-8df9-56d5b622843f None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:28:59.907990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de80cc-f383-4588-8df9-56d5b622843f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:28:59.908481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22de80cc-f383-4588-8df9-56d5b622843f None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5/users/20db34ba53644b309ff728ff065a221c/roles/e92acb6fd9834582bb4fd34409b37f94` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:28:59.911095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de80cc-f383-4588-8df9-56d5b622843f None admin] RBAC: Authorizing `identity:create_grant(project_id=fe62d682160e40e48208c627043f6ee5, user_id=20db34ba53644b309ff728ff065a221c, role_id=e92acb6fd9834582bb4fd34409b37f94)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:28:59.912753 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22de80cc-f383-4588-8df9-56d5b622843f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:00.042795 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 108/234] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:28:59 2022] PUT /identity/v3/projects/fe62d682160e40e48208c627043f6ee5/users/20db34ba53644b309ff728ff065a221c/roles/e92acb6fd9834582bb4fd34409b37f94 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:29:00.215771 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c836c8-8735-4274-aab2-b8eb3992e32e None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:00.216116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c836c8-8735-4274-aab2-b8eb3992e32e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:00.216352 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c836c8-8735-4274-aab2-b8eb3992e32e None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:00.218049 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 127/235] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:00.234909 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c3afc-69a5-4eb9-b987-bea58cff5118 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:00.235222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c3afc-69a5-4eb9-b987-bea58cff5118 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:00.236124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c3afc-69a5-4eb9-b987-bea58cff5118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:00.263283 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-204c3afc-69a5-4eb9-b987-bea58cff5118 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:00.264529 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-204c3afc-69a5-4eb9-b987-bea58cff5118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:00.347445 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca040ea-8557-4bb3-862d-b4ba8812c64d None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:00.347762 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca040ea-8557-4bb3-862d-b4ba8812c64d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:00.348017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca040ea-8557-4bb3-862d-b4ba8812c64d None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:00.349824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 128/236] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:00.350625 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 109/237] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:00.355390 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836361d-a1b6-47ec-9614-360df876c662 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:00.355683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836361d-a1b6-47ec-9614-360df876c662 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:00.355972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3836361d-a1b6-47ec-9614-360df876c662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:00.377677 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c3afc-69a5-4eb9-b987-bea58cff5118 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:00.378103 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-3836361d-a1b6-47ec-9614-360df876c662 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:00.379322 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3836361d-a1b6-47ec-9614-360df876c662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:00.468794 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 129/238] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:00.476169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:00.492490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c3afc-69a5-4eb9-b987-bea58cff5118 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:00.494249 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836361d-a1b6-47ec-9614-360df876c662 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:00.529645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0afed-53c8-457a-b059-5b1d20b12863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:00.530739 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0afed-53c8-457a-b059-5b1d20b12863 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:00.531030 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0afed-53c8-457a-b059-5b1d20b12863 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:00.531312 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0afed-53c8-457a-b059-5b1d20b12863 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:00.545320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c0afed-53c8-457a-b059-5b1d20b12863 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:00.555984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-65c0afed-53c8-457a-b059-5b1d20b12863 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:29:00.555984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:00.555984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:00.555984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:00.555984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:00.555984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:00.555984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:00.555984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:00.555984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:00.555984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:00.555984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:00.555984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:00.555984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:00.555984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:00.555984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:00.555984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:00.556928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:00.556928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:00.556928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:00.556928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:00.556928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:00.556928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:00.556928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:00.556928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:00.556928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:00.556928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:00.556928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:00.556928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:00.556928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:00.556928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:00.556928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:00.556928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:00.557803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:00.557803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:00.557803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:00.557803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:00.557803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:00.557803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:00.557803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:00.557803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:00.557803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:00.557803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:00.557803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:29:00.557803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:00.557803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 110/239] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:00.564990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0afed-53c8-457a-b059-5b1d20b12863 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:00.656559 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:00.676568 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3836361d-a1b6-47ec-9614-360df876c662 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:00.779486 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0afed-53c8-457a-b059-5b1d20b12863 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:00.823150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36890d-29ff-42ee-8d3a-5d841de3c722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:00.825443 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36890d-29ff-42ee-8d3a-5d841de3c722 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:00.826069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36890d-29ff-42ee-8d3a-5d841de3c722 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:00.826951 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa36890d-29ff-42ee-8d3a-5d841de3c722 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:00.829080 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36890d-29ff-42ee-8d3a-5d841de3c722 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:00.831487 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa36890d-29ff-42ee-8d3a-5d841de3c722 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:00.833786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 130/240] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:00.834559 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0033e-2e39-4d31-addd-380598be5131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:00.835463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0033e-2e39-4d31-addd-380598be5131 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:00.835902 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0033e-2e39-4d31-addd-380598be5131 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:00.836320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c0033e-2e39-4d31-addd-380598be5131 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:00.837244 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0033e-2e39-4d31-addd-380598be5131 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:00.837713 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0033e-2e39-4d31-addd-380598be5131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:00.839344 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c0033e-2e39-4d31-addd-380598be5131 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:00.840235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36890d-29ff-42ee-8d3a-5d841de3c722 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:00.856630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 111/241] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:29:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:00.866766 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0033e-2e39-4d31-addd-380598be5131 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:00.888186 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:01.036229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa36890d-29ff-42ee-8d3a-5d841de3c722 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:01.080814 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac83907-d25e-48e6-afa9-6f1810fe1aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:01.081544 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac83907-d25e-48e6-afa9-6f1810fe1aac None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:01.081829 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac83907-d25e-48e6-afa9-6f1810fe1aac None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:01.082106 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac83907-d25e-48e6-afa9-6f1810fe1aac None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:01.082831 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac83907-d25e-48e6-afa9-6f1810fe1aac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:01.084304 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac83907-d25e-48e6-afa9-6f1810fe1aac None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:01.087492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c0033e-2e39-4d31-addd-380598be5131 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:01.134770 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0470672-4adf-4519-b36a-6841dcd900a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:01.135668 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0470672-4adf-4519-b36a-6841dcd900a9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:01.136250 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0470672-4adf-4519-b36a-6841dcd900a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:01.136595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0470672-4adf-4519-b36a-6841dcd900a9 None admin] PATH_INFO: `/v3/users/cba14e0ec0bd424796a7c9bb447262c8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:01.152153 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0470672-4adf-4519-b36a-6841dcd900a9 None admin] RBAC: Authorizing `identity:get_user(user_id=cba14e0ec0bd424796a7c9bb447262c8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:01.153861 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0470672-4adf-4519-b36a-6841dcd900a9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:01.156046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 112/242] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:00 2022] GET /identity/v3/users/cba14e0ec0bd424796a7c9bb447262c8 => generated 297 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:01.161597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0470672-4adf-4519-b36a-6841dcd900a9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:01.190989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 131/243] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 16:29:00 2022] POST /identity/v3/users => generated 293 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:29:01.283178 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:01.316381 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0470672-4adf-4519-b36a-6841dcd900a9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:01.354563 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7518f0e-8e3d-4e13-a4e0-9fc818578506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:01.355294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7518f0e-8e3d-4e13-a4e0-9fc818578506 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:01.355561 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7518f0e-8e3d-4e13-a4e0-9fc818578506 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:01.355796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7518f0e-8e3d-4e13-a4e0-9fc818578506 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:01.430162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7518f0e-8e3d-4e13-a4e0-9fc818578506 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:01.431673 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7518f0e-8e3d-4e13-a4e0-9fc818578506 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:01.506415 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:01.538906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 113/244] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 16:29:01.544542 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac83907-d25e-48e6-afa9-6f1810fe1aac None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:01.565836 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:01.661278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac83907-d25e-48e6-afa9-6f1810fe1aac None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:01.684822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07868d47-1737-4756-87e9-fd0259f89418 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:01.685187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07868d47-1737-4756-87e9-fd0259f89418 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:01.685442 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07868d47-1737-4756-87e9-fd0259f89418 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:01.687117 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 114/245] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:29:01.692552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2385548-3438-4330-b005-0a4b8fcb3850 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:01.692875 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2385548-3438-4330-b005-0a4b8fcb3850 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:01.693265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2385548-3438-4330-b005-0a4b8fcb3850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:01.705639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2cc26-ed73-4e0b-b83e-2979b2410b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:01.706850 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2cc26-ed73-4e0b-b83e-2979b2410b2d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:01.707332 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2cc26-ed73-4e0b-b83e-2979b2410b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:01.707845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2cc26-ed73-4e0b-b83e-2979b2410b2d None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:01.709349 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2cc26-ed73-4e0b-b83e-2979b2410b2d None admin] RBAC: Authorizing `identity:get_project(project_id=fe62d682160e40e48208c627043f6ee5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:01.711007 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2cc26-ed73-4e0b-b83e-2979b2410b2d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:01.712935 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 132/246] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:01 2022] GET /identity/v3/projects/fe62d682160e40e48208c627043f6ee5 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:01.714493 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7724085-c835-4415-a709-d5a0d555e2f7 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:01.715020 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7724085-c835-4415-a709-d5a0d555e2f7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:01.715494 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7724085-c835-4415-a709-d5a0d555e2f7 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:01.716216 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e2385548-3438-4330-b005-0a4b8fcb3850 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:01.717429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 133/247] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:01.718660 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7724085-c835-4415-a709-d5a0d555e2f7 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:01.721318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e2385548-3438-4330-b005-0a4b8fcb3850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:01.826270 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 115/248] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:29:01.827980 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9832488-f3c4-4ccc-98b8-6e7624c82ff4 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:01.828271 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9832488-f3c4-4ccc-98b8-6e7624c82ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:01.828547 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9832488-f3c4-4ccc-98b8-6e7624c82ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:01.837284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:01.851979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c9832488-f3c4-4ccc-98b8-6e7624c82ff4 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:01.853231 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c9832488-f3c4-4ccc-98b8-6e7624c82ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:01.864005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7724085-c835-4415-a709-d5a0d555e2f7 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:01.915805 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc0a12-b5ff-4caa-9b73-35a622d524df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:01.917294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc0a12-b5ff-4caa-9b73-35a622d524df None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:01.917756 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc0a12-b5ff-4caa-9b73-35a622d524df None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:01.918624 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efc0a12-b5ff-4caa-9b73-35a622d524df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:01.919925 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc0a12-b5ff-4caa-9b73-35a622d524df None admin] RBAC: Adding query filter params (role.id=2b96b81e91b549b8b94f331c2772c9de, scope.project.id=fe62d682160e40e48208c627043f6ee5, user.id=cba14e0ec0bd424796a7c9bb447262c8) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:01.920414 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc0a12-b5ff-4caa-9b73-35a622d524df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:01.922826 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efc0a12-b5ff-4caa-9b73-35a622d524df None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:01.931741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 134/249] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:01 2022] GET /identity/v3/role_assignments?user.id=cba14e0ec0bd424796a7c9bb447262c8&scope.project.id=fe62d682160e40e48208c627043f6ee5&role.id=2b96b81e91b549b8b94f331c2772c9de => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:01.937539 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc0a12-b5ff-4caa-9b73-35a622d524df None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:01.965473 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 116/250] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:02.006747 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9832488-f3c4-4ccc-98b8-6e7624c82ff4 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:02.056811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:02.102900 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efc0a12-b5ff-4caa-9b73-35a622d524df None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:02.147517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38322b-c892-4c77-a44e-c38a722b8964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:02.148632 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38322b-c892-4c77-a44e-c38a722b8964 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:02.149123 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38322b-c892-4c77-a44e-c38a722b8964 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:02.149575 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b38322b-c892-4c77-a44e-c38a722b8964 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:02.163113 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b38322b-c892-4c77-a44e-c38a722b8964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:02.172646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-5b38322b-c892-4c77-a44e-c38a722b8964 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:02.172646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:02.172646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:02.172646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:02.172646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:02.172646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:02.172646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:02.172646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:02.172646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:02.172646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:02.172646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:02.172646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:02.172646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:02.172646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:02.172646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:02.172646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:02.174894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:02.174894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:02.174894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:02.174894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:02.174894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:02.174894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:02.174894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:02.174894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:02.174894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:02.174894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:02.174894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:02.174894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:02.174894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:02.174894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:02.174894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:02.174894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:02.176192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:02.176192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:02.176192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:02.176192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:02.176192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:02.176192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:02.176192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:02.176192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:02.176192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:02.176192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:02.176192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:02.176192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:02.178688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 135/251] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:29:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:02.186584 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38322b-c892-4c77-a44e-c38a722b8964 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:02.203637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:02.244093 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9832488-f3c4-4ccc-98b8-6e7624c82ff4 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:02.315507 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60210fc-585c-4d03-bfe9-7915f5c9667c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:02.316329 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60210fc-585c-4d03-bfe9-7915f5c9667c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:02.316613 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60210fc-585c-4d03-bfe9-7915f5c9667c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:02.316887 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60210fc-585c-4d03-bfe9-7915f5c9667c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:02.339311 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60210fc-585c-4d03-bfe9-7915f5c9667c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:02.348212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-e60210fc-585c-4d03-bfe9-7915f5c9667c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:29:02.348212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:02.348212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:02.348212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:02.348212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:02.348212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:02.348212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:02.348212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:02.348212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:02.348212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:02.348212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:02.348212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:02.348212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:02.348212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:02.348212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:02.348212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:02.349204 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:02.349204 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:02.349204 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:02.349204 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:02.349204 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:02.349204 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:02.349204 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:02.349204 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:02.349204 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:02.349204 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:02.349204 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:02.349204 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:02.349204 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:02.349204 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:02.349204 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:02.349204 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:02.350004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:02.350004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:02.350004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:02.350004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:02.350004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:02.350004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:02.350004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:02.350004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:02.350004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:02.350004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:02.350004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:29:02.350004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:02.363104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 117/252] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:02.368351 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60210fc-585c-4d03-bfe9-7915f5c9667c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:02.402337 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b38322b-c892-4c77-a44e-c38a722b8964 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:02.477124 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a539e4c-589e-44e3-b121-fd93f9514ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:02.477124 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a539e4c-589e-44e3-b121-fd93f9514ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:02.477124 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a539e4c-589e-44e3-b121-fd93f9514ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:02.477124 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a539e4c-589e-44e3-b121-fd93f9514ca3 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:02.477510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a539e4c-589e-44e3-b121-fd93f9514ca3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:02.477510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a539e4c-589e-44e3-b121-fd93f9514ca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:02.477827 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a539e4c-589e-44e3-b121-fd93f9514ca3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:02.503794 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 136/253] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:02.519369 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a539e4c-589e-44e3-b121-fd93f9514ca3 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:02.534828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:02.558625 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60210fc-585c-4d03-bfe9-7915f5c9667c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:02.637826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de9f94-437d-4775-96b2-c329ed232ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:02.638532 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de9f94-437d-4775-96b2-c329ed232ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:02.638825 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de9f94-437d-4775-96b2-c329ed232ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:02.639108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de9f94-437d-4775-96b2-c329ed232ee1 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:02.639890 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de9f94-437d-4775-96b2-c329ed232ee1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:02.640305 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de9f94-437d-4775-96b2-c329ed232ee1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:02.642353 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11de9f94-437d-4775-96b2-c329ed232ee1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:02.660236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 118/254] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:29:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:02.669036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de9f94-437d-4775-96b2-c329ed232ee1 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:02.688154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:02.789919 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a539e4c-589e-44e3-b121-fd93f9514ca3 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:02.819610 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79efac-68fa-4896-a25d-eece333b31eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:02.820712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79efac-68fa-4896-a25d-eece333b31eb None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:02.820998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79efac-68fa-4896-a25d-eece333b31eb None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:02.821300 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79efac-68fa-4896-a25d-eece333b31eb None admin] PATH_INFO: `/v3/users/20db34ba53644b309ff728ff065a221c` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:02.823101 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79efac-68fa-4896-a25d-eece333b31eb None admin] RBAC: Authorizing `identity:get_user(user_id=20db34ba53644b309ff728ff065a221c)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:02.824592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79efac-68fa-4896-a25d-eece333b31eb None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:02.826459 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 137/255] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:02 2022] GET /identity/v3/users/20db34ba53644b309ff728ff065a221c => generated 283 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:02.827913 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908247eb-5ab3-4ea0-957f-7513639a2a18 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:02.828200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908247eb-5ab3-4ea0-957f-7513639a2a18 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:02.828477 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908247eb-5ab3-4ea0-957f-7513639a2a18 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:02.830934 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 138/256] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:02.836994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908247eb-5ab3-4ea0-957f-7513639a2a18 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:02.916832 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de9f94-437d-4775-96b2-c329ed232ee1 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:02.978935 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d2140-f4f6-4a49-b50b-21c18ab610d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:02.980197 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d2140-f4f6-4a49-b50b-21c18ab610d5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:02.980686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d2140-f4f6-4a49-b50b-21c18ab610d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:02.981201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d2140-f4f6-4a49-b50b-21c18ab610d5 None admin] PATH_INFO: `/v3/users/805a8d3b9b1b4ac9999ee4778e7d048e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:02.983707 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d2140-f4f6-4a49-b50b-21c18ab610d5 None admin] RBAC: Authorizing `identity:get_user(user_id=805a8d3b9b1b4ac9999ee4778e7d048e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:02.986078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d2140-f4f6-4a49-b50b-21c18ab610d5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:02.990112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908247eb-5ab3-4ea0-957f-7513639a2a18 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:02.992900 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 119/257] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:02 2022] GET /identity/v3/users/805a8d3b9b1b4ac9999ee4778e7d048e => generated 297 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:02.994683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3aaec-43db-485a-92b1-e55c05bd2b88 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:02.999580 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3aaec-43db-485a-92b1-e55c05bd2b88 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:03.000088 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3aaec-43db-485a-92b1-e55c05bd2b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:03.028923 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e7f3aaec-43db-485a-92b1-e55c05bd2b88 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:03.031407 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e7f3aaec-43db-485a-92b1-e55c05bd2b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:03.056311 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad827e-1cab-41cd-bf31-cc5f9e4201c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:03.057391 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad827e-1cab-41cd-bf31-cc5f9e4201c5 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:03.057511 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:03.057997 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad827e-1cab-41cd-bf31-cc5f9e4201c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:03.058487 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad827e-1cab-41cd-bf31-cc5f9e4201c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:03.072845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:03.168223 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 120/258] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:03.171439 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3aaec-43db-485a-92b1-e55c05bd2b88 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:03.180029 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad827e-1cab-41cd-bf31-cc5f9e4201c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:03.185998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad827e-1cab-41cd-bf31-cc5f9e4201c5 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:03.307202 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3aaec-43db-485a-92b1-e55c05bd2b88 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:03.347730 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58b6ff-873d-41bb-9590-df26af0d2679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:03.349094 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58b6ff-873d-41bb-9590-df26af0d2679 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:03.349774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58b6ff-873d-41bb-9590-df26af0d2679 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:03.350240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58b6ff-873d-41bb-9590-df26af0d2679 None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:03.352211 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58b6ff-873d-41bb-9590-df26af0d2679 None admin] RBAC: Authorizing `identity:get_project(project_id=fe62d682160e40e48208c627043f6ee5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:03.354178 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58b6ff-873d-41bb-9590-df26af0d2679 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:03.356342 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 121/259] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:03 2022] GET /identity/v3/projects/fe62d682160e40e48208c627043f6ee5 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:03.357340 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58b6ff-873d-41bb-9590-df26af0d2679 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:03.383228 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:03.401632 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 139/260] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:29:03.402566 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad827e-1cab-41cd-bf31-cc5f9e4201c5 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:03.462226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:03.488425 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58b6ff-873d-41bb-9590-df26af0d2679 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:03.531380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2c199-4d58-406d-9e85-2ef5381e9042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:03.532794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2c199-4d58-406d-9e85-2ef5381e9042 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:03.533121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2c199-4d58-406d-9e85-2ef5381e9042 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:03.533405 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2c199-4d58-406d-9e85-2ef5381e9042 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:03.545382 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a2c199-4d58-406d-9e85-2ef5381e9042 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:03.555464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-90a2c199-4d58-406d-9e85-2ef5381e9042 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:29:03.555464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:03.555464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:03.555464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:03.555464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:03.555464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:03.555464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:03.555464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:03.555464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:03.555464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:03.555464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:03.555464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:03.555464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:03.555464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:03.555464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:03.555464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:03.556575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:03.556575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:03.556575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:03.556575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:03.556575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:03.556575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:03.556575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:03.556575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:03.556575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:03.556575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:03.556575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:03.556575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:03.556575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:03.556575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:03.556575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:03.556575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:03.557481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:03.557481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:03.557481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:03.557481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:03.557481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:03.557481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:03.557481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:03.557481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:03.557481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:03.557481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:03.557481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:29:03.557481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:03.557481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 122/261] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 16:29:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:03.561657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2c199-4d58-406d-9e85-2ef5381e9042 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:03.565509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad827e-1cab-41cd-bf31-cc5f9e4201c5 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:03.643874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f07668-08bc-4adf-ad4e-610b97995415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:03.644789 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f07668-08bc-4adf-ad4e-610b97995415 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:03.645101 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f07668-08bc-4adf-ad4e-610b97995415 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:03.645383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f07668-08bc-4adf-ad4e-610b97995415 None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5/users/805a8d3b9b1b4ac9999ee4778e7d048e/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:03.649846 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f07668-08bc-4adf-ad4e-610b97995415 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe62d682160e40e48208c627043f6ee5, user_id=805a8d3b9b1b4ac9999ee4778e7d048e, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:03.651307 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f07668-08bc-4adf-ad4e-610b97995415 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:03.665365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:03.692471 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2c199-4d58-406d-9e85-2ef5381e9042 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:03.728357 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a4bd5-2c31-4190-8491-ff44569aef41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:03.729556 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a4bd5-2c31-4190-8491-ff44569aef41 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:03.730001 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a4bd5-2c31-4190-8491-ff44569aef41 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:03.730432 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a4bd5-2c31-4190-8491-ff44569aef41 None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:03.731834 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a4bd5-2c31-4190-8491-ff44569aef41 None admin] RBAC: Authorizing `identity:get_project(project_id=fe62d682160e40e48208c627043f6ee5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:03.733533 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391a4bd5-2c31-4190-8491-ff44569aef41 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:03.735569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 123/262] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:03 2022] GET /identity/v3/projects/fe62d682160e40e48208c627043f6ee5 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:03.736489 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a4bd5-2c31-4190-8491-ff44569aef41 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:03.762686 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 140/263] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:29:03 2022] PUT /identity/v3/projects/fe62d682160e40e48208c627043f6ee5/users/805a8d3b9b1b4ac9999ee4778e7d048e/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:29:03.768327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f07668-08bc-4adf-ad4e-610b97995415 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:03.897873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a4bd5-2c31-4190-8491-ff44569aef41 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:03.951529 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4d0fb-0967-4778-a92e-13f566db1a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:03.952592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4d0fb-0967-4778-a92e-13f566db1a68 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:03.954752 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4d0fb-0967-4778-a92e-13f566db1a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:03.956076 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4d0fb-0967-4778-a92e-13f566db1a68 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:03.957230 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4d0fb-0967-4778-a92e-13f566db1a68 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:03.959065 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4d0fb-0967-4778-a92e-13f566db1a68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:03.961063 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4d0fb-0967-4778-a92e-13f566db1a68 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:03.980290 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 124/264] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:03.988370 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:03.989982 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4d0fb-0967-4778-a92e-13f566db1a68 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:04.010234 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f07668-08bc-4adf-ad4e-610b97995415 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:04.012729 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:04.091592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da8e75-b78b-4911-9749-1fa3c5825bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:04.092284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da8e75-b78b-4911-9749-1fa3c5825bfe None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:04.092578 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da8e75-b78b-4911-9749-1fa3c5825bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:04.092859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da8e75-b78b-4911-9749-1fa3c5825bfe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:04.093745 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da8e75-b78b-4911-9749-1fa3c5825bfe None admin] RBAC: Adding query filter params (role.id=c2d5d80485df4730903a874937d68aa3, scope.project.id=fe62d682160e40e48208c627043f6ee5, user.id=20db34ba53644b309ff728ff065a221c) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:04.094058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da8e75-b78b-4911-9749-1fa3c5825bfe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:04.095757 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da8e75-b78b-4911-9749-1fa3c5825bfe None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:04.107352 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 141/265] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:03 2022] GET /identity/v3/role_assignments?user.id=20db34ba53644b309ff728ff065a221c&scope.project.id=fe62d682160e40e48208c627043f6ee5&role.id=c2d5d80485df4730903a874937d68aa3 => generated 608 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:04.155259 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4d0fb-0967-4778-a92e-13f566db1a68 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:04.200718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c11b0-7fd5-4ebe-bba9-536a90451909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:04.201656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c11b0-7fd5-4ebe-bba9-536a90451909 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:04.201949 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c11b0-7fd5-4ebe-bba9-536a90451909 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:04.202233 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c11b0-7fd5-4ebe-bba9-536a90451909 None admin] PATH_INFO: `/v3/users/20db34ba53644b309ff728ff065a221c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:04.203463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c11b0-7fd5-4ebe-bba9-536a90451909 None admin] RBAC: Authorizing `identity:get_user(user_id=20db34ba53644b309ff728ff065a221c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:04.206008 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c11b0-7fd5-4ebe-bba9-536a90451909 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:04.208733 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 125/266] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:03 2022] GET /identity/v3/users/20db34ba53644b309ff728ff065a221c => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:04.213725 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da8e75-b78b-4911-9749-1fa3c5825bfe None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:04.276988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412b3f4-f991-4f73-a404-1a3469f4502f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:04.277341 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412b3f4-f991-4f73-a404-1a3469f4502f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:04.277587 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9412b3f4-f991-4f73-a404-1a3469f4502f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:04.279143 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 126/267] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:29:04.285241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe0f89-f0e1-454c-a897-78af31916df0 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:04.285935 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe0f89-f0e1-454c-a897-78af31916df0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:04.286221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe0f89-f0e1-454c-a897-78af31916df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:04.314706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-7dfe0f89-f0e1-454c-a897-78af31916df0 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:04.316204 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7dfe0f89-f0e1-454c-a897-78af31916df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:04.392153 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da8e75-b78b-4911-9749-1fa3c5825bfe None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:04.420040 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 127/268] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:04.440587 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66a1c9-8574-4904-bfec-10bcac41c70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:04.441387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66a1c9-8574-4904-bfec-10bcac41c70b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:04.441759 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66a1c9-8574-4904-bfec-10bcac41c70b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:04.442042 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66a1c9-8574-4904-bfec-10bcac41c70b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:04.465561 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe0f89-f0e1-454c-a897-78af31916df0 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:04.467702 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:04.475594 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:04.520887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66a1c9-8574-4904-bfec-10bcac41c70b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:04.523277 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d66a1c9-8574-4904-bfec-10bcac41c70b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:04.629989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe0f89-f0e1-454c-a897-78af31916df0 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:04.644048 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 142/269] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:29:04.649033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439522b2-7493-41fd-bcb1-053bb7d28068 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:04.649033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439522b2-7493-41fd-bcb1-053bb7d28068 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:04.649033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439522b2-7493-41fd-bcb1-053bb7d28068 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:04.649033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 143/270] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:04.655906 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439522b2-7493-41fd-bcb1-053bb7d28068 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:04.680721 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58650bf-5287-41de-a236-27744ed0b310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:04.681968 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58650bf-5287-41de-a236-27744ed0b310 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:04.682663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58650bf-5287-41de-a236-27744ed0b310 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:04.683161 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58650bf-5287-41de-a236-27744ed0b310 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:04.684748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58650bf-5287-41de-a236-27744ed0b310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:04.686537 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58650bf-5287-41de-a236-27744ed0b310 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:04.688710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 128/271] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:04.690329 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622731e-0bf7-4b49-a3a0-833a9ea51ac5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:04.690942 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622731e-0bf7-4b49-a3a0-833a9ea51ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:04.691414 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622731e-0bf7-4b49-a3a0-833a9ea51ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:04.710716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6622731e-0bf7-4b49-a3a0-833a9ea51ac5 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:04.712291 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6622731e-0bf7-4b49-a3a0-833a9ea51ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:04.726270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:04.773836 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439522b2-7493-41fd-bcb1-053bb7d28068 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:04.786175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:04.792246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 129/272] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:04.801226 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622731e-0bf7-4b49-a3a0-833a9ea51ac5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:04.812973 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a142c-5fd5-46c8-ba31-e30a66adc1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:04.814711 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a142c-5fd5-46c8-ba31-e30a66adc1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:04.815165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a142c-5fd5-46c8-ba31-e30a66adc1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:04.815598 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a142c-5fd5-46c8-ba31-e30a66adc1f1 None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:04.817047 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a142c-5fd5-46c8-ba31-e30a66adc1f1 None admin] RBAC: Authorizing `identity:get_project(project_id=fe62d682160e40e48208c627043f6ee5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:04.818827 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a142c-5fd5-46c8-ba31-e30a66adc1f1 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:04.820812 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 144/273] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:04 2022] GET /identity/v3/projects/fe62d682160e40e48208c627043f6ee5 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:04.829973 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a142c-5fd5-46c8-ba31-e30a66adc1f1 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:04.931485 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6622731e-0bf7-4b49-a3a0-833a9ea51ac5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:04.939699 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a142c-5fd5-46c8-ba31-e30a66adc1f1 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:04.968781 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:04.970192 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5edf99c-6076-4d8b-ad22-69f3ee67ff87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:04.970681 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edf99c-6076-4d8b-ad22-69f3ee67ff87 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:04.970972 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edf99c-6076-4d8b-ad22-69f3ee67ff87 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:04.971251 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5edf99c-6076-4d8b-ad22-69f3ee67ff87 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:04.972132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edf99c-6076-4d8b-ad22-69f3ee67ff87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:04.973785 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5edf99c-6076-4d8b-ad22-69f3ee67ff87 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:04.976781 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3ef4a-d875-44c5-ad55-06c9e8f3faba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:04.977471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3ef4a-d875-44c5-ad55-06c9e8f3faba None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:04.977756 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3ef4a-d875-44c5-ad55-06c9e8f3faba None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:04.978135 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d3ef4a-d875-44c5-ad55-06c9e8f3faba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:04.978866 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3ef4a-d875-44c5-ad55-06c9e8f3faba None admin] RBAC: Adding query filter params (role.id=e92acb6fd9834582bb4fd34409b37f94, scope.project.id=fe62d682160e40e48208c627043f6ee5, user.id=20db34ba53644b309ff728ff065a221c) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:04.979204 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3ef4a-d875-44c5-ad55-06c9e8f3faba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:04.980640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d3ef4a-d875-44c5-ad55-06c9e8f3faba None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:04.986875 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 145/274] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:04 2022] GET /identity/v3/role_assignments?user.id=20db34ba53644b309ff728ff065a221c&scope.project.id=fe62d682160e40e48208c627043f6ee5&role.id=e92acb6fd9834582bb4fd34409b37f94 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:04.993287 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3ef4a-d875-44c5-ad55-06c9e8f3faba None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:05.105501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 130/275] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 16:29:04 2022] POST /identity/v3/users => generated 293 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:29:05.107659 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55529fcb-66a8-41ab-a6bf-a6f42177d3d2 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:05.108188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55529fcb-66a8-41ab-a6bf-a6f42177d3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:05.113045 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55529fcb-66a8-41ab-a6bf-a6f42177d3d2 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:05.115520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 131/276] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:05.120135 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d3ef4a-d875-44c5-ad55-06c9e8f3faba None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:05.122121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0785b-7773-4edc-86fb-760aaa1aa530 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:05.122985 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0785b-7773-4edc-86fb-760aaa1aa530 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:05.123478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0785b-7773-4edc-86fb-760aaa1aa530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:05.163983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-fbb0785b-7773-4edc-86fb-760aaa1aa530 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:05.165759 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fbb0785b-7773-4edc-86fb-760aaa1aa530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:05.185158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4fee0-3895-4c1d-974f-6e725a85863c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:05.185158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4fee0-3895-4c1d-974f-6e725a85863c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:05.185158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4fee0-3895-4c1d-974f-6e725a85863c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:05.185158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4fee0-3895-4c1d-974f-6e725a85863c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:05.204944 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df4fee0-3895-4c1d-974f-6e725a85863c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:05.215564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-0df4fee0-3895-4c1d-974f-6e725a85863c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:29:05.215564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:05.215564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:05.215564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:05.215564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:05.215564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:05.215564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:05.215564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:05.215564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:05.215564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:05.215564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:05.215564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:05.215564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:05.215564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:05.215564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:05.215564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:05.216647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:05.216647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:05.216647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:05.216647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:05.216647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:05.216647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:05.216647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:05.216647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:05.216647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:05.216647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:05.216647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:05.216647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:05.216647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:05.216647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:05.216647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:05.216647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:05.217645 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:05.217645 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:05.217645 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:05.217645 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:05.217645 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:05.217645 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:05.217645 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:05.217645 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:05.217645 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:05.217645 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:05.217645 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:29:05.217645 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:05.217645 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 146/277] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:05.223956 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4fee0-3895-4c1d-974f-6e725a85863c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:05.238994 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:05.260220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 132/278] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:05.284599 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0785b-7773-4edc-86fb-760aaa1aa530 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:05.306340 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:05.366023 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4fee0-3895-4c1d-974f-6e725a85863c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:05.417926 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d4168-626f-42e2-b60c-e267392ccf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:05.418638 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d4168-626f-42e2-b60c-e267392ccf29 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:05.418928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d4168-626f-42e2-b60c-e267392ccf29 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:05.419205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d4168-626f-42e2-b60c-e267392ccf29 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:05.420681 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d4168-626f-42e2-b60c-e267392ccf29 None admin] RBAC: Adding query filter params (name=member) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:05.420681 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d4168-626f-42e2-b60c-e267392ccf29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:05.421699 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d4168-626f-42e2-b60c-e267392ccf29 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:05.428519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0785b-7773-4edc-86fb-760aaa1aa530 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:05.433049 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 147/279] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:29:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:05.439522 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d4168-626f-42e2-b60c-e267392ccf29 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:05.474230 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728a458-46bb-433d-b29d-e29231885710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:05.475647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728a458-46bb-433d-b29d-e29231885710 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:05.476091 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728a458-46bb-433d-b29d-e29231885710 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:05.476669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5728a458-46bb-433d-b29d-e29231885710 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:05.495273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5728a458-46bb-433d-b29d-e29231885710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:05.505820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-5728a458-46bb-433d-b29d-e29231885710 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:29:05.505820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:05.505820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:05.505820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:05.505820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:05.505820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:05.505820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:05.505820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:05.505820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:05.505820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:05.505820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:05.505820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:05.505820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:05.505820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:05.505820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:05.505820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:05.506930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:05.506930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:05.506930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:05.506930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:05.506930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:05.506930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:05.506930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:05.506930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:05.506930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:05.506930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:05.506930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:05.506930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:05.506930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:05.506930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:05.506930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:05.506930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:05.507926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:05.507926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:05.507926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:05.507926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:05.507926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:05.507926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:05.507926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:05.507926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:05.507926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:05.507926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:05.507926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:29:05.507926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:05.510938 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 133/280] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:05.516114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728a458-46bb-433d-b29d-e29231885710 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:05.580929 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d4168-626f-42e2-b60c-e267392ccf29 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:05.586344 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:05.599379 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:05.623338 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea262008-97ef-4f14-b0f4-d74d72106659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:05.624183 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea262008-97ef-4f14-b0f4-d74d72106659 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:05.624467 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea262008-97ef-4f14-b0f4-d74d72106659 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:05.624900 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea262008-97ef-4f14-b0f4-d74d72106659 None admin] PATH_INFO: `/v3/users/e4bb45be9b30420ca37b57274e6b86fb` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:05.641466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea262008-97ef-4f14-b0f4-d74d72106659 None admin] RBAC: Authorizing `identity:get_user(user_id=e4bb45be9b30420ca37b57274e6b86fb)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:05.643184 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea262008-97ef-4f14-b0f4-d74d72106659 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:05.645430 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 148/281] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:05 2022] GET /identity/v3/users/e4bb45be9b30420ca37b57274e6b86fb => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:05.650937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea262008-97ef-4f14-b0f4-d74d72106659 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:05.670434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5728a458-46bb-433d-b29d-e29231885710 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:05.726030 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a354275-4c7c-40cd-bf86-5af1f5f9b720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:05.726645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a354275-4c7c-40cd-bf86-5af1f5f9b720 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:05.726930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a354275-4c7c-40cd-bf86-5af1f5f9b720 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:05.727210 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a354275-4c7c-40cd-bf86-5af1f5f9b720 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:05.727977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a354275-4c7c-40cd-bf86-5af1f5f9b720 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:05.728286 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a354275-4c7c-40cd-bf86-5af1f5f9b720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:05.729724 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a354275-4c7c-40cd-bf86-5af1f5f9b720 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:05.757054 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 134/282] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:29:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:05.758924 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a354275-4c7c-40cd-bf86-5af1f5f9b720 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:05.857238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea262008-97ef-4f14-b0f4-d74d72106659 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:05.909640 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a354275-4c7c-40cd-bf86-5af1f5f9b720 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:05.920455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:05.947665 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705baba-da4a-4d79-98ec-6f408117610c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:05.948344 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705baba-da4a-4d79-98ec-6f408117610c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:05.948627 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705baba-da4a-4d79-98ec-6f408117610c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:05.948904 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705baba-da4a-4d79-98ec-6f408117610c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:05.949785 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705baba-da4a-4d79-98ec-6f408117610c None admin] RBAC: Adding query filter params (role.id=38ab22e38dfd483dbd2f224b3088f16e, user.id=e4bb45be9b30420ca37b57274e6b86fb, scope.system=all) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:05.950099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705baba-da4a-4d79-98ec-6f408117610c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:05.951624 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4705baba-da4a-4d79-98ec-6f408117610c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:05.956975 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa88131-2012-4b5e-9612-37db762935ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:05.957893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa88131-2012-4b5e-9612-37db762935ec None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:05.958177 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa88131-2012-4b5e-9612-37db762935ec None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:05.958451 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa88131-2012-4b5e-9612-37db762935ec None admin] PATH_INFO: `/v3/users/cba14e0ec0bd424796a7c9bb447262c8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:05.960255 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa88131-2012-4b5e-9612-37db762935ec None admin] RBAC: Authorizing `identity:get_user(user_id=cba14e0ec0bd424796a7c9bb447262c8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:05.961761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa88131-2012-4b5e-9612-37db762935ec None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:05.964694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 135/283] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:05 2022] GET /identity/v3/users/cba14e0ec0bd424796a7c9bb447262c8 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:05.971664 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 149/284] 10.222.0.76 () {56 vars in 1308 bytes} [Mon Jul 18 16:29:05 2022] GET /identity/v3/role_assignments?user.id=e4bb45be9b30420ca37b57274e6b86fb&scope.system=all&role.id=38ab22e38dfd483dbd2f224b3088f16e => generated 226 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:05.972468 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa88131-2012-4b5e-9612-37db762935ec None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:06.089838 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa88131-2012-4b5e-9612-37db762935ec None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:06.130763 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0856a1-e317-4978-ae19-66e528712657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:06.131668 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0856a1-e317-4978-ae19-66e528712657 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:06.131962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0856a1-e317-4978-ae19-66e528712657 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:06.132243 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0856a1-e317-4978-ae19-66e528712657 None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:06.133576 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0856a1-e317-4978-ae19-66e528712657 None admin] RBAC: Authorizing `identity:get_project(project_id=fe62d682160e40e48208c627043f6ee5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:06.135103 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0856a1-e317-4978-ae19-66e528712657 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:06.137253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 136/285] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:05 2022] GET /identity/v3/projects/fe62d682160e40e48208c627043f6ee5 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:06.144151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705baba-da4a-4d79-98ec-6f408117610c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:06.214936 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:06.288948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705baba-da4a-4d79-98ec-6f408117610c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:06.343193 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f7f4c-6a3e-4847-b542-8d43b2330bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:06.345049 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f7f4c-6a3e-4847-b542-8d43b2330bd2 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:06.345555 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f7f4c-6a3e-4847-b542-8d43b2330bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:06.346031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f7f4c-6a3e-4847-b542-8d43b2330bd2 None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5/users/cba14e0ec0bd424796a7c9bb447262c8/roles/2b96b81e91b549b8b94f331c2772c9de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:06.354409 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f7f4c-6a3e-4847-b542-8d43b2330bd2 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe62d682160e40e48208c627043f6ee5, user_id=cba14e0ec0bd424796a7c9bb447262c8, role_id=2b96b81e91b549b8b94f331c2772c9de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:06.356253 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f7f4c-6a3e-4847-b542-8d43b2330bd2 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:06.436455 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 150/286] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:29:06 2022] PUT /identity/v3/projects/fe62d682160e40e48208c627043f6ee5/users/cba14e0ec0bd424796a7c9bb447262c8/roles/2b96b81e91b549b8b94f331c2772c9de => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:29:06.482788 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948fd64-fdbc-444a-b8b6-6f7a1151e8b6 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:06.483793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948fd64-fdbc-444a-b8b6-6f7a1151e8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:06.484279 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948fd64-fdbc-444a-b8b6-6f7a1151e8b6 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:06.486690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 137/287] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:06.492795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a9116-50a4-4753-93a4-65fc861ef7f1 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:06.493467 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a9116-50a4-4753-93a4-65fc861ef7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:06.493962 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a9116-50a4-4753-93a4-65fc861ef7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:06.513404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d88a9116-50a4-4753-93a4-65fc861ef7f1 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:06.514982 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d88a9116-50a4-4753-93a4-65fc861ef7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:06.592915 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 151/288] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:29:06.618284 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948fd64-fdbc-444a-b8b6-6f7a1151e8b6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:06.674696 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:06.738037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948fd64-fdbc-444a-b8b6-6f7a1151e8b6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:06.777446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6aa4c-8007-4fbf-9a99-91f2f7fcf641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:06.778655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6aa4c-8007-4fbf-9a99-91f2f7fcf641 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:06.779186 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6aa4c-8007-4fbf-9a99-91f2f7fcf641 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:06.779669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6aa4c-8007-4fbf-9a99-91f2f7fcf641 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:06.793625 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec6aa4c-8007-4fbf-9a99-91f2f7fcf641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:06.802940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-2ec6aa4c-8007-4fbf-9a99-91f2f7fcf641 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:29:06.802940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:06.802940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:06.802940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:06.802940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:06.802940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:06.802940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:06.802940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:06.802940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:06.802940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:06.802940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:06.802940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:06.802940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:06.802940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:06.802940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:06.802940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:06.803912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:06.803912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:06.803912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:06.803912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:06.803912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:06.803912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:06.803912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:06.803912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:06.803912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:06.803912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:06.803912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:06.803912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:06.803912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:06.803912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:06.803912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:06.803912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:06.804705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:06.804705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:06.804705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:06.804705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:06.804705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:06.804705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:06.804705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:06.804705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:06.804705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:06.804705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:06.804705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:29:06.804705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:06.807746 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 138/289] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:06.814507 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a9116-50a4-4753-93a4-65fc861ef7f1 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:06.873492 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:06.920217 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a9116-50a4-4753-93a4-65fc861ef7f1 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:06.964561 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e91550-5809-4a4f-a630-61a047e7d930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:06.965666 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e91550-5809-4a4f-a630-61a047e7d930 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:06.966159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e91550-5809-4a4f-a630-61a047e7d930 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:06.966690 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e91550-5809-4a4f-a630-61a047e7d930 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:06.967676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e91550-5809-4a4f-a630-61a047e7d930 None admin] RBAC: Adding query filter params (name=member) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:06.968201 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e91550-5809-4a4f-a630-61a047e7d930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:06.970464 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e91550-5809-4a4f-a630-61a047e7d930 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:06.986049 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 152/290] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:29:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:06.992125 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6aa4c-8007-4fbf-9a99-91f2f7fcf641 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:07.104413 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6aa4c-8007-4fbf-9a99-91f2f7fcf641 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:07.107186 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:07.142190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172941e3-c1f9-4889-a919-01f34ba605dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:07.143436 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172941e3-c1f9-4889-a919-01f34ba605dd None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:07.143940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172941e3-c1f9-4889-a919-01f34ba605dd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:07.144408 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172941e3-c1f9-4889-a919-01f34ba605dd None admin] PATH_INFO: `/v3/users/805a8d3b9b1b4ac9999ee4778e7d048e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:07.151047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172941e3-c1f9-4889-a919-01f34ba605dd None admin] RBAC: Authorizing `identity:get_user(user_id=805a8d3b9b1b4ac9999ee4778e7d048e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:07.152749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172941e3-c1f9-4889-a919-01f34ba605dd None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:07.155062 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 139/291] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:06 2022] GET /identity/v3/users/805a8d3b9b1b4ac9999ee4778e7d048e => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:07.162126 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e91550-5809-4a4f-a630-61a047e7d930 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:07.269810 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:07.278159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e91550-5809-4a4f-a630-61a047e7d930 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:07.315398 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253825b-dc40-45d3-bc2f-f4929073a6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:07.316388 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253825b-dc40-45d3-bc2f-f4929073a6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:07.316847 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253825b-dc40-45d3-bc2f-f4929073a6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:07.317365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253825b-dc40-45d3-bc2f-f4929073a6a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:07.390028 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253825b-dc40-45d3-bc2f-f4929073a6a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:07.391834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253825b-dc40-45d3-bc2f-f4929073a6a5 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:07.501530 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:07.509269 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 153/292] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:29:07.518162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172941e3-c1f9-4889-a919-01f34ba605dd None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:07.663621 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172941e3-c1f9-4889-a919-01f34ba605dd None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:07.706374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41407a-02e7-4146-bff1-91aa234eadfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:07.707709 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41407a-02e7-4146-bff1-91aa234eadfd None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:07.708173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41407a-02e7-4146-bff1-91aa234eadfd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:07.708635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41407a-02e7-4146-bff1-91aa234eadfd None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:07.710149 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41407a-02e7-4146-bff1-91aa234eadfd None admin] RBAC: Authorizing `identity:get_project(project_id=fe62d682160e40e48208c627043f6ee5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:07.711795 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41407a-02e7-4146-bff1-91aa234eadfd None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:07.714154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 140/293] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:07 2022] GET /identity/v3/projects/fe62d682160e40e48208c627043f6ee5 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:07.722160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253825b-dc40-45d3-bc2f-f4929073a6a5 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:07.778507 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f509a-38da-438f-8a1a-6b40aea4689a None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:07.779108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f509a-38da-438f-8a1a-6b40aea4689a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:07.779562 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f509a-38da-438f-8a1a-6b40aea4689a None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:07.781388 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 141/294] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:07.787225 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ab671-6f8c-427d-b95b-9cf8035341b6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:07.787805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ab671-6f8c-427d-b95b-9cf8035341b6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:07.788272 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ab671-6f8c-427d-b95b-9cf8035341b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:07.818434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-415ab671-6f8c-427d-b95b-9cf8035341b6 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:07.819969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-415ab671-6f8c-427d-b95b-9cf8035341b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:07.865984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:07.902929 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253825b-dc40-45d3-bc2f-f4929073a6a5 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:07.909066 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 142/295] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:07.910448 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5da346-193e-4a5f-ad84-add3480c50f4 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:07.910748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5da346-193e-4a5f-ad84-add3480c50f4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:07.911168 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5da346-193e-4a5f-ad84-add3480c50f4 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:07.913964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 143/296] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:07.919213 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4102c4e-ee47-442a-bb2a-5ddd2e577b3f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:07.919508 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4102c4e-ee47-442a-bb2a-5ddd2e577b3f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:07.919790 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4102c4e-ee47-442a-bb2a-5ddd2e577b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:07.937620 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a4102c4e-ee47-442a-bb2a-5ddd2e577b3f None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:07.939093 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a4102c4e-ee47-442a-bb2a-5ddd2e577b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:07.947556 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52aa780-2f7c-4f5f-9b3f-1fb564db9600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:07.948511 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52aa780-2f7c-4f5f-9b3f-1fb564db9600 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:07.949122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52aa780-2f7c-4f5f-9b3f-1fb564db9600 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:07.949643 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52aa780-2f7c-4f5f-9b3f-1fb564db9600 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:07.950781 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52aa780-2f7c-4f5f-9b3f-1fb564db9600 None admin] RBAC: Adding query filter params (role.id=38ab22e38dfd483dbd2f224b3088f16e, scope.project.id=fe62d682160e40e48208c627043f6ee5, user.id=805a8d3b9b1b4ac9999ee4778e7d048e) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:07.951291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52aa780-2f7c-4f5f-9b3f-1fb564db9600 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:07.952964 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52aa780-2f7c-4f5f-9b3f-1fb564db9600 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:07.960317 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 154/297] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:07 2022] GET /identity/v3/role_assignments?user.id=805a8d3b9b1b4ac9999ee4778e7d048e&scope.project.id=fe62d682160e40e48208c627043f6ee5&role.id=38ab22e38dfd483dbd2f224b3088f16e => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:07.961665 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52aa780-2f7c-4f5f-9b3f-1fb564db9600 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:08.014399 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 144/298] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:29:08.029491 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:08.038613 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4102c4e-ee47-442a-bb2a-5ddd2e577b3f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:08.095832 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52aa780-2f7c-4f5f-9b3f-1fb564db9600 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:08.161073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11295189-ce4e-4004-ac98-6d2eccf1c5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:08.161073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11295189-ce4e-4004-ac98-6d2eccf1c5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:08.161073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11295189-ce4e-4004-ac98-6d2eccf1c5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:08.161073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11295189-ce4e-4004-ac98-6d2eccf1c5c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:08.161467 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11295189-ce4e-4004-ac98-6d2eccf1c5c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:08.161467 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11295189-ce4e-4004-ac98-6d2eccf1c5c7 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:08.163729 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 155/299] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:08.168843 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11295189-ce4e-4004-ac98-6d2eccf1c5c7 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:08.218339 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:08.222221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4102c4e-ee47-442a-bb2a-5ddd2e577b3f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:08.266966 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5cf7e-5d86-4a03-974f-f32cc54a372d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:08.268574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5cf7e-5d86-4a03-974f-f32cc54a372d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:08.269103 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5cf7e-5d86-4a03-974f-f32cc54a372d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:08.269821 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea5cf7e-5d86-4a03-974f-f32cc54a372d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:08.283736 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea5cf7e-5d86-4a03-974f-f32cc54a372d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:08.288348 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11295189-ce4e-4004-ac98-6d2eccf1c5c7 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:08.293987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-9ea5cf7e-5d86-4a03-974f-f32cc54a372d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:29:08.293987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:08.293987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:08.293987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:08.293987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:08.293987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:08.293987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:08.293987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:08.293987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:08.293987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:08.293987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:08.293987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:08.293987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:08.293987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:08.293987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:08.293987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:08.294896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:08.294896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:08.294896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:08.294896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:08.294896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:08.294896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:08.294896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:08.294896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:08.294896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:08.294896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:08.294896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:08.294896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:08.294896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:08.294896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:08.294896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:08.294896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:08.295694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:08.295694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:08.295694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:08.295694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:08.295694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:08.295694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:08.295694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:08.295694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:08.295694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:08.295694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:08.295694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:29:08.295694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:08.301050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 145/300] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:08.306159 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5cf7e-5d86-4a03-974f-f32cc54a372d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:08.319052 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:08.330646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5132e-78a7-4c9f-8222-21fa09796ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:08.331552 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5132e-78a7-4c9f-8222-21fa09796ecf None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:08.332195 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5132e-78a7-4c9f-8222-21fa09796ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:08.332488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5132e-78a7-4c9f-8222-21fa09796ecf None admin] PATH_INFO: `/v3/groups` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:08.333340 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5132e-78a7-4c9f-8222-21fa09796ecf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:08.334923 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5132e-78a7-4c9f-8222-21fa09796ecf None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:08.419421 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea5cf7e-5d86-4a03-974f-f32cc54a372d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:08.458376 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329f7e2-4cd6-42da-bfb4-67f3f382ef37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:08.458941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 156/301] 10.222.0.76 () {60 vars in 1134 bytes} [Mon Jul 18 16:29:08 2022] POST /identity/v3/groups => generated 229 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:29:08.459720 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329f7e2-4cd6-42da-bfb4-67f3f382ef37 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:08.460212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329f7e2-4cd6-42da-bfb4-67f3f382ef37 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:08.460949 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b329f7e2-4cd6-42da-bfb4-67f3f382ef37 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:08.461954 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329f7e2-4cd6-42da-bfb4-67f3f382ef37 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:08.462426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329f7e2-4cd6-42da-bfb4-67f3f382ef37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:08.464207 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b329f7e2-4cd6-42da-bfb4-67f3f382ef37 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:08.476510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 146/302] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:29:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:08.482095 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5132e-78a7-4c9f-8222-21fa09796ecf None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:08.611788 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5132e-78a7-4c9f-8222-21fa09796ecf None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:08.651511 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bab482-e731-4e64-9a7f-beb79597a57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:08.652404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bab482-e731-4e64-9a7f-beb79597a57a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:08.652691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bab482-e731-4e64-9a7f-beb79597a57a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:08.652969 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bab482-e731-4e64-9a7f-beb79597a57a None admin] PATH_INFO: `/v3/users/0ec5ff5e86c746e29726a64717712507` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:08.668370 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bab482-e731-4e64-9a7f-beb79597a57a None admin] RBAC: Authorizing `identity:get_user(user_id=0ec5ff5e86c746e29726a64717712507)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:08.669943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bab482-e731-4e64-9a7f-beb79597a57a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:08.671894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 157/303] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:08 2022] GET /identity/v3/users/0ec5ff5e86c746e29726a64717712507 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:08.678899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329f7e2-4cd6-42da-bfb4-67f3f382ef37 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:08.708405 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:08.791206 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b329f7e2-4cd6-42da-bfb4-67f3f382ef37 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:08.828343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c756d2a6-92fa-457e-a490-5dd075eec4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:08.830037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756d2a6-92fa-457e-a490-5dd075eec4df None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:08.830545 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756d2a6-92fa-457e-a490-5dd075eec4df None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:08.831030 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756d2a6-92fa-457e-a490-5dd075eec4df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:08.832094 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756d2a6-92fa-457e-a490-5dd075eec4df None admin] RBAC: Adding query filter params (role.id=2b96b81e91b549b8b94f331c2772c9de, user.id=0ec5ff5e86c746e29726a64717712507, scope.system=all) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:08.832631 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756d2a6-92fa-457e-a490-5dd075eec4df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:08.834354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c756d2a6-92fa-457e-a490-5dd075eec4df None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:08.840725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 147/304] 10.222.0.76 () {56 vars in 1308 bytes} [Mon Jul 18 16:29:08 2022] GET /identity/v3/role_assignments?user.id=0ec5ff5e86c746e29726a64717712507&scope.system=all&role.id=2b96b81e91b549b8b94f331c2772c9de => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:08.942262 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad2b14-eb07-479a-ba4a-4170e7ce8d6f None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:08.943211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad2b14-eb07-479a-ba4a-4170e7ce8d6f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:08.943710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad2b14-eb07-479a-ba4a-4170e7ce8d6f None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:08.945757 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 158/305] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:08.951645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d1342-a02b-46c4-91dd-5dc2e08c1d9c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:08.952137 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d1342-a02b-46c4-91dd-5dc2e08c1d9c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:08.952567 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d1342-a02b-46c4-91dd-5dc2e08c1d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:08.972729 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-df4d1342-a02b-46c4-91dd-5dc2e08c1d9c None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:08.974321 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-df4d1342-a02b-46c4-91dd-5dc2e08c1d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:09.051275 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 148/306] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:09.067177 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc49beb-5c25-4c4c-aa76-adde4888d16d None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:09.067469 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc49beb-5c25-4c4c-aa76-adde4888d16d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:09.067746 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc49beb-5c25-4c4c-aa76-adde4888d16d None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:09.069158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 159/307] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:09.073773 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d1342-a02b-46c4-91dd-5dc2e08c1d9c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:09.074449 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c3663-1cc1-40d8-9587-4a268973ec31 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:09.075010 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c3663-1cc1-40d8-9587-4a268973ec31 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:09.075517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c3663-1cc1-40d8-9587-4a268973ec31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:09.093672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:09.094372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-4e1c3663-1cc1-40d8-9587-4a268973ec31 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:09.096006 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4e1c3663-1cc1-40d8-9587-4a268973ec31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:09.135967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:09.191336 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 160/308] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:29:09.209494 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d1342-a02b-46c4-91dd-5dc2e08c1d9c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:09.216925 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c3663-1cc1-40d8-9587-4a268973ec31 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:09.253153 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e601ec-e187-4365-9bd9-9773fe85d6ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:09.253993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e601ec-e187-4365-9bd9-9773fe85d6ed None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:09.254403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e601ec-e187-4365-9bd9-9773fe85d6ed None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:09.254686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e601ec-e187-4365-9bd9-9773fe85d6ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:09.268194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e601ec-e187-4365-9bd9-9773fe85d6ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:09.282403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-c6e601ec-e187-4365-9bd9-9773fe85d6ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:29:09.282403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:09.282403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:09.282403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:09.282403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:09.282403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:09.282403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:09.282403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:09.282403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:09.282403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:09.282403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:09.282403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:09.282403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:09.282403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:09.282403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:09.282403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:09.283456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:09.283456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:09.283456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:09.283456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:09.283456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:09.283456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:09.283456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:09.283456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:09.283456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:09.283456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:09.283456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:09.283456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:09.283456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:09.283456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:09.283456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:09.283456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:09.284265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:09.284265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:09.284265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:09.284265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:09.284265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:09.284265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:09.284265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:09.284265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:09.284265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:09.284265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:09.284265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:29:09.284265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:09.287251 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 149/309] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:09.293832 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e601ec-e187-4365-9bd9-9773fe85d6ed None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:09.337379 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c3663-1cc1-40d8-9587-4a268973ec31 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:09.379937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99f5ee-a093-41b4-a4ac-4b75e04b74b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:09.381205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99f5ee-a093-41b4-a4ac-4b75e04b74b5 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:09.381741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99f5ee-a093-41b4-a4ac-4b75e04b74b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:09.382220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec99f5ee-a093-41b4-a4ac-4b75e04b74b5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:09.394810 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec99f5ee-a093-41b4-a4ac-4b75e04b74b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:09.396859 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:09.403247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-ec99f5ee-a093-41b4-a4ac-4b75e04b74b5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:29:09.403247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:09.403247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:09.403247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:09.403247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:09.403247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:09.403247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:09.403247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:09.403247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:09.403247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:09.403247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:09.403247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:09.403247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:09.403247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:09.403247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:09.403247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:09.415394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:09.415394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:09.415394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:09.415394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:09.415394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:09.415394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:09.415394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:09.415394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:09.415394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:09.415394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:09.415394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:09.415394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:09.415394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:09.415394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:09.415394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:09.415394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:09.416218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:09.416218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:09.416218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:09.416218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:09.416218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:09.416218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:09.416218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:09.416218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:09.416218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:09.416218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:09.416218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:29:09.416218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:09.416218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 161/310] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:09.416218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99f5ee-a093-41b4-a4ac-4b75e04b74b5 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:09.427506 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e601ec-e187-4365-9bd9-9773fe85d6ed None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:09.449230 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:09.475211 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dff6a4-6ca4-4226-bea0-a494f60a4dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:09.476226 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dff6a4-6ca4-4226-bea0-a494f60a4dce None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:09.476748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dff6a4-6ca4-4226-bea0-a494f60a4dce None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:09.477274 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dff6a4-6ca4-4226-bea0-a494f60a4dce None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:09.478242 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dff6a4-6ca4-4226-bea0-a494f60a4dce None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:09.478753 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dff6a4-6ca4-4226-bea0-a494f60a4dce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:09.480429 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dff6a4-6ca4-4226-bea0-a494f60a4dce None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:09.491033 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 150/311] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:29:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:09.496938 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dff6a4-6ca4-4226-bea0-a494f60a4dce None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:09.542848 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec99f5ee-a093-41b4-a4ac-4b75e04b74b5 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:09.581343 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d3cab-32f8-4e44-b11b-1262a5631c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:09.582511 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d3cab-32f8-4e44-b11b-1262a5631c37 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:09.583219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d3cab-32f8-4e44-b11b-1262a5631c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:09.583805 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d3cab-32f8-4e44-b11b-1262a5631c37 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:09.584865 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d3cab-32f8-4e44-b11b-1262a5631c37 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:09.585681 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d3cab-32f8-4e44-b11b-1262a5631c37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:09.587707 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d3cab-32f8-4e44-b11b-1262a5631c37 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:09.597106 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 162/312] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:29:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:09.602939 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d3cab-32f8-4e44-b11b-1262a5631c37 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:09.624734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dff6a4-6ca4-4226-bea0-a494f60a4dce None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:09.670252 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e37ef-956d-4215-9a57-fa328a732959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:09.671441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e37ef-956d-4215-9a57-fa328a732959 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:09.671728 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e37ef-956d-4215-9a57-fa328a732959 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:09.672008 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e37ef-956d-4215-9a57-fa328a732959 None admin] PATH_INFO: `/v3/users/e4bb45be9b30420ca37b57274e6b86fb` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:09.673964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e37ef-956d-4215-9a57-fa328a732959 None admin] RBAC: Authorizing `identity:get_user(user_id=e4bb45be9b30420ca37b57274e6b86fb)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:09.675910 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e37ef-956d-4215-9a57-fa328a732959 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:09.678070 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 151/313] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:09 2022] GET /identity/v3/users/e4bb45be9b30420ca37b57274e6b86fb => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:09.683736 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e37ef-956d-4215-9a57-fa328a732959 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:09.712234 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:09.724549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d3cab-32f8-4e44-b11b-1262a5631c37 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:09.761404 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:09.771175 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934db4e3-67fb-4e48-bcc4-6f9cdfcd5902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:09.772436 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934db4e3-67fb-4e48-bcc4-6f9cdfcd5902 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:09.772991 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934db4e3-67fb-4e48-bcc4-6f9cdfcd5902 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:09.773509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934db4e3-67fb-4e48-bcc4-6f9cdfcd5902 None admin] PATH_INFO: `/v3/users/cba14e0ec0bd424796a7c9bb447262c8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:09.775046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934db4e3-67fb-4e48-bcc4-6f9cdfcd5902 None admin] RBAC: Authorizing `identity:get_user(user_id=cba14e0ec0bd424796a7c9bb447262c8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:09.776830 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934db4e3-67fb-4e48-bcc4-6f9cdfcd5902 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:09.783560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 163/314] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:09 2022] GET /identity/v3/users/cba14e0ec0bd424796a7c9bb447262c8 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:09.784818 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934db4e3-67fb-4e48-bcc4-6f9cdfcd5902 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:09.793818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e37ef-956d-4215-9a57-fa328a732959 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:09.830001 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432e4f9-202c-45e7-a51c-990c58b00127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:09.830889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432e4f9-202c-45e7-a51c-990c58b00127 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:09.831175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432e4f9-202c-45e7-a51c-990c58b00127 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:09.831455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432e4f9-202c-45e7-a51c-990c58b00127 None admin] PATH_INFO: `/v3/system/users/e4bb45be9b30420ca37b57274e6b86fb/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:09.833074 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432e4f9-202c-45e7-a51c-990c58b00127 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e4bb45be9b30420ca37b57274e6b86fb, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:09.834581 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432e4f9-202c-45e7-a51c-990c58b00127 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:09.896080 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934db4e3-67fb-4e48-bcc4-6f9cdfcd5902 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:09.934331 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e159ae8-5323-4bb1-9fe8-d1a5c2326fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:09.934996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e159ae8-5323-4bb1-9fe8-d1a5c2326fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:09.935284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e159ae8-5323-4bb1-9fe8-d1a5c2326fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:09.935567 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e159ae8-5323-4bb1-9fe8-d1a5c2326fa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:09.950736 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 152/315] 10.222.0.76 () {58 vars in 1334 bytes} [Mon Jul 18 16:29:09 2022] PUT /identity/v3/system/users/e4bb45be9b30420ca37b57274e6b86fb/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:29:09.973394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:10.024686 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e159ae8-5323-4bb1-9fe8-d1a5c2326fa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:10.026150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e159ae8-5323-4bb1-9fe8-d1a5c2326fa6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:10.138721 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 164/316] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:29:10.144172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432e4f9-202c-45e7-a51c-990c58b00127 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:10.225783 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:10.258401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432e4f9-202c-45e7-a51c-990c58b00127 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:10.298320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a42ba49-ef71-4839-8bf0-979579eb25ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:10.299219 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42ba49-ef71-4839-8bf0-979579eb25ca None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:10.299507 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42ba49-ef71-4839-8bf0-979579eb25ca None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:10.299802 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a42ba49-ef71-4839-8bf0-979579eb25ca None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:10.301205 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42ba49-ef71-4839-8bf0-979579eb25ca None admin] RBAC: Authorizing `identity:get_project(project_id=fe62d682160e40e48208c627043f6ee5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:10.302821 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a42ba49-ef71-4839-8bf0-979579eb25ca None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:10.308261 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 153/317] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:10 2022] GET /identity/v3/projects/fe62d682160e40e48208c627043f6ee5 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:10.311523 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e159ae8-5323-4bb1-9fe8-d1a5c2326fa6 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:10.378743 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:10.423471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e159ae8-5323-4bb1-9fe8-d1a5c2326fa6 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:10.466525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3236ab-e733-4e1c-81de-f4f81eed3057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:10.467277 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3236ab-e733-4e1c-81de-f4f81eed3057 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:10.467568 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3236ab-e733-4e1c-81de-f4f81eed3057 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:10.467852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3236ab-e733-4e1c-81de-f4f81eed3057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:10.468717 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3236ab-e733-4e1c-81de-f4f81eed3057 None admin] RBAC: Adding query filter params (role.id=2b96b81e91b549b8b94f331c2772c9de, scope.project.id=fe62d682160e40e48208c627043f6ee5, user.id=cba14e0ec0bd424796a7c9bb447262c8) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:10.469118 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3236ab-e733-4e1c-81de-f4f81eed3057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:10.471336 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3236ab-e733-4e1c-81de-f4f81eed3057 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:10.485706 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 165/318] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:10 2022] GET /identity/v3/role_assignments?user.id=cba14e0ec0bd424796a7c9bb447262c8&scope.project.id=fe62d682160e40e48208c627043f6ee5&role.id=2b96b81e91b549b8b94f331c2772c9de => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:10.635594 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f20013-8684-4479-9520-dc74c1185b7b None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:10.635954 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f20013-8684-4479-9520-dc74c1185b7b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:10.636151 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f20013-8684-4479-9520-dc74c1185b7b None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:10.637522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 154/319] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:10.644183 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0530b3-ac50-4469-b5b6-18edc4fe133a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:10.644491 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0530b3-ac50-4469-b5b6-18edc4fe133a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:10.644752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0530b3-ac50-4469-b5b6-18edc4fe133a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:10.663864 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-3d0530b3-ac50-4469-b5b6-18edc4fe133a None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:10.665080 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3d0530b3-ac50-4469-b5b6-18edc4fe133a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:10.740471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 166/320] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:10.763824 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f20013-8684-4479-9520-dc74c1185b7b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:10.914015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f20013-8684-4479-9520-dc74c1185b7b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:10.948117 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1f0b7-3364-4881-b783-a0ae7fd80b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:10.948922 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1f0b7-3364-4881-b783-a0ae7fd80b40 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:10.949248 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1f0b7-3364-4881-b783-a0ae7fd80b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:10.949535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1f0b7-3364-4881-b783-a0ae7fd80b40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:10.950707 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1f0b7-3364-4881-b783-a0ae7fd80b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:10.952169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1f0b7-3364-4881-b783-a0ae7fd80b40 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:10.954581 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 155/321] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:10.960224 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0530b3-ac50-4469-b5b6-18edc4fe133a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:10.969093 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126d954-4f9b-4b7d-9fd2-7fbea43ee092 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:10.969575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126d954-4f9b-4b7d-9fd2-7fbea43ee092 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:10.969722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d126d954-4f9b-4b7d-9fd2-7fbea43ee092 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:10.971280 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 156/322] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:29:10.976334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf29ce-ab21-4152-a979-46b4c5bae5de None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:10.976628 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf29ce-ab21-4152-a979-46b4c5bae5de None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:10.976949 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cf29ce-ab21-4152-a979-46b4c5bae5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:10.990085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:10.995496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-67cf29ce-ab21-4152-a979-46b4c5bae5de None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:10.996706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-67cf29ce-ab21-4152-a979-46b4c5bae5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:11.019915 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:11.070010 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 157/323] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:29:11.070236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0530b3-ac50-4469-b5b6-18edc4fe133a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:11.092131 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf29ce-ab21-4152-a979-46b4c5bae5de None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:11.108460 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c70a62-b537-4677-ba00-add5bca5d01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:11.109434 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c70a62-b537-4677-ba00-add5bca5d01a None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:11.110225 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c70a62-b537-4677-ba00-add5bca5d01a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:11.110811 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c70a62-b537-4677-ba00-add5bca5d01a None admin] PATH_INFO: `/v3/groups` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:11.111786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c70a62-b537-4677-ba00-add5bca5d01a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:11.113391 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c70a62-b537-4677-ba00-add5bca5d01a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:11.197246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cf29ce-ab21-4152-a979-46b4c5bae5de None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:11.234710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06b437-be78-472c-b10f-9d578d39087c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:11.235537 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06b437-be78-472c-b10f-9d578d39087c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:11.235821 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06b437-be78-472c-b10f-9d578d39087c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:11.236092 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a06b437-be78-472c-b10f-9d578d39087c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:11.241455 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 167/324] 10.222.0.76 () {60 vars in 1134 bytes} [Mon Jul 18 16:29:10 2022] POST /identity/v3/groups => generated 226 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:29:11.246601 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:11.256627 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a06b437-be78-472c-b10f-9d578d39087c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:11.264899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-9a06b437-be78-472c-b10f-9d578d39087c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:29:11.264899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:11.264899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:11.264899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:11.264899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:11.264899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:11.264899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:11.264899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:11.264899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:11.264899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:11.264899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:11.264899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:11.264899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:11.264899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:11.264899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:11.264899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:11.266401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:11.266401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:11.266401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:11.266401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:11.266401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:11.266401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:11.266401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:11.266401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:11.266401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:11.266401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:11.266401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:11.266401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:11.266401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:11.266401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:11.266401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:11.266401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:11.267946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:11.267946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:11.267946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:11.267946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:11.267946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:11.267946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:11.267946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:11.267946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:11.267946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:11.267946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:11.267946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:29:11.267946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:11.267946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 158/325] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:11.273094 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c70a62-b537-4677-ba00-add5bca5d01a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:11.398225 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c70a62-b537-4677-ba00-add5bca5d01a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:11.412789 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:11.434959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c38b3-edf5-495e-a66c-12ca6f7869dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:11.435568 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c38b3-edf5-495e-a66c-12ca6f7869dd None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:11.435857 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c38b3-edf5-495e-a66c-12ca6f7869dd None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:11.436136 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c38b3-edf5-495e-a66c-12ca6f7869dd None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:11.436887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c38b3-edf5-495e-a66c-12ca6f7869dd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:11.437350 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c38b3-edf5-495e-a66c-12ca6f7869dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:11.439012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c38b3-edf5-495e-a66c-12ca6f7869dd None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:11.448519 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 168/326] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:29:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:11.454282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06b437-be78-472c-b10f-9d578d39087c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:11.566379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a06b437-be78-472c-b10f-9d578d39087c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:11.603578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9735e695-7009-42ca-8cd7-98cb24b314c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:11.604751 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735e695-7009-42ca-8cd7-98cb24b314c9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:11.605244 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735e695-7009-42ca-8cd7-98cb24b314c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:11.605809 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735e695-7009-42ca-8cd7-98cb24b314c9 None admin] PATH_INFO: `/v3/users/0ec5ff5e86c746e29726a64717712507` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:11.607254 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735e695-7009-42ca-8cd7-98cb24b314c9 None admin] RBAC: Authorizing `identity:get_user(user_id=0ec5ff5e86c746e29726a64717712507)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:11.609170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9735e695-7009-42ca-8cd7-98cb24b314c9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:11.611737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 159/327] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:11 2022] GET /identity/v3/users/0ec5ff5e86c746e29726a64717712507 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:11.618254 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c38b3-edf5-495e-a66c-12ca6f7869dd None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:11.813836 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c38b3-edf5-495e-a66c-12ca6f7869dd None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:11.855663 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a58b7-54f4-45fe-8639-05c69e0b6c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:11.856560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a58b7-54f4-45fe-8639-05c69e0b6c51 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:11.856846 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a58b7-54f4-45fe-8639-05c69e0b6c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:11.857167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a58b7-54f4-45fe-8639-05c69e0b6c51 None admin] PATH_INFO: `/v3/system/users/0ec5ff5e86c746e29726a64717712507/roles/2b96b81e91b549b8b94f331c2772c9de` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:11.858768 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a58b7-54f4-45fe-8639-05c69e0b6c51 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0ec5ff5e86c746e29726a64717712507, role_id=2b96b81e91b549b8b94f331c2772c9de)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:11.860906 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a58b7-54f4-45fe-8639-05c69e0b6c51 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:11.938483 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 169/328] 10.222.0.76 () {58 vars in 1334 bytes} [Mon Jul 18 16:29:11 2022] PUT /identity/v3/system/users/0ec5ff5e86c746e29726a64717712507/roles/2b96b81e91b549b8b94f331c2772c9de => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:29:12.100125 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf4a09-db84-48d2-bc20-f75454ff9372 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:12.100754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf4a09-db84-48d2-bc20-f75454ff9372 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:12.100754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdf4a09-db84-48d2-bc20-f75454ff9372 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:12.102456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 160/329] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:12.108122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3d937-fce9-4845-ad8c-50fbbfc21835 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:12.108737 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3d937-fce9-4845-ad8c-50fbbfc21835 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:12.108737 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3d937-fce9-4845-ad8c-50fbbfc21835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:12.134228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-bce3d937-fce9-4845-ad8c-50fbbfc21835 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:12.135488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-bce3d937-fce9-4845-ad8c-50fbbfc21835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:12.180764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:12.232812 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 170/330] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:12.260514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf4a09-db84-48d2-bc20-f75454ff9372 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:12.340659 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:12.389817 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdf4a09-db84-48d2-bc20-f75454ff9372 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:12.436651 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22159269-7a7f-46a6-a925-d37f17830e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:12.437507 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22159269-7a7f-46a6-a925-d37f17830e19 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:12.438397 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22159269-7a7f-46a6-a925-d37f17830e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:12.438854 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22159269-7a7f-46a6-a925-d37f17830e19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:12.450208 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22159269-7a7f-46a6-a925-d37f17830e19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:12.461738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-22159269-7a7f-46a6-a925-d37f17830e19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:29:12.461738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:12.461738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:12.461738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:12.461738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:12.461738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:12.461738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:12.461738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:12.461738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:12.461738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:12.461738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:12.461738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:12.461738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:12.461738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:12.461738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:12.461738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:12.462672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:12.462672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:12.462672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:12.462672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:12.462672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:12.462672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:12.462672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:12.462672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:12.462672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:12.462672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:12.462672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:12.462672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:12.462672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:12.462672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:12.462672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:12.462672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:12.463466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:12.463466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:12.463466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:12.463466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:12.463466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:12.463466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:12.463466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:12.463466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:12.463466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:12.463466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:12.463466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:29:12.463466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:12.463466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 161/331] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:12.473037 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3d937-fce9-4845-ad8c-50fbbfc21835 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:12.606684 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3d937-fce9-4845-ad8c-50fbbfc21835 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:12.650223 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd321c-673b-4dc0-8c14-5b4a33aeb240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:12.651289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd321c-673b-4dc0-8c14-5b4a33aeb240 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:12.651779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd321c-673b-4dc0-8c14-5b4a33aeb240 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:12.652270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fd321c-673b-4dc0-8c14-5b4a33aeb240 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:12.653258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd321c-673b-4dc0-8c14-5b4a33aeb240 None admin] RBAC: Adding query filter params (name=member) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:12.655221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd321c-673b-4dc0-8c14-5b4a33aeb240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:12.655221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fd321c-673b-4dc0-8c14-5b4a33aeb240 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:12.665224 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 171/332] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:29:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:12.671158 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22159269-7a7f-46a6-a925-d37f17830e19 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:12.819493 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22159269-7a7f-46a6-a925-d37f17830e19 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:12.849404 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:12.864399 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecadff8-05b6-4caf-8a53-2fe5ce5f7941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:12.866935 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecadff8-05b6-4caf-8a53-2fe5ce5f7941 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:12.866935 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecadff8-05b6-4caf-8a53-2fe5ce5f7941 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:12.866935 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecadff8-05b6-4caf-8a53-2fe5ce5f7941 None admin] PATH_INFO: `/v3/users/e4bb45be9b30420ca37b57274e6b86fb` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:12.867164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecadff8-05b6-4caf-8a53-2fe5ce5f7941 None admin] RBAC: Authorizing `identity:get_user(user_id=e4bb45be9b30420ca37b57274e6b86fb)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:12.868487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecadff8-05b6-4caf-8a53-2fe5ce5f7941 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:12.870510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 162/333] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:12 2022] GET /identity/v3/users/e4bb45be9b30420ca37b57274e6b86fb => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:12.876540 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd321c-673b-4dc0-8c14-5b4a33aeb240 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:12.934062 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:13.039312 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fd321c-673b-4dc0-8c14-5b4a33aeb240 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:13.091008 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffe4bd7-c3f9-45d9-8109-8f7a3db268bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:13.091775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe4bd7-c3f9-45d9-8109-8f7a3db268bc None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:13.092057 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe4bd7-c3f9-45d9-8109-8f7a3db268bc None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:13.092333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffe4bd7-c3f9-45d9-8109-8f7a3db268bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:13.093216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe4bd7-c3f9-45d9-8109-8f7a3db268bc None admin] RBAC: Adding query filter params (role.id=38ab22e38dfd483dbd2f224b3088f16e, user.id=e4bb45be9b30420ca37b57274e6b86fb, scope.system=all) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:13.093535 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe4bd7-c3f9-45d9-8109-8f7a3db268bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:13.096051 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffe4bd7-c3f9-45d9-8109-8f7a3db268bc None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:13.113573 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 172/334] 10.222.0.76 () {56 vars in 1308 bytes} [Mon Jul 18 16:29:12 2022] GET /identity/v3/role_assignments?user.id=e4bb45be9b30420ca37b57274e6b86fb&scope.system=all&role.id=38ab22e38dfd483dbd2f224b3088f16e => generated 510 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:13.935165 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b42a2d-da56-4b35-88af-8768dc69e60c None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:13.935678 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b42a2d-da56-4b35-88af-8768dc69e60c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:13.935753 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b42a2d-da56-4b35-88af-8768dc69e60c None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:13.937571 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 163/335] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:13.943316 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26d993-05e3-4aab-a505-f2fba4d975e0 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:13.943656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26d993-05e3-4aab-a505-f2fba4d975e0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:13.943885 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26d993-05e3-4aab-a505-f2fba4d975e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:13.966924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-0c26d993-05e3-4aab-a505-f2fba4d975e0 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:13.968210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0c26d993-05e3-4aab-a505-f2fba4d975e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:14.070484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 173/336] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:14.114542 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b42a2d-da56-4b35-88af-8768dc69e60c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:14.255135 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b42a2d-da56-4b35-88af-8768dc69e60c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:14.295657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d56e5b-4b40-4bbf-8b65-a306aba85c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:14.296478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d56e5b-4b40-4bbf-8b65-a306aba85c38 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:14.296766 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d56e5b-4b40-4bbf-8b65-a306aba85c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:14.297643 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d56e5b-4b40-4bbf-8b65-a306aba85c38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:14.308701 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d56e5b-4b40-4bbf-8b65-a306aba85c38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:14.319162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-c2d56e5b-4b40-4bbf-8b65-a306aba85c38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:29:14.319162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:14.319162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:14.319162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:14.319162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:14.319162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:14.319162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:14.319162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:14.319162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:14.319162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:14.319162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:14.319162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:14.319162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:14.319162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:14.319162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:14.319162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:14.320095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:14.320095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:14.320095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:14.320095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:14.320095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:14.320095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:14.320095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:14.320095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:14.320095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:14.320095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:14.320095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:14.320095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:14.320095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:14.320095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:14.320095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:14.320095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:14.320995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:14.320995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:14.320995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:14.320995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:14.320995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:14.320995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:14.320995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:14.320995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:14.320995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:14.320995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:14.320995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:29:14.320995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:14.320995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 164/337] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:14.330163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26d993-05e3-4aab-a505-f2fba4d975e0 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:14.361039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:14.468415 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26d993-05e3-4aab-a505-f2fba4d975e0 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:14.507071 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097c948-9089-4328-9e1d-ba188eb215be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:14.508060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097c948-9089-4328-9e1d-ba188eb215be None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:14.508527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097c948-9089-4328-9e1d-ba188eb215be None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:14.508984 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097c948-9089-4328-9e1d-ba188eb215be None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:14.509945 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097c948-9089-4328-9e1d-ba188eb215be None admin] RBAC: Adding query filter params (name=member) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:14.510430 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097c948-9089-4328-9e1d-ba188eb215be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:14.512007 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097c948-9089-4328-9e1d-ba188eb215be None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:14.525650 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 174/338] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:29:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:14.532347 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d56e5b-4b40-4bbf-8b65-a306aba85c38 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:14.615545 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:14.675389 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d56e5b-4b40-4bbf-8b65-a306aba85c38 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:14.712978 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2324c6-7adb-421f-b0dc-a26ff8ce0309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:14.713684 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2324c6-7adb-421f-b0dc-a26ff8ce0309 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:14.713971 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2324c6-7adb-421f-b0dc-a26ff8ce0309 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:14.714396 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2324c6-7adb-421f-b0dc-a26ff8ce0309 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:14.732507 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709edb30-0d70-4dbf-af08-d9e5357a8f34 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:14.733169 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709edb30-0d70-4dbf-af08-d9e5357a8f34 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:14.733680 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709edb30-0d70-4dbf-af08-d9e5357a8f34 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:14.741042 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 175/339] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:14.745374 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4c0e7-9988-4638-a677-e695384996d3 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:14.746015 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4c0e7-9988-4638-a677-e695384996d3 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:14.746523 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4c0e7-9988-4638-a677-e695384996d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:14.774635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-dbc4c0e7-9988-4638-a677-e695384996d3 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:14.776182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-dbc4c0e7-9988-4638-a677-e695384996d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:14.791489 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2324c6-7adb-421f-b0dc-a26ff8ce0309 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:14.794728 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2324c6-7adb-421f-b0dc-a26ff8ce0309 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:14.847556 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:14.898255 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 165/340] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:29:14.904595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2324c6-7adb-421f-b0dc-a26ff8ce0309 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:14.909752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 176/341] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:14.956437 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4c0e7-9988-4638-a677-e695384996d3 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:14.986749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:15.011002 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2324c6-7adb-421f-b0dc-a26ff8ce0309 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:15.052181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfce21-acb7-4742-b6ea-d14c66b59aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:15.052975 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfce21-acb7-4742-b6ea-d14c66b59aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:15.053296 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfce21-acb7-4742-b6ea-d14c66b59aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:15.053574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfce21-acb7-4742-b6ea-d14c66b59aa7 None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:15.054789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfce21-acb7-4742-b6ea-d14c66b59aa7 None admin] RBAC: Authorizing `identity:get_project(project_id=927eca8521754c2ebbb30dec8ac82458)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:15.056230 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfce21-acb7-4742-b6ea-d14c66b59aa7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:15.058305 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 166/342] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:14 2022] GET /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:15.059655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a434c-9325-4121-a699-92959ed4996a None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:15.059949 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a434c-9325-4121-a699-92959ed4996a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:15.060229 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a434c-9325-4121-a699-92959ed4996a None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:15.061777 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 167/343] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:15.065195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a434c-9325-4121-a699-92959ed4996a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:15.093392 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:15.181092 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a434c-9325-4121-a699-92959ed4996a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:15.195062 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4c0e7-9988-4638-a677-e695384996d3 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:15.224627 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f50e722-1b03-47d9-b75b-5035d896ace7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:15.225552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50e722-1b03-47d9-b75b-5035d896ace7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:15.226277 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50e722-1b03-47d9-b75b-5035d896ace7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:15.226701 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f50e722-1b03-47d9-b75b-5035d896ace7 None admin] PATH_INFO: `/v3/groups/22b15d65b17f4abfbc24087aea9ddccb` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:15.234533 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50e722-1b03-47d9-b75b-5035d896ace7 None admin] RBAC: Authorizing `identity:get_group(group_id=22b15d65b17f4abfbc24087aea9ddccb)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:15.236405 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f50e722-1b03-47d9-b75b-5035d896ace7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:15.238623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 168/344] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 16:29:15 2022] GET /identity/v3/groups/22b15d65b17f4abfbc24087aea9ddccb => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:15.240460 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a600d91-ded2-4e3a-84cb-39f37510ae79 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:15.240901 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a600d91-ded2-4e3a-84cb-39f37510ae79 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:15.241341 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a600d91-ded2-4e3a-84cb-39f37510ae79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:15.260593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2a600d91-ded2-4e3a-84cb-39f37510ae79 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:15.262039 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2a600d91-ded2-4e3a-84cb-39f37510ae79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:15.326464 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e1f24-0851-4319-a2f9-c04d50ed4dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:15.327212 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e1f24-0851-4319-a2f9-c04d50ed4dbd None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:15.327681 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e1f24-0851-4319-a2f9-c04d50ed4dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:15.328165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e1f24-0851-4319-a2f9-c04d50ed4dbd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:15.339248 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 169/345] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:15.340374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a600d91-ded2-4e3a-84cb-39f37510ae79 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:15.357188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:15.382052 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e1f24-0851-4319-a2f9-c04d50ed4dbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:15.392141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-953e1f24-0851-4319-a2f9-c04d50ed4dbd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:29:15.392141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:15.392141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:15.392141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:15.392141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:15.392141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:15.392141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:15.392141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:15.392141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:15.392141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:15.392141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:15.392141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:15.392141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:15.392141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:15.392141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:15.392141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:15.393208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:15.393208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:15.393208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:15.393208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:15.393208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:15.393208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:15.393208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:15.393208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:15.393208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:15.393208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:15.393208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:15.393208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:15.393208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:15.393208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:15.393208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:15.393208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:15.394024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:15.394024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:15.394024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:15.394024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:15.394024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:15.394024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:15.394024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:15.394024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:15.394024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:15.394024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:15.394024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:29:15.394024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:15.394024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 177/346] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 436 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:15.394024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e1f24-0851-4319-a2f9-c04d50ed4dbd None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:15.481461 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a600d91-ded2-4e3a-84cb-39f37510ae79 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:15.483671 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:15.518722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e1f24-0851-4319-a2f9-c04d50ed4dbd None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:15.527405 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbe32b-913b-4f73-913a-8e4c339ddcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:15.528089 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbe32b-913b-4f73-913a-8e4c339ddcd1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:15.528378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbe32b-913b-4f73-913a-8e4c339ddcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:15.528657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbe32b-913b-4f73-913a-8e4c339ddcd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:15.537031 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbe32b-913b-4f73-913a-8e4c339ddcd1 None admin] RBAC: Adding query filter params (group.id=22b15d65b17f4abfbc24087aea9ddccb, role.id=38ab22e38dfd483dbd2f224b3088f16e, scope.project.id=927eca8521754c2ebbb30dec8ac82458) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:15.537031 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbe32b-913b-4f73-913a-8e4c339ddcd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:15.537031 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbe32b-913b-4f73-913a-8e4c339ddcd1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:15.541177 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 170/347] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Jul 18 16:29:15 2022] GET /identity/v3/role_assignments?group.id=22b15d65b17f4abfbc24087aea9ddccb&scope.project.id=927eca8521754c2ebbb30dec8ac82458&role.id=38ab22e38dfd483dbd2f224b3088f16e => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:15.542171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbe32b-913b-4f73-913a-8e4c339ddcd1 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:15.565670 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd7c43-f8f6-4545-afca-ccec19bb068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:15.566742 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd7c43-f8f6-4545-afca-ccec19bb068b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:15.567441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd7c43-f8f6-4545-afca-ccec19bb068b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:15.567735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd7c43-f8f6-4545-afca-ccec19bb068b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:15.585320 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd7c43-f8f6-4545-afca-ccec19bb068b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:15.595604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-40dd7c43-f8f6-4545-afca-ccec19bb068b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:29:15.595604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:15.595604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:15.595604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:15.595604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:15.595604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:15.595604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:15.595604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:15.595604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:15.595604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:15.595604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:15.595604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:15.595604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:15.595604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:15.595604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:15.595604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:15.596700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:15.596700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:15.596700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:15.596700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:15.596700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:15.596700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:15.596700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:15.596700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:15.596700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:15.596700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:15.596700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:15.596700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:15.596700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:15.596700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:15.596700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:15.596700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:15.598242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:15.598242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:15.598242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:15.598242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:15.598242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:15.598242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:15.598242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:15.598242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:15.598242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:15.598242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:15.598242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:29:15.598242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:15.598242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 178/348] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 16:29:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:15.603866 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747b962-de97-4c11-86c3-08a4d3574af7 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:15.603866 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747b962-de97-4c11-86c3-08a4d3574af7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:15.603866 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b747b962-de97-4c11-86c3-08a4d3574af7 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:15.603866 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 179/349] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:15.608800 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747b962-de97-4c11-86c3-08a4d3574af7 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:15.656923 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:15.682311 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbe32b-913b-4f73-913a-8e4c339ddcd1 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:15.721900 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86415343-1b4f-4385-8da7-3d4518ddf9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:15.723013 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86415343-1b4f-4385-8da7-3d4518ddf9ef None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:15.723013 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86415343-1b4f-4385-8da7-3d4518ddf9ef None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:15.723195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86415343-1b4f-4385-8da7-3d4518ddf9ef None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:15.723889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86415343-1b4f-4385-8da7-3d4518ddf9ef None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:15.724197 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86415343-1b4f-4385-8da7-3d4518ddf9ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:15.725611 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86415343-1b4f-4385-8da7-3d4518ddf9ef None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:15.735881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 171/350] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:29:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:15.741034 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada408e8-ebff-44c9-855e-1ab97e43d3c2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:15.741034 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada408e8-ebff-44c9-855e-1ab97e43d3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:15.741034 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada408e8-ebff-44c9-855e-1ab97e43d3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:15.754025 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b747b962-de97-4c11-86c3-08a4d3574af7 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:15.757184 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ada408e8-ebff-44c9-855e-1ab97e43d3c2 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:15.758999 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ada408e8-ebff-44c9-855e-1ab97e43d3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:15.794201 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:15.802561 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a816bfd-8932-443f-849e-7001ed3eef12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:15.803578 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a816bfd-8932-443f-849e-7001ed3eef12 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:15.804038 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a816bfd-8932-443f-849e-7001ed3eef12 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:15.810641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a816bfd-8932-443f-849e-7001ed3eef12 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:15.810641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a816bfd-8932-443f-849e-7001ed3eef12 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:15.810641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a816bfd-8932-443f-849e-7001ed3eef12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:15.810641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a816bfd-8932-443f-849e-7001ed3eef12 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:15.820212 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 180/351] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:15.821681 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a816bfd-8932-443f-849e-7001ed3eef12 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:15.838496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 172/352] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:15.839420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada408e8-ebff-44c9-855e-1ab97e43d3c2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:15.940344 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:15.975843 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a816bfd-8932-443f-849e-7001ed3eef12 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:15.978125 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada408e8-ebff-44c9-855e-1ab97e43d3c2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:16.018258 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7b73a-67b0-40cc-ac2d-3b41f1b30c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:16.019649 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b73a-67b0-40cc-ac2d-3b41f1b30c88 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:16.020216 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b73a-67b0-40cc-ac2d-3b41f1b30c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:16.020667 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7b73a-67b0-40cc-ac2d-3b41f1b30c88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:16.030670 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aad79f-da44-47ea-bccc-f8febb9eef5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:16.032323 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aad79f-da44-47ea-bccc-f8febb9eef5c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:16.032784 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aad79f-da44-47ea-bccc-f8febb9eef5c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:16.033252 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aad79f-da44-47ea-bccc-f8febb9eef5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:16.134771 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:16.137365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7b73a-67b0-40cc-ac2d-3b41f1b30c88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:16.139089 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7b73a-67b0-40cc-ac2d-3b41f1b30c88 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:16.146378 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aad79f-da44-47ea-bccc-f8febb9eef5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:16.147850 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aad79f-da44-47ea-bccc-f8febb9eef5c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:16.228522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:16.273836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 173/353] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:29:16.279423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7b73a-67b0-40cc-ac2d-3b41f1b30c88 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:16.292016 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 181/354] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:29:16.297586 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0b0e5-4e1c-499b-9fdb-e4b7abac54fa None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:16.298831 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0b0e5-4e1c-499b-9fdb-e4b7abac54fa None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:16.299317 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec0b0e5-4e1c-499b-9fdb-e4b7abac54fa None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:16.301088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 182/355] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:16.303536 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0b0e5-4e1c-499b-9fdb-e4b7abac54fa None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:16.428910 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7b73a-67b0-40cc-ac2d-3b41f1b30c88 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:16.447418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:16.459027 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec0b0e5-4e1c-499b-9fdb-e4b7abac54fa None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:16.474506 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a54947-fd23-4dc4-b562-9007a743b687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:16.475617 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a54947-fd23-4dc4-b562-9007a743b687 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:16.476094 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a54947-fd23-4dc4-b562-9007a743b687 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:16.476539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a54947-fd23-4dc4-b562-9007a743b687 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:16.489439 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a54947-fd23-4dc4-b562-9007a743b687 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:16.498466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-90a54947-fd23-4dc4-b562-9007a743b687 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:29:16.498466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:16.498466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:16.498466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:16.498466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:16.498466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:16.498466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:16.498466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:16.498466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:16.498466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:16.498466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:16.498466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:16.498466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:16.498466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:16.498466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:16.498466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:16.499352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:16.499352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:16.499352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:16.499352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:16.499352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:16.499352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:16.499352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:16.499352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:16.499352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:16.499352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:16.499352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:16.499352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:16.499352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:16.499352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:16.499352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:16.499352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:16.500282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:16.500282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:16.500282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:16.500282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:16.500282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:16.500282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:16.500282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:16.500282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:16.500282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:16.500282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:16.500282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 18 16:29:16.500282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:16.503168 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb14198b-a5c7-4f2a-8fbe-4d18794a4cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:16.503302 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 174/356] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:16.503375 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14198b-a5c7-4f2a-8fbe-4d18794a4cbf None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:16.503375 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14198b-a5c7-4f2a-8fbe-4d18794a4cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:16.503518 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a54947-fd23-4dc4-b562-9007a743b687 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:16.503795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb14198b-a5c7-4f2a-8fbe-4d18794a4cbf None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:16.505895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14198b-a5c7-4f2a-8fbe-4d18794a4cbf None admin] RBAC: Authorizing `identity:get_project(project_id=927eca8521754c2ebbb30dec8ac82458)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:16.507469 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb14198b-a5c7-4f2a-8fbe-4d18794a4cbf None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:16.509863 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 183/357] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:16 2022] GET /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:16.510530 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696fbc2-745f-4e7d-b556-4a88ee19bde5 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:16.510814 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696fbc2-745f-4e7d-b556-4a88ee19bde5 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:16.511090 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696fbc2-745f-4e7d-b556-4a88ee19bde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:16.529165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-8696fbc2-745f-4e7d-b556-4a88ee19bde5 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:16.530372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8696fbc2-745f-4e7d-b556-4a88ee19bde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:16.549275 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:16.624333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 184/358] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:16.625838 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066f02e-86ac-46ba-8924-14feafcff151 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:16.626133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066f02e-86ac-46ba-8924-14feafcff151 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:16.626408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066f02e-86ac-46ba-8924-14feafcff151 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:16.632755 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 185/359] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:16.632755 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066f02e-86ac-46ba-8924-14feafcff151 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:16.645711 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a54947-fd23-4dc4-b562-9007a743b687 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:16.691545 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb568080-2188-4936-8e97-595256b09f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:16.692443 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb568080-2188-4936-8e97-595256b09f0d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:16.692746 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb568080-2188-4936-8e97-595256b09f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:16.693040 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb568080-2188-4936-8e97-595256b09f0d None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:16.694381 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb568080-2188-4936-8e97-595256b09f0d None admin] RBAC: Authorizing `identity:get_project(project_id=fe62d682160e40e48208c627043f6ee5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:16.695849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb568080-2188-4936-8e97-595256b09f0d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:16.698167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 175/360] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:16 2022] GET /identity/v3/projects/fe62d682160e40e48208c627043f6ee5 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:16.699125 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb568080-2188-4936-8e97-595256b09f0d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:16.752556 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:16.776586 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066f02e-86ac-46ba-8924-14feafcff151 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:16.823987 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4e598-8a5e-474e-9873-1027732367cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:16.824539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:16.825340 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4e598-8a5e-474e-9873-1027732367cc None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:16.826127 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4e598-8a5e-474e-9873-1027732367cc None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:16.826805 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4e598-8a5e-474e-9873-1027732367cc None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:16.827760 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4e598-8a5e-474e-9873-1027732367cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:16.828801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4e598-8a5e-474e-9873-1027732367cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:16.829087 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb568080-2188-4936-8e97-595256b09f0d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:16.830961 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4e598-8a5e-474e-9873-1027732367cc None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:16.842891 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 186/361] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:29:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:16.845550 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95655b2-5b20-4ce3-95c3-def20abf9cf7 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:16.846066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95655b2-5b20-4ce3-95c3-def20abf9cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:16.846506 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95655b2-5b20-4ce3-95c3-def20abf9cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:16.871178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e95655b2-5b20-4ce3-95c3-def20abf9cf7 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:16.871178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e95655b2-5b20-4ce3-95c3-def20abf9cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:16.876760 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986289d-6ec1-47b3-9d59-6d635f4f5af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:16.879951 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986289d-6ec1-47b3-9d59-6d635f4f5af1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:16.879951 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986289d-6ec1-47b3-9d59-6d635f4f5af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:16.879951 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986289d-6ec1-47b3-9d59-6d635f4f5af1 None admin] PATH_INFO: `/v3/groups/22b15d65b17f4abfbc24087aea9ddccb` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:16.881283 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986289d-6ec1-47b3-9d59-6d635f4f5af1 None admin] RBAC: Authorizing `identity:get_group(group_id=22b15d65b17f4abfbc24087aea9ddccb)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:16.883349 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986289d-6ec1-47b3-9d59-6d635f4f5af1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:16.885309 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 176/362] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 16:29:16 2022] GET /identity/v3/groups/22b15d65b17f4abfbc24087aea9ddccb => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:16.886286 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986289d-6ec1-47b3-9d59-6d635f4f5af1 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:16.960897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 187/363] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:16.963063 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95655b2-5b20-4ce3-95c3-def20abf9cf7 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:17.036309 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986289d-6ec1-47b3-9d59-6d635f4f5af1 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:17.075255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:17.092414 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf5f06-fbf2-4085-8e90-727700a59e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:17.102768 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf5f06-fbf2-4085-8e90-727700a59e8d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:17.102768 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf5f06-fbf2-4085-8e90-727700a59e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:17.102768 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf5f06-fbf2-4085-8e90-727700a59e8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:17.103035 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95655b2-5b20-4ce3-95c3-def20abf9cf7 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:17.108427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf5f06-fbf2-4085-8e90-727700a59e8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:17.118361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-94bf5f06-fbf2-4085-8e90-727700a59e8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:29:17.118361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:17.118361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:17.118361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:17.118361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:17.118361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:17.118361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:17.118361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:17.118361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:17.118361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:17.118361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:17.118361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:17.118361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:17.118361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:17.118361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:17.118361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:17.119481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:17.119481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:17.119481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:17.119481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:17.119481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:17.119481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:17.119481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:17.119481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:17.119481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:17.119481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:17.119481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:17.119481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:17.119481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:17.119481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:17.119481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:17.119481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:17.120503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:17.120503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:17.120503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:17.120503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:17.120503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:17.120503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:17.120503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:17.120503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:17.120503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:17.120503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:17.120503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:29:17.120503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:17.122225 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 177/364] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 16:29:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:17.123104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf5f06-fbf2-4085-8e90-727700a59e8d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:17.157733 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ab726-172f-4e98-9fcf-1cfe220209aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:17.158939 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ab726-172f-4e98-9fcf-1cfe220209aa None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:17.159234 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ab726-172f-4e98-9fcf-1cfe220209aa None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:17.159514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ab726-172f-4e98-9fcf-1cfe220209aa None admin] PATH_INFO: `/v3/groups/22b15d65b17f4abfbc24087aea9ddccb` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:17.161334 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ab726-172f-4e98-9fcf-1cfe220209aa None admin] RBAC: Authorizing `identity:get_group(group_id=22b15d65b17f4abfbc24087aea9ddccb)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:17.163189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:17.163430 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ab726-172f-4e98-9fcf-1cfe220209aa None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:17.166991 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 188/365] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 16:29:16 2022] GET /identity/v3/groups/22b15d65b17f4abfbc24087aea9ddccb => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:17.167809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ab726-172f-4e98-9fcf-1cfe220209aa None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:17.275360 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf5f06-fbf2-4085-8e90-727700a59e8d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:17.304849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ab726-172f-4e98-9fcf-1cfe220209aa None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:17.330154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045be4e-e582-4343-ac63-ca8f0d22ac45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:17.331283 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045be4e-e582-4343-ac63-ca8f0d22ac45 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:17.331722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045be4e-e582-4343-ac63-ca8f0d22ac45 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:17.332171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5045be4e-e582-4343-ac63-ca8f0d22ac45 None admin] PATH_INFO: `/v3/users/0ec5ff5e86c746e29726a64717712507` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:17.333574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045be4e-e582-4343-ac63-ca8f0d22ac45 None admin] RBAC: Authorizing `identity:get_user(user_id=0ec5ff5e86c746e29726a64717712507)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:17.336116 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5045be4e-e582-4343-ac63-ca8f0d22ac45 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:17.337998 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 178/366] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:29:17 2022] GET /identity/v3/users/0ec5ff5e86c746e29726a64717712507 => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:17.338903 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045be4e-e582-4343-ac63-ca8f0d22ac45 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:17.353795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30c65d-1253-4f43-ac2f-ac6a758f13db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:17.354739 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30c65d-1253-4f43-ac2f-ac6a758f13db None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:17.355024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30c65d-1253-4f43-ac2f-ac6a758f13db None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:17.355303 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a30c65d-1253-4f43-ac2f-ac6a758f13db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:17.356680 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30c65d-1253-4f43-ac2f-ac6a758f13db None admin] RBAC: Adding query filter params (group.id=22b15d65b17f4abfbc24087aea9ddccb, role.id=e92acb6fd9834582bb4fd34409b37f94, scope.project.id=927eca8521754c2ebbb30dec8ac82458) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:17.356995 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30c65d-1253-4f43-ac2f-ac6a758f13db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:17.358921 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a30c65d-1253-4f43-ac2f-ac6a758f13db None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:17.368339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 189/367] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Jul 18 16:29:17 2022] GET /identity/v3/role_assignments?group.id=22b15d65b17f4abfbc24087aea9ddccb&scope.project.id=927eca8521754c2ebbb30dec8ac82458&role.id=e92acb6fd9834582bb4fd34409b37f94 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:17.369220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30c65d-1253-4f43-ac2f-ac6a758f13db None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:17.391947 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:17.466292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:17.474394 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5045be4e-e582-4343-ac63-ca8f0d22ac45 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:17.506854 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a30c65d-1253-4f43-ac2f-ac6a758f13db None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:17.529069 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcfddb-494f-4739-997e-a1a5cad81cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:17.530215 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcfddb-494f-4739-997e-a1a5cad81cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:17.530730 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcfddb-494f-4739-997e-a1a5cad81cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:17.531301 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbcfddb-494f-4739-997e-a1a5cad81cf3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:17.547456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbcfddb-494f-4739-997e-a1a5cad81cf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:17.552705 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282144f3-4347-4b4e-a0b0-56b24d71ffd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:17.553796 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282144f3-4347-4b4e-a0b0-56b24d71ffd9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:17.553796 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282144f3-4347-4b4e-a0b0-56b24d71ffd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:17.554041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282144f3-4347-4b4e-a0b0-56b24d71ffd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:17.554757 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282144f3-4347-4b4e-a0b0-56b24d71ffd9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:17.555065 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282144f3-4347-4b4e-a0b0-56b24d71ffd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:17.556489 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282144f3-4347-4b4e-a0b0-56b24d71ffd9 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:17.558456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-ffbcfddb-494f-4739-997e-a1a5cad81cf3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:17.558456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:17.558456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:17.558456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:17.558456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:17.558456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:17.558456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:17.558456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:17.558456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:17.558456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:17.558456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:17.558456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:17.558456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:17.558456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:17.558456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:17.558456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:17.559538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:17.559538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:17.559538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:17.559538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:17.559538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:17.559538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:17.559538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:17.559538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:17.559538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:17.559538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:17.559538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:17.559538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:17.559538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:17.559538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:17.559538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:17.559538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:17.560338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:17.560338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:17.560338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:17.560338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:17.560338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:17.560338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:17.560338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:17.560338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:17.560338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:17.560338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:17.560338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:17.560338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:17.563838 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 179/368] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:29:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:17.565033 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcfddb-494f-4739-997e-a1a5cad81cf3 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:17.569350 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 190/369] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:17.569350 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282144f3-4347-4b4e-a0b0-56b24d71ffd9 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:17.683542 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:17.719335 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282144f3-4347-4b4e-a0b0-56b24d71ffd9 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:17.736718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbcfddb-494f-4739-997e-a1a5cad81cf3 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:17.774806 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d5d29-cd3b-441f-ac2f-1c6e05e684fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:17.775549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5d29-cd3b-441f-ac2f-1c6e05e684fd None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:17.775878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5d29-cd3b-441f-ac2f-1c6e05e684fd None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:17.776163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d5d29-cd3b-441f-ac2f-1c6e05e684fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:17.776999 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d5d29-cd3b-441f-ac2f-1c6e05e684fd None admin] RBAC: Adding query filter params (role.id=2b96b81e91b549b8b94f331c2772c9de, user.id=0ec5ff5e86c746e29726a64717712507, scope.system=all) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:17.777342 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d5d29-cd3b-441f-ac2f-1c6e05e684fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:17.778827 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d5d29-cd3b-441f-ac2f-1c6e05e684fd None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:17.793751 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b0270-25f4-4d69-bb63-b6340243159a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:17.795135 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 191/370] 10.222.0.76 () {56 vars in 1308 bytes} [Mon Jul 18 16:29:17 2022] GET /identity/v3/role_assignments?user.id=0ec5ff5e86c746e29726a64717712507&scope.system=all&role.id=2b96b81e91b549b8b94f331c2772c9de => generated 510 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:17.795958 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b0270-25f4-4d69-bb63-b6340243159a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:17.796065 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d5d29-cd3b-441f-ac2f-1c6e05e684fd None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:17.796727 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b0270-25f4-4d69-bb63-b6340243159a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:17.797791 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b0270-25f4-4d69-bb63-b6340243159a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:17.799357 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b0270-25f4-4d69-bb63-b6340243159a None admin] RBAC: Adding query filter params (group.id=22b15d65b17f4abfbc24087aea9ddccb, role.id=38ab22e38dfd483dbd2f224b3088f16e, scope.project.id=fe62d682160e40e48208c627043f6ee5) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:17.800960 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b0270-25f4-4d69-bb63-b6340243159a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:17.802863 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b0270-25f4-4d69-bb63-b6340243159a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:17.811504 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 180/371] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Jul 18 16:29:17 2022] GET /identity/v3/role_assignments?group.id=22b15d65b17f4abfbc24087aea9ddccb&scope.project.id=fe62d682160e40e48208c627043f6ee5&role.id=38ab22e38dfd483dbd2f224b3088f16e => generated 260 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:17.813657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b0270-25f4-4d69-bb63-b6340243159a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:17.846203 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:17.939715 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d5d29-cd3b-441f-ac2f-1c6e05e684fd None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:17.960077 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b0270-25f4-4d69-bb63-b6340243159a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:17.980287 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399a5df-ab96-40f9-ad60-b98a4b2192a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:17.980991 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399a5df-ab96-40f9-ad60-b98a4b2192a5 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:17.981317 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399a5df-ab96-40f9-ad60-b98a4b2192a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:17.981600 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2399a5df-ab96-40f9-ad60-b98a4b2192a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:17.982383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399a5df-ab96-40f9-ad60-b98a4b2192a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:17.982702 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399a5df-ab96-40f9-ad60-b98a4b2192a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:17.984732 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2399a5df-ab96-40f9-ad60-b98a4b2192a5 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:17.986600 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:17.996104 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 192/372] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:18.006234 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399a5df-ab96-40f9-ad60-b98a4b2192a5 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:18.033866 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e06ca4a-4fd9-4950-9e5e-88411219181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:18.034543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06ca4a-4fd9-4950-9e5e-88411219181b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:18.034828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06ca4a-4fd9-4950-9e5e-88411219181b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:18.035106 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06ca4a-4fd9-4950-9e5e-88411219181b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:18.168238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06ca4a-4fd9-4950-9e5e-88411219181b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:18.169835 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e06ca4a-4fd9-4950-9e5e-88411219181b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:18.205316 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:18.237444 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2399a5df-ab96-40f9-ad60-b98a4b2192a5 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:18.285398 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81843a9-f468-4a56-940b-8f89c86a54b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:18.287119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81843a9-f468-4a56-940b-8f89c86a54b7 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:18.287502 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81843a9-f468-4a56-940b-8f89c86a54b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:18.287882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81843a9-f468-4a56-940b-8f89c86a54b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:18.314071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 181/373] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:29:18.315680 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451e805-568e-46ae-9126-93c5f41c7d0f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:18.316073 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451e805-568e-46ae-9126-93c5f41c7d0f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:18.316453 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451e805-568e-46ae-9126-93c5f41c7d0f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:18.318080 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 182/374] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:18.319818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451e805-568e-46ae-9126-93c5f41c7d0f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:18.380183 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:18.391703 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81843a9-f468-4a56-940b-8f89c86a54b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:18.393249 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81843a9-f468-4a56-940b-8f89c86a54b7 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:18.475064 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451e805-568e-46ae-9126-93c5f41c7d0f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:18.499571 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:18.523890 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 193/375] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:29:18.525898 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259cabe-a4b3-40bb-890a-b925abe548ad None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:18.526460 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259cabe-a4b3-40bb-890a-b925abe548ad None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:18.526925 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259cabe-a4b3-40bb-890a-b925abe548ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:18.527988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407d1ab-0958-4695-afd7-cdc7ec86fb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:18.528867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407d1ab-0958-4695-afd7-cdc7ec86fb23 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:18.529194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407d1ab-0958-4695-afd7-cdc7ec86fb23 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:18.529467 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407d1ab-0958-4695-afd7-cdc7ec86fb23 None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:18.533426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407d1ab-0958-4695-afd7-cdc7ec86fb23 None admin] RBAC: Authorizing `identity:get_project(project_id=fe62d682160e40e48208c627043f6ee5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:18.534532 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6407d1ab-0958-4695-afd7-cdc7ec86fb23 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:18.538386 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 183/376] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:18 2022] GET /identity/v3/projects/fe62d682160e40e48208c627043f6ee5 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:18.539285 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407d1ab-0958-4695-afd7-cdc7ec86fb23 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:18.551222 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-9259cabe-a4b3-40bb-890a-b925abe548ad None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:18.553308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9259cabe-a4b3-40bb-890a-b925abe548ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:18.653042 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 194/377] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:18.653042 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259cabe-a4b3-40bb-890a-b925abe548ad None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:18.679014 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407d1ab-0958-4695-afd7-cdc7ec86fb23 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:18.684991 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:18.724552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562ecce-0adc-4c59-bff1-a572a8b4c3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:18.726006 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562ecce-0adc-4c59-bff1-a572a8b4c3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:18.726505 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562ecce-0adc-4c59-bff1-a572a8b4c3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:18.727002 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562ecce-0adc-4c59-bff1-a572a8b4c3d7 None admin] PATH_INFO: `/v3/projects/0e39050787a54caf815f78d2aa8ec514` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:18.728461 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562ecce-0adc-4c59-bff1-a572a8b4c3d7 None admin] RBAC: Authorizing `identity:get_project(project_id=0e39050787a54caf815f78d2aa8ec514)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:18.730288 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562ecce-0adc-4c59-bff1-a572a8b4c3d7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:18.732691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 184/378] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:18 2022] GET /identity/v3/projects/0e39050787a54caf815f78d2aa8ec514 => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:18.733435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562ecce-0adc-4c59-bff1-a572a8b4c3d7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:18.787109 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259cabe-a4b3-40bb-890a-b925abe548ad None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:18.809053 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:18.837837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14d307-65e5-4b5e-932b-a2591e7bfc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:18.839145 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14d307-65e5-4b5e-932b-a2591e7bfc56 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:18.839734 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14d307-65e5-4b5e-932b-a2591e7bfc56 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:18.840176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e14d307-65e5-4b5e-932b-a2591e7bfc56 None admin] PATH_INFO: `/v3/groups/22b15d65b17f4abfbc24087aea9ddccb` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:18.841823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14d307-65e5-4b5e-932b-a2591e7bfc56 None admin] RBAC: Authorizing `identity:get_group(group_id=22b15d65b17f4abfbc24087aea9ddccb)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:18.844389 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e14d307-65e5-4b5e-932b-a2591e7bfc56 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:18.852311 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 195/379] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 16:29:18 2022] GET /identity/v3/groups/22b15d65b17f4abfbc24087aea9ddccb => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:18.852311 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14d307-65e5-4b5e-932b-a2591e7bfc56 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:18.872922 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562ecce-0adc-4c59-bff1-a572a8b4c3d7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:18.926502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce28181-bcad-44ed-a968-e79616aa4c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:18.928050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce28181-bcad-44ed-a968-e79616aa4c6c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:18.929108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce28181-bcad-44ed-a968-e79616aa4c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:18.929885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce28181-bcad-44ed-a968-e79616aa4c6c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:18.946934 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce28181-bcad-44ed-a968-e79616aa4c6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:18.957846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-dce28181-bcad-44ed-a968-e79616aa4c6c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:29:18.957846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:18.957846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:18.957846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:18.957846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:18.957846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:18.957846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:18.957846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:18.957846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:18.957846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:18.957846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:18.957846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:18.957846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:18.957846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:18.957846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:18.957846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:18.958765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:18.958765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:18.958765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:18.958765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:18.958765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:18.958765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:18.958765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:18.958765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:18.958765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:18.958765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:18.958765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:18.958765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:18.958765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:18.958765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:18.958765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:18.958765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:18.959557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:18.959557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:18.959557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:18.959557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:18.959557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:18.959557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:18.959557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:18.959557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:18.959557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:18.959557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:18.959557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:29:18.959557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:18.962933 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 185/380] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:18.964414 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce28181-bcad-44ed-a968-e79616aa4c6c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:18.986495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:18.996759 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e14d307-65e5-4b5e-932b-a2591e7bfc56 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:19.042474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b4337-221b-4650-9657-d719d9b2f557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:19.043403 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b4337-221b-4650-9657-d719d9b2f557 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:19.043691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b4337-221b-4650-9657-d719d9b2f557 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:19.043972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363b4337-221b-4650-9657-d719d9b2f557 None admin] PATH_INFO: `/v3/groups/b89fc04fb72748d4a296bb4e714efcc7` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:19.051672 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b4337-221b-4650-9657-d719d9b2f557 None admin] RBAC: Authorizing `identity:get_group(group_id=b89fc04fb72748d4a296bb4e714efcc7)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:19.052948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363b4337-221b-4650-9657-d719d9b2f557 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:19.055029 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 196/381] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 16:29:18 2022] GET /identity/v3/groups/b89fc04fb72748d4a296bb4e714efcc7 => generated 229 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:19.055876 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b4337-221b-4650-9657-d719d9b2f557 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:19.108210 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce28181-bcad-44ed-a968-e79616aa4c6c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:19.129578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:19.158638 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fb689-1b1b-492a-8d32-436756d44a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:19.159884 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fb689-1b1b-492a-8d32-436756d44a44 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:19.161246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fb689-1b1b-492a-8d32-436756d44a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:19.161738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878fb689-1b1b-492a-8d32-436756d44a44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:19.162845 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fb689-1b1b-492a-8d32-436756d44a44 None admin] RBAC: Adding query filter params (group.id=22b15d65b17f4abfbc24087aea9ddccb, role.id=e92acb6fd9834582bb4fd34409b37f94, scope.project.id=fe62d682160e40e48208c627043f6ee5) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:19.163371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fb689-1b1b-492a-8d32-436756d44a44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:19.165072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878fb689-1b1b-492a-8d32-436756d44a44 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:19.185282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 186/382] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Jul 18 16:29:18 2022] GET /identity/v3/role_assignments?group.id=22b15d65b17f4abfbc24087aea9ddccb&scope.project.id=fe62d682160e40e48208c627043f6ee5&role.id=e92acb6fd9834582bb4fd34409b37f94 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:19.185282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fb689-1b1b-492a-8d32-436756d44a44 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:19.228091 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363b4337-221b-4650-9657-d719d9b2f557 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:19.292079 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e40dc-7e21-4db1-80b0-e5ee5c755654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:19.293371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e40dc-7e21-4db1-80b0-e5ee5c755654 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:19.293868 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e40dc-7e21-4db1-80b0-e5ee5c755654 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:19.294346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e40dc-7e21-4db1-80b0-e5ee5c755654 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:19.295310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e40dc-7e21-4db1-80b0-e5ee5c755654 None admin] RBAC: Adding query filter params (name=member) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:19.295821 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e40dc-7e21-4db1-80b0-e5ee5c755654 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:19.298230 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e40dc-7e21-4db1-80b0-e5ee5c755654 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:19.322218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 197/383] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:29:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:19.328870 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e40dc-7e21-4db1-80b0-e5ee5c755654 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:19.369867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878fb689-1b1b-492a-8d32-436756d44a44 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:19.376138 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:19.443007 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319e6d3-935d-4b9c-be62-d777acaee579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:19.444058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319e6d3-935d-4b9c-be62-d777acaee579 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:19.444549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319e6d3-935d-4b9c-be62-d777acaee579 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:19.445550 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319e6d3-935d-4b9c-be62-d777acaee579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:19.446637 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319e6d3-935d-4b9c-be62-d777acaee579 None admin] RBAC: Adding query filter params (group.id=b89fc04fb72748d4a296bb4e714efcc7, role.id=c2d5d80485df4730903a874937d68aa3, scope.project.id=0e39050787a54caf815f78d2aa8ec514) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:19.447455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319e6d3-935d-4b9c-be62-d777acaee579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:19.451892 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319e6d3-935d-4b9c-be62-d777acaee579 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:19.460035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 187/384] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Jul 18 16:29:19 2022] GET /identity/v3/role_assignments?group.id=b89fc04fb72748d4a296bb4e714efcc7&scope.project.id=0e39050787a54caf815f78d2aa8ec514&role.id=c2d5d80485df4730903a874937d68aa3 => generated 260 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:19.537052 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e40dc-7e21-4db1-80b0-e5ee5c755654 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:19.584638 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c48188-03b6-4b21-9bcf-c2d8a290be4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:19.585466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c48188-03b6-4b21-9bcf-c2d8a290be4a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:19.585758 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c48188-03b6-4b21-9bcf-c2d8a290be4a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:19.586048 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c48188-03b6-4b21-9bcf-c2d8a290be4a None admin] PATH_INFO: `/v3/groups/22b15d65b17f4abfbc24087aea9ddccb` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:19.589815 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c48188-03b6-4b21-9bcf-c2d8a290be4a None admin] RBAC: Authorizing `identity:get_group(group_id=22b15d65b17f4abfbc24087aea9ddccb)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:19.591308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c48188-03b6-4b21-9bcf-c2d8a290be4a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:19.593460 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 198/385] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 16:29:19 2022] GET /identity/v3/groups/22b15d65b17f4abfbc24087aea9ddccb => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:19.599702 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319e6d3-935d-4b9c-be62-d777acaee579 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:19.673365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:19.751570 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319e6d3-935d-4b9c-be62-d777acaee579 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:19.793351 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde0b87-6901-43ca-a739-b16e922b727a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:19.794245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde0b87-6901-43ca-a739-b16e922b727a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:19.794535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde0b87-6901-43ca-a739-b16e922b727a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:19.794821 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde0b87-6901-43ca-a739-b16e922b727a None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:19.796071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde0b87-6901-43ca-a739-b16e922b727a None admin] RBAC: Authorizing `identity:get_project(project_id=927eca8521754c2ebbb30dec8ac82458)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:19.798344 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde0b87-6901-43ca-a739-b16e922b727a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:19.800409 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 188/386] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:19 2022] GET /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:19.805800 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c48188-03b6-4b21-9bcf-c2d8a290be4a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:19.913932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:19.929915 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c48188-03b6-4b21-9bcf-c2d8a290be4a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:19.969684 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90914548-1d41-4845-b115-2c6704e86e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:19.970752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90914548-1d41-4845-b115-2c6704e86e9e None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:19.971035 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90914548-1d41-4845-b115-2c6704e86e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:19.971316 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90914548-1d41-4845-b115-2c6704e86e9e None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458/groups/22b15d65b17f4abfbc24087aea9ddccb/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:19.973362 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90914548-1d41-4845-b115-2c6704e86e9e None admin] RBAC: Authorizing `identity:create_grant(project_id=927eca8521754c2ebbb30dec8ac82458, group_id=22b15d65b17f4abfbc24087aea9ddccb, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:19.974821 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90914548-1d41-4845-b115-2c6704e86e9e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:20.041520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d9d23-8072-4dc8-8020-dee1da29a5e0 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:20.041956 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d9d23-8072-4dc8-8020-dee1da29a5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:20.042350 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d9d23-8072-4dc8-8020-dee1da29a5e0 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:20.044254 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 189/387] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:29:20.052280 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 199/388] 10.222.0.76 () {58 vars in 1442 bytes} [Mon Jul 18 16:29:19 2022] PUT /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458/groups/22b15d65b17f4abfbc24087aea9ddccb/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:29:20.053200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee941c-c251-44ec-a92f-0564e2a01fcd None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:20.053409 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee941c-c251-44ec-a92f-0564e2a01fcd None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:20.053748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee941c-c251-44ec-a92f-0564e2a01fcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:20.078864 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d3ee941c-c251-44ec-a92f-0564e2a01fcd None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:20.080081 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d3ee941c-c251-44ec-a92f-0564e2a01fcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:20.187092 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 190/389] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:29:20.223109 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90914548-1d41-4845-b115-2c6704e86e9e None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:20.355306 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90914548-1d41-4845-b115-2c6704e86e9e None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:20.372869 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682443ec-6808-431d-851b-66eca2aa2f0f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:20.373214 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682443ec-6808-431d-851b-66eca2aa2f0f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:20.373498 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682443ec-6808-431d-851b-66eca2aa2f0f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:20.375167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 191/390] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:20.380436 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e861a6c-110e-46b4-a88a-11d2ef30710c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:20.380720 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e861a6c-110e-46b4-a88a-11d2ef30710c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:20.381000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e861a6c-110e-46b4-a88a-11d2ef30710c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:20.398738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8e861a6c-110e-46b4-a88a-11d2ef30710c None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:20.399937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8e861a6c-110e-46b4-a88a-11d2ef30710c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:20.405757 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85cc70-570f-4462-98cd-a3616cefe7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:20.407162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85cc70-570f-4462-98cd-a3616cefe7a0 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:20.407446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85cc70-570f-4462-98cd-a3616cefe7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:20.407720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b85cc70-570f-4462-98cd-a3616cefe7a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:20.426662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b85cc70-570f-4462-98cd-a3616cefe7a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:20.434823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-6b85cc70-570f-4462-98cd-a3616cefe7a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:29:20.434823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:20.434823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:20.434823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:20.434823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:20.434823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:20.434823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:20.434823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:20.434823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:20.434823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:20.434823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:20.434823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:20.434823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:20.434823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:20.434823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:20.434823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:20.435744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:20.435744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:20.435744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:20.435744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:20.435744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:20.435744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:20.435744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:20.435744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:20.435744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:20.435744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:20.435744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:20.435744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:20.435744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:20.435744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:20.435744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:20.435744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:20.436700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:20.436700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:20.436700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:20.436700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:20.436700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:20.436700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:20.436700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:20.436700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:20.436700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:20.436700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:20.436700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:29:20.436700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:20.436700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 200/391] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 16:29:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:20.447361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85cc70-570f-4462-98cd-a3616cefe7a0 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:20.469354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:20.473359 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:20.534459 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 192/392] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:20.565667 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e861a6c-110e-46b4-a88a-11d2ef30710c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:20.615475 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b85cc70-570f-4462-98cd-a3616cefe7a0 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:20.658592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25b23e-9327-4fb8-a2dc-379df00a2b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:20.660526 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25b23e-9327-4fb8-a2dc-379df00a2b77 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:20.662088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25b23e-9327-4fb8-a2dc-379df00a2b77 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:20.662575 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25b23e-9327-4fb8-a2dc-379df00a2b77 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:20.663726 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25b23e-9327-4fb8-a2dc-379df00a2b77 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:20.665072 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25b23e-9327-4fb8-a2dc-379df00a2b77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:20.667319 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25b23e-9327-4fb8-a2dc-379df00a2b77 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:20.685970 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 201/393] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:20.693289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25b23e-9327-4fb8-a2dc-379df00a2b77 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:20.740222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e861a6c-110e-46b4-a88a-11d2ef30710c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:20.791527 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90882667-29fe-4c0b-b14c-3b3ab12532c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:20.792348 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90882667-29fe-4c0b-b14c-3b3ab12532c6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:20.792638 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90882667-29fe-4c0b-b14c-3b3ab12532c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:20.792917 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90882667-29fe-4c0b-b14c-3b3ab12532c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:20.817493 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90882667-29fe-4c0b-b14c-3b3ab12532c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:20.832731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-90882667-29fe-4c0b-b14c-3b3ab12532c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:29:20.832731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:20.832731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:20.832731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:20.832731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:20.832731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:20.832731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:20.832731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:20.832731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:20.832731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:20.832731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:20.832731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:20.832731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:20.832731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:20.832731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:20.832731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:20.833722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:20.833722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:20.833722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:20.833722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:20.833722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:20.833722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:20.833722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:20.833722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:20.833722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:20.833722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:20.833722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:20.833722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:20.833722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:20.833722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:20.833722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:20.833722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:20.835123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:20.835123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:20.835123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:20.835123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:20.835123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:20.835123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:20.835123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:20.835123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:20.835123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:20.835123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:20.835123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:29:20.835123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:20.835123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 193/394] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:20.842257 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90882667-29fe-4c0b-b14c-3b3ab12532c6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:20.845346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:20.882923 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25b23e-9327-4fb8-a2dc-379df00a2b77 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:20.912905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:20.970631 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc8a50-00c5-4a21-82e3-f26332b63cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:20.971441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc8a50-00c5-4a21-82e3-f26332b63cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:20.971725 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc8a50-00c5-4a21-82e3-f26332b63cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:20.972002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc8a50-00c5-4a21-82e3-f26332b63cd6 None admin] PATH_INFO: `/v3/groups/22b15d65b17f4abfbc24087aea9ddccb` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:20.973224 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc8a50-00c5-4a21-82e3-f26332b63cd6 None admin] RBAC: Authorizing `identity:get_group(group_id=22b15d65b17f4abfbc24087aea9ddccb)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:20.974712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc8a50-00c5-4a21-82e3-f26332b63cd6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:20.980826 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 202/395] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 16:29:20 2022] GET /identity/v3/groups/22b15d65b17f4abfbc24087aea9ddccb => generated 226 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:20.990480 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc8a50-00c5-4a21-82e3-f26332b63cd6 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:21.004326 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90882667-29fe-4c0b-b14c-3b3ab12532c6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:21.044898 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d2d19-f2ed-4e80-9553-2f027cee7726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:21.046448 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d2d19-f2ed-4e80-9553-2f027cee7726 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:21.046944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d2d19-f2ed-4e80-9553-2f027cee7726 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:21.047429 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d2d19-f2ed-4e80-9553-2f027cee7726 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:21.048388 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d2d19-f2ed-4e80-9553-2f027cee7726 None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:21.048918 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d2d19-f2ed-4e80-9553-2f027cee7726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:21.050886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d2d19-f2ed-4e80-9553-2f027cee7726 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:21.061388 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 194/396] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:29:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:21.070150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d2d19-f2ed-4e80-9553-2f027cee7726 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:21.198335 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc8a50-00c5-4a21-82e3-f26332b63cd6 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:21.242213 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816e580-1eed-4157-83b8-722cc803a754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:21.246269 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816e580-1eed-4157-83b8-722cc803a754 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:21.246603 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816e580-1eed-4157-83b8-722cc803a754 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:21.247145 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816e580-1eed-4157-83b8-722cc803a754 None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:21.253877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816e580-1eed-4157-83b8-722cc803a754 None admin] RBAC: Authorizing `identity:get_project(project_id=927eca8521754c2ebbb30dec8ac82458)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:21.255452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816e580-1eed-4157-83b8-722cc803a754 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:21.257794 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 203/397] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:20 2022] GET /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:21.263435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816e580-1eed-4157-83b8-722cc803a754 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:21.270168 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:21.281222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d2d19-f2ed-4e80-9553-2f027cee7726 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:21.284048 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:21.323849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada2f8f-2ded-4883-a2be-8a850e47af53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:21.325993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada2f8f-2ded-4883-a2be-8a850e47af53 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:21.327452 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada2f8f-2ded-4883-a2be-8a850e47af53 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:21.329724 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada2f8f-2ded-4883-a2be-8a850e47af53 None admin] PATH_INFO: `/v3/groups/22b15d65b17f4abfbc24087aea9ddccb` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:21.333480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada2f8f-2ded-4883-a2be-8a850e47af53 None admin] RBAC: Authorizing `identity:get_group(group_id=22b15d65b17f4abfbc24087aea9ddccb)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:21.335182 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aada2f8f-2ded-4883-a2be-8a850e47af53 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:21.343305 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 195/398] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 16:29:21 2022] GET /identity/v3/groups/22b15d65b17f4abfbc24087aea9ddccb => generated 226 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:21.349200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada2f8f-2ded-4883-a2be-8a850e47af53 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:21.432098 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816e580-1eed-4157-83b8-722cc803a754 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:21.472195 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bb326-88d8-4029-b9c0-0e2b0d1c6422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:21.473123 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bb326-88d8-4029-b9c0-0e2b0d1c6422 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:21.473412 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bb326-88d8-4029-b9c0-0e2b0d1c6422 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:21.473697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799bb326-88d8-4029-b9c0-0e2b0d1c6422 None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458/groups/22b15d65b17f4abfbc24087aea9ddccb/roles/e92acb6fd9834582bb4fd34409b37f94` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:21.476037 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bb326-88d8-4029-b9c0-0e2b0d1c6422 None admin] RBAC: Authorizing `identity:create_grant(project_id=927eca8521754c2ebbb30dec8ac82458, group_id=22b15d65b17f4abfbc24087aea9ddccb, role_id=e92acb6fd9834582bb4fd34409b37f94)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:21.477564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799bb326-88d8-4029-b9c0-0e2b0d1c6422 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:21.535519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aada2f8f-2ded-4883-a2be-8a850e47af53 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:21.550114 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 204/399] 10.222.0.76 () {58 vars in 1442 bytes} [Mon Jul 18 16:29:21 2022] PUT /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458/groups/22b15d65b17f4abfbc24087aea9ddccb/roles/e92acb6fd9834582bb4fd34409b37f94 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:29:21.591702 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07637ba7-f49c-4986-9db6-ce07535f1adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:21.592666 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07637ba7-f49c-4986-9db6-ce07535f1adb None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:21.593004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07637ba7-f49c-4986-9db6-ce07535f1adb None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:21.593361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07637ba7-f49c-4986-9db6-ce07535f1adb None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:21.595089 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07637ba7-f49c-4986-9db6-ce07535f1adb None admin] RBAC: Authorizing `identity:get_project(project_id=fe62d682160e40e48208c627043f6ee5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:21.596646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07637ba7-f49c-4986-9db6-ce07535f1adb None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:21.599071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 196/400] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:21 2022] GET /identity/v3/projects/fe62d682160e40e48208c627043f6ee5 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:21.604874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bb326-88d8-4029-b9c0-0e2b0d1c6422 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:21.704524 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:21.750867 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799bb326-88d8-4029-b9c0-0e2b0d1c6422 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:21.813941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66656c3a-3ad9-46f3-a8f0-8179fa6a2b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:21.814869 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66656c3a-3ad9-46f3-a8f0-8179fa6a2b05 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:21.815251 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66656c3a-3ad9-46f3-a8f0-8179fa6a2b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:21.815506 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66656c3a-3ad9-46f3-a8f0-8179fa6a2b05 None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5/groups/22b15d65b17f4abfbc24087aea9ddccb/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:21.818174 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66656c3a-3ad9-46f3-a8f0-8179fa6a2b05 None admin] RBAC: Authorizing `identity:create_grant(project_id=fe62d682160e40e48208c627043f6ee5, group_id=22b15d65b17f4abfbc24087aea9ddccb, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:21.819940 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66656c3a-3ad9-46f3-a8f0-8179fa6a2b05 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:21.894838 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dac2a5-d4bb-47ca-b479-4abdb07a8659 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:21.895160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dac2a5-d4bb-47ca-b479-4abdb07a8659 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:21.895400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dac2a5-d4bb-47ca-b479-4abdb07a8659 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:21.897109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 197/401] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:29:21.902395 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfa94c-6843-4c82-bd6d-2e4d595c6ee1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:21.902687 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfa94c-6843-4c82-bd6d-2e4d595c6ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:21.902967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfa94c-6843-4c82-bd6d-2e4d595c6ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:21.921241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a6bfa94c-6843-4c82-bd6d-2e4d595c6ee1 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:21.923250 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a6bfa94c-6843-4c82-bd6d-2e4d595c6ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:21.949485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 205/402] 10.222.0.76 () {58 vars in 1442 bytes} [Mon Jul 18 16:29:21 2022] PUT /identity/v3/projects/fe62d682160e40e48208c627043f6ee5/groups/22b15d65b17f4abfbc24087aea9ddccb/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:29:21.957602 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:22.021934 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 198/403] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:29:22.047070 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66656c3a-3ad9-46f3-a8f0-8179fa6a2b05 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:22.181523 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66656c3a-3ad9-46f3-a8f0-8179fa6a2b05 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:22.210734 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:22.217965 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175e21f-2c5c-4114-81ee-ef571ae98b28 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:22.218400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175e21f-2c5c-4114-81ee-ef571ae98b28 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:22.218577 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175e21f-2c5c-4114-81ee-ef571ae98b28 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:22.220536 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ba585-b708-4333-9167-f71312bb90a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:22.220671 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 199/404] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:29:22.221439 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ba585-b708-4333-9167-f71312bb90a6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:22.221781 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ba585-b708-4333-9167-f71312bb90a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:22.228306 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ba585-b708-4333-9167-f71312bb90a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:22.228433 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb35ba-1b8b-41c0-89ab-888da02d5405 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:22.228433 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb35ba-1b8b-41c0-89ab-888da02d5405 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:22.228433 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb35ba-1b8b-41c0-89ab-888da02d5405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:22.240157 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ba585-b708-4333-9167-f71312bb90a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:22.248242 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-78eb35ba-1b8b-41c0-89ab-888da02d5405 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:22.249116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-e11ba585-b708-4333-9167-f71312bb90a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:29:22.249116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:22.249116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:22.249116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:22.249116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:22.249116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:22.249116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:22.249116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:22.249116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:22.249116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:22.249116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:22.249116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:22.249116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:22.249116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:22.249116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:22.249116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:22.251165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:22.251165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:22.251165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:22.251165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:22.251165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:22.251165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:22.251165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:22.251165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:22.251165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:22.251165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:22.251165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:22.251165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:22.251165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:22.251165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:22.251165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:22.251165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:22.252210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:22.252210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:22.252210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:22.252210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:22.252210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:22.252210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:22.252210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:22.252210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:22.252210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:22.252210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:22.252210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:29:22.252210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:22.252210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 206/405] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 16:29:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:22.255565 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-78eb35ba-1b8b-41c0-89ab-888da02d5405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:22.257280 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ba585-b708-4333-9167-f71312bb90a6 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:22.335983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 200/406] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:29:22.359700 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb35ba-1b8b-41c0-89ab-888da02d5405 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:22.376403 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ba585-b708-4333-9167-f71312bb90a6 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:22.419162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5902a-8f56-4cd3-9101-61c7f423dba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:22.420308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5902a-8f56-4cd3-9101-61c7f423dba2 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:22.420899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5902a-8f56-4cd3-9101-61c7f423dba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:22.421961 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5902a-8f56-4cd3-9101-61c7f423dba2 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:22.423031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5902a-8f56-4cd3-9101-61c7f423dba2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:22.423560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5902a-8f56-4cd3-9101-61c7f423dba2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:22.425323 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5902a-8f56-4cd3-9101-61c7f423dba2 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:22.434756 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 207/407] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:22.440885 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5902a-8f56-4cd3-9101-61c7f423dba2 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:22.457592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:22.469039 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb35ba-1b8b-41c0-89ab-888da02d5405 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:22.507825 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7e288-8a33-43e9-928e-e443ba4a0124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:22.508634 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7e288-8a33-43e9-928e-e443ba4a0124 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:22.508921 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7e288-8a33-43e9-928e-e443ba4a0124 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:22.509241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7e288-8a33-43e9-928e-e443ba4a0124 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:22.530310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:22.532912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7e288-8a33-43e9-928e-e443ba4a0124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:22.541827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-67e7e288-8a33-43e9-928e-e443ba4a0124 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:22.541827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:22.541827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:22.541827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:22.541827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:22.541827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:22.541827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:22.541827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:22.541827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:22.541827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:22.541827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:22.541827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:22.541827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:22.541827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:22.541827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:22.541827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:22.542976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:22.542976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:22.542976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:22.542976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:22.542976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:22.542976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:22.542976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:22.542976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:22.542976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:22.542976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:22.542976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:22.542976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:22.542976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:22.542976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:22.542976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:22.542976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:22.544188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:22.544188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:22.544188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:22.544188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:22.544188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:22.544188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:22.544188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:22.544188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:22.544188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:22.544188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:22.544188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:22.544188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:22.544188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 201/408] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:29:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:22.549991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7e288-8a33-43e9-928e-e443ba4a0124 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:22.623054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5902a-8f56-4cd3-9101-61c7f423dba2 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:22.667429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3696aab6-2ab6-4d8e-916e-ada7a631f7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:22.668990 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696aab6-2ab6-4d8e-916e-ada7a631f7c1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:22.669859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696aab6-2ab6-4d8e-916e-ada7a631f7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:22.670357 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3696aab6-2ab6-4d8e-916e-ada7a631f7c1 None admin] PATH_INFO: `/v3/groups/22b15d65b17f4abfbc24087aea9ddccb` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:22.671796 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696aab6-2ab6-4d8e-916e-ada7a631f7c1 None admin] RBAC: Authorizing `identity:get_group(group_id=22b15d65b17f4abfbc24087aea9ddccb)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:22.674534 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3696aab6-2ab6-4d8e-916e-ada7a631f7c1 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:22.677668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 208/409] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 16:29:22 2022] GET /identity/v3/groups/22b15d65b17f4abfbc24087aea9ddccb => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:22.679256 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cebdf-4883-478e-8b89-30fda9bcc4ae None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:22.679748 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cebdf-4883-478e-8b89-30fda9bcc4ae None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:22.680224 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087cebdf-4883-478e-8b89-30fda9bcc4ae None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:22.681950 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 209/410] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:22.684224 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cebdf-4883-478e-8b89-30fda9bcc4ae None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:22.690642 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7e288-8a33-43e9-928e-e443ba4a0124 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:22.727617 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc119cec-f80b-47b3-bc03-a836b538b8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:22.728302 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc119cec-f80b-47b3-bc03-a836b538b8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:22.728585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc119cec-f80b-47b3-bc03-a836b538b8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:22.728887 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc119cec-f80b-47b3-bc03-a836b538b8e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:22.729643 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc119cec-f80b-47b3-bc03-a836b538b8e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:22.729949 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc119cec-f80b-47b3-bc03-a836b538b8e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:22.731470 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc119cec-f80b-47b3-bc03-a836b538b8e6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:22.743635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 202/411] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:22.748534 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18a87b-b58e-464c-bb34-bb2f1882ba4c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:22.748534 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18a87b-b58e-464c-bb34-bb2f1882ba4c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:22.748534 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18a87b-b58e-464c-bb34-bb2f1882ba4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:22.772000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0b18a87b-b58e-464c-bb34-bb2f1882ba4c None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:22.773824 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0b18a87b-b58e-464c-bb34-bb2f1882ba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:22.778121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:22.819386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087cebdf-4883-478e-8b89-30fda9bcc4ae None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:22.840981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:22.861086 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70e3c5-fe2a-43cc-823c-9120b689ee7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:22.862327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70e3c5-fe2a-43cc-823c-9120b689ee7f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:22.862439 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70e3c5-fe2a-43cc-823c-9120b689ee7f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:22.862683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f70e3c5-fe2a-43cc-823c-9120b689ee7f None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:22.863947 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70e3c5-fe2a-43cc-823c-9120b689ee7f None admin] RBAC: Authorizing `identity:get_project(project_id=fe62d682160e40e48208c627043f6ee5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:22.865455 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f70e3c5-fe2a-43cc-823c-9120b689ee7f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:22.867887 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 203/413] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:22.869152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18a87b-b58e-464c-bb34-bb2f1882ba4c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:22.872518 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 210/413] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:22 2022] GET /identity/v3/projects/fe62d682160e40e48208c627043f6ee5 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:22.874136 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70e3c5-fe2a-43cc-823c-9120b689ee7f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:22.990234 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18a87b-b58e-464c-bb34-bb2f1882ba4c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:23.001615 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f70e3c5-fe2a-43cc-823c-9120b689ee7f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:23.031524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49f06c-81ae-48d5-b74f-4a1ace9c2286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:23.032752 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49f06c-81ae-48d5-b74f-4a1ace9c2286 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:23.033493 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49f06c-81ae-48d5-b74f-4a1ace9c2286 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:23.033784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49f06c-81ae-48d5-b74f-4a1ace9c2286 None admin] PATH_INFO: `/v3/groups/b89fc04fb72748d4a296bb4e714efcc7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:23.035545 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49f06c-81ae-48d5-b74f-4a1ace9c2286 None admin] RBAC: Authorizing `identity:get_group(group_id=b89fc04fb72748d4a296bb4e714efcc7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:23.037748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49f06c-81ae-48d5-b74f-4a1ace9c2286 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:23.039439 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 204/414] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 16:29:22 2022] GET /identity/v3/groups/b89fc04fb72748d4a296bb4e714efcc7 => generated 229 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:23.040215 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49f06c-81ae-48d5-b74f-4a1ace9c2286 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:23.045877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d803fb6-e6c1-49d0-9073-d4b42981ee5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:23.047398 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d803fb6-e6c1-49d0-9073-d4b42981ee5f None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:23.047754 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d803fb6-e6c1-49d0-9073-d4b42981ee5f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:23.053031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d803fb6-e6c1-49d0-9073-d4b42981ee5f None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5/groups/22b15d65b17f4abfbc24087aea9ddccb/roles/e92acb6fd9834582bb4fd34409b37f94` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:23.053031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d803fb6-e6c1-49d0-9073-d4b42981ee5f None admin] RBAC: Authorizing `identity:create_grant(project_id=fe62d682160e40e48208c627043f6ee5, group_id=22b15d65b17f4abfbc24087aea9ddccb, role_id=e92acb6fd9834582bb4fd34409b37f94)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:23.053031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d803fb6-e6c1-49d0-9073-d4b42981ee5f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:23.058088 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:23.132339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 211/415] 10.222.0.76 () {58 vars in 1442 bytes} [Mon Jul 18 16:29:22 2022] PUT /identity/v3/projects/fe62d682160e40e48208c627043f6ee5/groups/22b15d65b17f4abfbc24087aea9ddccb/roles/e92acb6fd9834582bb4fd34409b37f94 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:29:23.139729 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d803fb6-e6c1-49d0-9073-d4b42981ee5f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:23.152901 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49f06c-81ae-48d5-b74f-4a1ace9c2286 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:23.210418 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d49f36-b87b-4879-bae0-3885a814dce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:23.211261 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d49f36-b87b-4879-bae0-3885a814dce9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:23.211567 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d49f36-b87b-4879-bae0-3885a814dce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:23.211835 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d49f36-b87b-4879-bae0-3885a814dce9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:23.240339 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d49f36-b87b-4879-bae0-3885a814dce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:23.255540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-24d49f36-b87b-4879-bae0-3885a814dce9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:29:23.255540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:23.255540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:23.255540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:23.255540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:23.255540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:23.255540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:23.255540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:23.255540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:23.255540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:23.255540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:23.255540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:23.255540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:23.255540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:23.255540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:23.255540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:23.256528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:23.256528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:23.256528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:23.256528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:23.256528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:23.256528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:23.256528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:23.256528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:23.256528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:23.256528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:23.256528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:23.256528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:23.256528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:23.256528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:23.256528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:23.256528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:23.257365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:23.257365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:23.257365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:23.257365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:23.257365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:23.257365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:23.257365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:23.257365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:23.257365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:23.257365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:23.257365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:29:23.257365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:23.257989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:23.258069 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 205/416] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:23.268292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d49f36-b87b-4879-bae0-3885a814dce9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:23.383703 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d803fb6-e6c1-49d0-9073-d4b42981ee5f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:23.399675 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:23.430491 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8b3fa-38be-4a3c-ae66-a3f52b0fd91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:23.432244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8b3fa-38be-4a3c-ae66-a3f52b0fd91f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:23.432746 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8b3fa-38be-4a3c-ae66-a3f52b0fd91f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:23.433542 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8b3fa-38be-4a3c-ae66-a3f52b0fd91f None admin] PATH_INFO: `/v3/projects/0e39050787a54caf815f78d2aa8ec514` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:23.435200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8b3fa-38be-4a3c-ae66-a3f52b0fd91f None admin] RBAC: Authorizing `identity:get_project(project_id=0e39050787a54caf815f78d2aa8ec514)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:23.437063 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8b3fa-38be-4a3c-ae66-a3f52b0fd91f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:23.439117 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 212/417] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:23 2022] GET /identity/v3/projects/0e39050787a54caf815f78d2aa8ec514 => generated 344 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:23.448953 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8b3fa-38be-4a3c-ae66-a3f52b0fd91f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:23.473527 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d49f36-b87b-4879-bae0-3885a814dce9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:23.514192 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baaa61e-edb8-4fba-baa3-6d9ce1b7b973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:23.515944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baaa61e-edb8-4fba-baa3-6d9ce1b7b973 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:23.516484 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baaa61e-edb8-4fba-baa3-6d9ce1b7b973 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:23.516986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baaa61e-edb8-4fba-baa3-6d9ce1b7b973 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:23.517991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baaa61e-edb8-4fba-baa3-6d9ce1b7b973 None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:23.518539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baaa61e-edb8-4fba-baa3-6d9ce1b7b973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:23.520137 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baaa61e-edb8-4fba-baa3-6d9ce1b7b973 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:23.530093 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 206/418] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:29:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:23.536718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baaa61e-edb8-4fba-baa3-6d9ce1b7b973 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:23.655483 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8b3fa-38be-4a3c-ae66-a3f52b0fd91f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:23.670952 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:23.713523 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2c9980-6bbe-4131-8e01-43025bfc3b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:23.715544 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c9980-6bbe-4131-8e01-43025bfc3b23 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:23.717530 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c9980-6bbe-4131-8e01-43025bfc3b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:23.719381 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2c9980-6bbe-4131-8e01-43025bfc3b23 None admin] PATH_INFO: `/v3/projects/0e39050787a54caf815f78d2aa8ec514/groups/b89fc04fb72748d4a296bb4e714efcc7/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:23.722966 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c9980-6bbe-4131-8e01-43025bfc3b23 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e39050787a54caf815f78d2aa8ec514, group_id=b89fc04fb72748d4a296bb4e714efcc7, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:23.729397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2c9980-6bbe-4131-8e01-43025bfc3b23 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:23.747161 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baaa61e-edb8-4fba-baa3-6d9ce1b7b973 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:23.779924 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:23.786434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e12fc-62ee-4a17-8b5a-ae57d83e9838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:23.787369 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e12fc-62ee-4a17-8b5a-ae57d83e9838 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:23.787856 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e12fc-62ee-4a17-8b5a-ae57d83e9838 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:23.788315 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e12fc-62ee-4a17-8b5a-ae57d83e9838 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:23.806306 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 213/419] 10.222.0.76 () {58 vars in 1442 bytes} [Mon Jul 18 16:29:23 2022] PUT /identity/v3/projects/0e39050787a54caf815f78d2aa8ec514/groups/b89fc04fb72748d4a296bb4e714efcc7/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:29:23.875981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e12fc-62ee-4a17-8b5a-ae57d83e9838 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:23.877794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251e12fc-62ee-4a17-8b5a-ae57d83e9838 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:23.949154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c31e99-87b1-4917-82c1-fc60caab2ec0 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:23.950194 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c31e99-87b1-4917-82c1-fc60caab2ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:23.950736 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c31e99-87b1-4917-82c1-fc60caab2ec0 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:23.952896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 214/420] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:29:23.959660 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9165a8-263b-442b-b282-da302109cb5a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:23.959954 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9165a8-263b-442b-b282-da302109cb5a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:23.960238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9165a8-263b-442b-b282-da302109cb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:23.997467 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 207/421] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:29:23.999578 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-4e9165a8-263b-442b-b282-da302109cb5a None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:24.000831 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4e9165a8-263b-442b-b282-da302109cb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:24.003246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e12fc-62ee-4a17-8b5a-ae57d83e9838 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:24.037473 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:24.113803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251e12fc-62ee-4a17-8b5a-ae57d83e9838 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:24.115768 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 215/422] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:24.151107 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c077b-1ea0-4738-a3c1-715fc8bb6507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:24.152223 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c077b-1ea0-4738-a3c1-715fc8bb6507 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:24.152658 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c077b-1ea0-4738-a3c1-715fc8bb6507 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:24.153182 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c077b-1ea0-4738-a3c1-715fc8bb6507 None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:24.154586 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c077b-1ea0-4738-a3c1-715fc8bb6507 None admin] RBAC: Authorizing `identity:get_project(project_id=927eca8521754c2ebbb30dec8ac82458)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:24.156792 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c077b-1ea0-4738-a3c1-715fc8bb6507 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:24.159085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 208/423] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:24 2022] GET /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:24.159983 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9165a8-263b-442b-b282-da302109cb5a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:24.168161 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c077b-1ea0-4738-a3c1-715fc8bb6507 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:24.333197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9165a8-263b-442b-b282-da302109cb5a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:24.335169 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:24.354165 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:24.364994 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c077b-1ea0-4738-a3c1-715fc8bb6507 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:24.382611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ab114-464e-471d-bc61-27de0564c00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:24.383694 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab114-464e-471d-bc61-27de0564c00a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:24.384121 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab114-464e-471d-bc61-27de0564c00a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:24.384549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab114-464e-471d-bc61-27de0564c00a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:24.400287 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d1da2-ea60-47d7-beda-a9756d135ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:24.406058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d1da2-ea60-47d7-beda-a9756d135ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:24.406058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d1da2-ea60-47d7-beda-a9756d135ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:24.406058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d1da2-ea60-47d7-beda-a9756d135ea4 None admin] PATH_INFO: `/v3/groups/22b15d65b17f4abfbc24087aea9ddccb` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:24.406058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d1da2-ea60-47d7-beda-a9756d135ea4 None admin] RBAC: Authorizing `identity:get_group(group_id=22b15d65b17f4abfbc24087aea9ddccb)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:24.406323 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ab114-464e-471d-bc61-27de0564c00a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:24.406409 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d1da2-ea60-47d7-beda-a9756d135ea4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:24.417124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 209/424] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 16:29:24 2022] GET /identity/v3/groups/22b15d65b17f4abfbc24087aea9ddccb => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:24.417124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d1da2-ea60-47d7-beda-a9756d135ea4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:24.422333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-f16ab114-464e-471d-bc61-27de0564c00a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:29:24.422333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:24.422333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:24.422333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:24.422333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:24.422333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:24.422333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:24.422333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:24.422333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:24.422333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:24.422333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:24.422333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:24.422333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:24.422333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:24.422333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:24.422333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:24.423226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:24.423226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:24.423226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:24.423226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:24.423226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:24.423226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:24.423226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:24.423226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:24.423226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:24.423226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:24.423226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:24.423226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:24.423226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:24.423226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:24.423226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:24.423226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:24.424021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:24.424021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:24.424021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:24.424021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:24.424021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:24.424021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:24.424021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:24.424021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:24.424021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:24.424021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:24.424021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:29:24.424021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:24.427538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 216/425] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 16:29:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:24.432437 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ab114-464e-471d-bc61-27de0564c00a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:24.542363 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d1da2-ea60-47d7-beda-a9756d135ea4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:24.581938 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ab114-464e-471d-bc61-27de0564c00a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:24.583997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4912a5e8-3262-4367-9203-be570e7206b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:24.584561 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912a5e8-3262-4367-9203-be570e7206b5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:24.584868 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912a5e8-3262-4367-9203-be570e7206b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:24.585162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4912a5e8-3262-4367-9203-be570e7206b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:24.586443 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912a5e8-3262-4367-9203-be570e7206b5 None admin] RBAC: Adding query filter params (group.id=22b15d65b17f4abfbc24087aea9ddccb, role.id=38ab22e38dfd483dbd2f224b3088f16e, scope.project.id=927eca8521754c2ebbb30dec8ac82458) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:24.586443 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912a5e8-3262-4367-9203-be570e7206b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:24.587880 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4912a5e8-3262-4367-9203-be570e7206b5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:24.599094 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 210/426] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Jul 18 16:29:24 2022] GET /identity/v3/role_assignments?group.id=22b15d65b17f4abfbc24087aea9ddccb&scope.project.id=927eca8521754c2ebbb30dec8ac82458&role.id=38ab22e38dfd483dbd2f224b3088f16e => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:24.599094 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2696c0d-8c85-4619-8f05-1c41868059b6 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:24.599094 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2696c0d-8c85-4619-8f05-1c41868059b6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:24.599094 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2696c0d-8c85-4619-8f05-1c41868059b6 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:24.602173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 211/427] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:24.603525 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a51a2-afaf-4885-a947-f3b40b0b65ef None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:24.603819 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a51a2-afaf-4885-a947-f3b40b0b65ef None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:24.604102 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a51a2-afaf-4885-a947-f3b40b0b65ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:24.631505 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2c9a51a2-afaf-4885-a947-f3b40b0b65ef None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:24.636341 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2c9a51a2-afaf-4885-a947-f3b40b0b65ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:24.638934 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a679101-77ba-4daf-9f16-0a274ec3dbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:24.639977 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a679101-77ba-4daf-9f16-0a274ec3dbf1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:24.640468 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a679101-77ba-4daf-9f16-0a274ec3dbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:24.640940 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a679101-77ba-4daf-9f16-0a274ec3dbf1 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:24.642009 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a679101-77ba-4daf-9f16-0a274ec3dbf1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:24.642517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a679101-77ba-4daf-9f16-0a274ec3dbf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:24.644338 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a679101-77ba-4daf-9f16-0a274ec3dbf1 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:24.658792 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 217/428] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:24.660706 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a679101-77ba-4daf-9f16-0a274ec3dbf1 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:24.693475 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:24.700752 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:24.777396 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a679101-77ba-4daf-9f16-0a274ec3dbf1 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:24.814399 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 212/429] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:24.823850 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25afa1b-a759-401b-8a79-3cc185137e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:24.825328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25afa1b-a759-401b-8a79-3cc185137e4b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:24.825814 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25afa1b-a759-401b-8a79-3cc185137e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:24.826258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25afa1b-a759-401b-8a79-3cc185137e4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:24.854545 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a51a2-afaf-4885-a947-f3b40b0b65ef None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:24.921398 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25afa1b-a759-401b-8a79-3cc185137e4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:24.923017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25afa1b-a759-401b-8a79-3cc185137e4b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:24.951097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:24.986635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a51a2-afaf-4885-a947-f3b40b0b65ef None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:25.035901 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61ef30-dee9-4d1d-ab86-16905b4182eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:25.036716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61ef30-dee9-4d1d-ab86-16905b4182eb None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:25.037004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61ef30-dee9-4d1d-ab86-16905b4182eb None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:25.037310 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61ef30-dee9-4d1d-ab86-16905b4182eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:25.039006 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 218/430] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 16:29:25.045293 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25afa1b-a759-401b-8a79-3cc185137e4b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:25.051776 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61ef30-dee9-4d1d-ab86-16905b4182eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:25.063157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-ae61ef30-dee9-4d1d-ab86-16905b4182eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:29:25.063157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:25.063157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:25.063157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:25.063157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:25.063157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:25.063157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:25.063157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:25.063157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:25.063157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:25.063157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:25.063157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:25.063157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:25.063157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:25.063157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:25.063157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:25.064110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:25.064110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:25.064110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:25.064110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:25.064110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:25.064110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:25.064110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:25.064110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:25.064110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:25.064110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:25.064110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:25.064110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:25.064110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:25.064110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:25.064110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:25.064110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:25.065365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:25.065365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:25.065365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:25.065365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:25.065365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:25.065365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:25.065365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:25.065365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:25.065365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:25.065365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:25.065365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 18 16:29:25.065365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:25.065365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 213/431] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:25.070432 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61ef30-dee9-4d1d-ab86-16905b4182eb None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:25.105534 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:25.186471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25afa1b-a759-401b-8a79-3cc185137e4b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:25.216000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:25.230731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61ef30-dee9-4d1d-ab86-16905b4182eb None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:25.235111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ef627-0599-43e8-b6c9-4b8f29722465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:25.236311 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ef627-0599-43e8-b6c9-4b8f29722465 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:25.236802 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ef627-0599-43e8-b6c9-4b8f29722465 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:25.237347 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ef627-0599-43e8-b6c9-4b8f29722465 None admin] PATH_INFO: `/v3/projects/927eca8521754c2ebbb30dec8ac82458` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:25.238857 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ef627-0599-43e8-b6c9-4b8f29722465 None admin] RBAC: Authorizing `identity:get_project(project_id=927eca8521754c2ebbb30dec8ac82458)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:25.245933 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ef627-0599-43e8-b6c9-4b8f29722465 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:25.255540 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 219/432] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:25 2022] GET /identity/v3/projects/927eca8521754c2ebbb30dec8ac82458 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:25.261179 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ef627-0599-43e8-b6c9-4b8f29722465 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:25.274610 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a103d-a0d4-4a8d-9420-c05f6b8cb859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:25.275351 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a103d-a0d4-4a8d-9420-c05f6b8cb859 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:25.276217 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a103d-a0d4-4a8d-9420-c05f6b8cb859 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:25.276217 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a103d-a0d4-4a8d-9420-c05f6b8cb859 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:25.276811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a103d-a0d4-4a8d-9420-c05f6b8cb859 None admin] RBAC: Adding query filter params (name=member) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:25.277169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a103d-a0d4-4a8d-9420-c05f6b8cb859 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:25.278586 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a103d-a0d4-4a8d-9420-c05f6b8cb859 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:25.293698 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 214/433] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:29:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:25.301500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a103d-a0d4-4a8d-9420-c05f6b8cb859 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:25.407719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ef627-0599-43e8-b6c9-4b8f29722465 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:25.420639 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:25.448889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a103d-a0d4-4a8d-9420-c05f6b8cb859 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:25.473038 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981083f-3ef6-4f7b-85a1-4866d3a2f2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:25.473038 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981083f-3ef6-4f7b-85a1-4866d3a2f2d9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:25.473306 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981083f-3ef6-4f7b-85a1-4866d3a2f2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:25.473550 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981083f-3ef6-4f7b-85a1-4866d3a2f2d9 None admin] PATH_INFO: `/v3/groups/22b15d65b17f4abfbc24087aea9ddccb` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:25.475770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981083f-3ef6-4f7b-85a1-4866d3a2f2d9 None admin] RBAC: Authorizing `identity:get_group(group_id=22b15d65b17f4abfbc24087aea9ddccb)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:25.477274 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981083f-3ef6-4f7b-85a1-4866d3a2f2d9 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:25.480413 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 220/434] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 16:29:25 2022] GET /identity/v3/groups/22b15d65b17f4abfbc24087aea9ddccb => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:25.496427 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981083f-3ef6-4f7b-85a1-4866d3a2f2d9 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:25.503293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200fe83-f069-471d-a525-bbecb2fcc73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:25.504266 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200fe83-f069-471d-a525-bbecb2fcc73b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:25.505883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200fe83-f069-471d-a525-bbecb2fcc73b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:25.506726 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200fe83-f069-471d-a525-bbecb2fcc73b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:25.623866 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:25.650494 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200fe83-f069-471d-a525-bbecb2fcc73b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:25.652196 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200fe83-f069-471d-a525-bbecb2fcc73b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:25.676641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981083f-3ef6-4f7b-85a1-4866d3a2f2d9 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:25.724705 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b99f44b-2a2d-417e-9fd6-489bba012c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:25.725919 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99f44b-2a2d-417e-9fd6-489bba012c48 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:25.726302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99f44b-2a2d-417e-9fd6-489bba012c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:25.726930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b99f44b-2a2d-417e-9fd6-489bba012c48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:25.728318 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99f44b-2a2d-417e-9fd6-489bba012c48 None admin] RBAC: Adding query filter params (group.id=22b15d65b17f4abfbc24087aea9ddccb, role.id=e92acb6fd9834582bb4fd34409b37f94, scope.project.id=927eca8521754c2ebbb30dec8ac82458) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:25.728878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99f44b-2a2d-417e-9fd6-489bba012c48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:25.731197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b99f44b-2a2d-417e-9fd6-489bba012c48 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:25.741245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 221/435] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Jul 18 16:29:25 2022] GET /identity/v3/role_assignments?group.id=22b15d65b17f4abfbc24087aea9ddccb&scope.project.id=927eca8521754c2ebbb30dec8ac82458&role.id=e92acb6fd9834582bb4fd34409b37f94 => generated 611 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:25.742718 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a6378-f1bf-4707-b920-eea97ba244df None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:25.743084 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a6378-f1bf-4707-b920-eea97ba244df None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:25.743436 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a6378-f1bf-4707-b920-eea97ba244df None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:25.744860 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 222/436] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:25.752867 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1dd4-9a65-4482-b0fc-0adb52998b0e None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:25.753402 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1dd4-9a65-4482-b0fc-0adb52998b0e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:25.753854 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848f1dd4-9a65-4482-b0fc-0adb52998b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:25.776162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-848f1dd4-9a65-4482-b0fc-0adb52998b0e None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:25.777636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-848f1dd4-9a65-4482-b0fc-0adb52998b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:25.779848 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:25.809514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 215/437] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:29:25.811403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200fe83-f069-471d-a525-bbecb2fcc73b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:25.885187 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 223/438] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:25.915818 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f1dd4-9a65-4482-b0fc-0adb52998b0e None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:25.946932 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200fe83-f069-471d-a525-bbecb2fcc73b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:25.990843 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:25.995372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72930a-21e4-4597-ae9c-ceeaa05702b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:25.996251 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72930a-21e4-4597-ae9c-ceeaa05702b9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:25.996827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72930a-21e4-4597-ae9c-ceeaa05702b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:25.997101 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72930a-21e4-4597-ae9c-ceeaa05702b9 None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:25.998317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72930a-21e4-4597-ae9c-ceeaa05702b9 None admin] RBAC: Authorizing `identity:get_project(project_id=fe62d682160e40e48208c627043f6ee5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:26.016476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72930a-21e4-4597-ae9c-ceeaa05702b9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:26.016476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 216/439] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:25 2022] GET /identity/v3/projects/fe62d682160e40e48208c627043f6ee5 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:26.016476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72930a-21e4-4597-ae9c-ceeaa05702b9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:26.049882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848f1dd4-9a65-4482-b0fc-0adb52998b0e None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:26.065446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:26.099571 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168467e-2086-4503-9297-bc776fda4d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:26.100579 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168467e-2086-4503-9297-bc776fda4d6f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:26.100876 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168467e-2086-4503-9297-bc776fda4d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:26.101251 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7168467e-2086-4503-9297-bc776fda4d6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:26.117690 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7168467e-2086-4503-9297-bc776fda4d6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:26.124707 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72930a-21e4-4597-ae9c-ceeaa05702b9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:26.129229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-7168467e-2086-4503-9297-bc776fda4d6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:29:26.129229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:26.129229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:26.129229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:26.129229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:26.129229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:26.129229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:26.129229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:26.129229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:26.129229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:26.129229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:26.129229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:26.129229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:26.129229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:26.129229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:26.129229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:26.130140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:26.130140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:26.130140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:26.130140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:26.130140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:26.130140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:26.130140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:26.130140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:26.130140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:26.130140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:26.130140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:26.130140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:26.130140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:26.130140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:26.130140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:26.130140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:26.131044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:26.131044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:26.131044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:26.131044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:26.131044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:26.131044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:26.131044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:26.131044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:26.131044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:26.131044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:26.131044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:29:26.131044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:26.131044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 224/440] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 16:29:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:26.137242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168467e-2086-4503-9297-bc776fda4d6f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:26.172647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d238c-21db-4e64-a65f-2d94d959bc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:26.173182 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d238c-21db-4e64-a65f-2d94d959bc10 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:26.173378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d238c-21db-4e64-a65f-2d94d959bc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:26.173655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655d238c-21db-4e64-a65f-2d94d959bc10 None admin] PATH_INFO: `/v3/groups/22b15d65b17f4abfbc24087aea9ddccb` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:26.174966 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d238c-21db-4e64-a65f-2d94d959bc10 None admin] RBAC: Authorizing `identity:get_group(group_id=22b15d65b17f4abfbc24087aea9ddccb)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:26.176566 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655d238c-21db-4e64-a65f-2d94d959bc10 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:26.178562 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 217/441] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 16:29:26 2022] GET /identity/v3/groups/22b15d65b17f4abfbc24087aea9ddccb => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:26.184425 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d238c-21db-4e64-a65f-2d94d959bc10 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:26.283995 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7168467e-2086-4503-9297-bc776fda4d6f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:26.300669 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:26.305285 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655d238c-21db-4e64-a65f-2d94d959bc10 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:26.322277 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ea162-79df-49b6-a0ef-7f3f1702e1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:26.322793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:26.323892 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ea162-79df-49b6-a0ef-7f3f1702e1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:26.324178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ea162-79df-49b6-a0ef-7f3f1702e1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:26.324460 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ea162-79df-49b6-a0ef-7f3f1702e1a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:26.325238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ea162-79df-49b6-a0ef-7f3f1702e1a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:26.325553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ea162-79df-49b6-a0ef-7f3f1702e1a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:26.326998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ea162-79df-49b6-a0ef-7f3f1702e1a3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:26.337820 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 225/442] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:26.340902 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a46a5-9094-4a3c-b314-588900fe3bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:26.341639 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a46a5-9094-4a3c-b314-588900fe3bec None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:26.341918 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a46a5-9094-4a3c-b314-588900fe3bec None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:26.342512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a46a5-9094-4a3c-b314-588900fe3bec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:26.343734 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ea162-79df-49b6-a0ef-7f3f1702e1a3 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:26.344372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a46a5-9094-4a3c-b314-588900fe3bec None admin] RBAC: Adding query filter params (group.id=22b15d65b17f4abfbc24087aea9ddccb, role.id=38ab22e38dfd483dbd2f224b3088f16e, scope.project.id=fe62d682160e40e48208c627043f6ee5) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:26.344685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a46a5-9094-4a3c-b314-588900fe3bec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:26.346283 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a46a5-9094-4a3c-b314-588900fe3bec None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:26.365061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 218/443] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Jul 18 16:29:26 2022] GET /identity/v3/role_assignments?group.id=22b15d65b17f4abfbc24087aea9ddccb&scope.project.id=fe62d682160e40e48208c627043f6ee5&role.id=38ab22e38dfd483dbd2f224b3088f16e => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:26.384465 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce81124-faa0-47b9-9ac8-c66721fa06a8 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:26.384756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce81124-faa0-47b9-9ac8-c66721fa06a8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:26.385066 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce81124-faa0-47b9-9ac8-c66721fa06a8 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:26.386647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 219/444] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:29:26.393429 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46979f75-cdc6-4039-8180-b044de0efacf None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:26.393744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46979f75-cdc6-4039-8180-b044de0efacf None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:26.394000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46979f75-cdc6-4039-8180-b044de0efacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:26.412675 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-46979f75-cdc6-4039-8180-b044de0efacf None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:26.414051 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-46979f75-cdc6-4039-8180-b044de0efacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:26.460891 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ea162-79df-49b6-a0ef-7f3f1702e1a3 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:26.497430 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 220/445] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:26.502855 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cd8c7-d5be-4f77-a9d6-dceb67da2e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:26.503531 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cd8c7-d5be-4f77-a9d6-dceb67da2e45 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:26.503815 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cd8c7-d5be-4f77-a9d6-dceb67da2e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:26.504090 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cd8c7-d5be-4f77-a9d6-dceb67da2e45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:26.523810 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46979f75-cdc6-4039-8180-b044de0efacf None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:26.560506 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:26.589004 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9cd8c7-d5be-4f77-a9d6-dceb67da2e45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:26.590501 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9cd8c7-d5be-4f77-a9d6-dceb67da2e45 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:26.651540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46979f75-cdc6-4039-8180-b044de0efacf None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:26.666830 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:26.695941 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba88cf-2bbf-4406-9404-69f4ec0a8ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:26.697246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba88cf-2bbf-4406-9404-69f4ec0a8ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:26.697599 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba88cf-2bbf-4406-9404-69f4ec0a8ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:26.697884 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba88cf-2bbf-4406-9404-69f4ec0a8ea8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:26.709046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 226/446] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 16:29:26.714404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cd8c7-d5be-4f77-a9d6-dceb67da2e45 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:26.714684 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba88cf-2bbf-4406-9404-69f4ec0a8ea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:26.722688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-acba88cf-2bbf-4406-9404-69f4ec0a8ea8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:26.722688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:26.722688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:26.722688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:26.722688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:26.722688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:26.722688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:26.722688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:26.722688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:26.722688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:26.722688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:26.722688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:26.722688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:26.722688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:26.722688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:26.722688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:26.723664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:26.723664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:26.723664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:26.723664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:26.723664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:26.723664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:26.723664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:26.723664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:26.723664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:26.723664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:26.723664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:26.723664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:26.723664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:26.723664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:26.723664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:26.723664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:26.724578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:26.724578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:26.724578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:26.724578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:26.724578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:26.724578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:26.724578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:26.724578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:26.724578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:26.724578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:26.724578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:26.724578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:26.724578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 221/447] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:29:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:26.731178 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba88cf-2bbf-4406-9404-69f4ec0a8ea8 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:26.798169 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:26.820809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cd8c7-d5be-4f77-a9d6-dceb67da2e45 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:26.848019 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba88cf-2bbf-4406-9404-69f4ec0a8ea8 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:26.855176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdc2bb-6cc9-4814-8cec-bd13ebeb675d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:26.856038 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdc2bb-6cc9-4814-8cec-bd13ebeb675d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:26.856320 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdc2bb-6cc9-4814-8cec-bd13ebeb675d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:26.856591 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdc2bb-6cc9-4814-8cec-bd13ebeb675d None admin] PATH_INFO: `/v3/projects/fe62d682160e40e48208c627043f6ee5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:26.857790 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdc2bb-6cc9-4814-8cec-bd13ebeb675d None admin] RBAC: Authorizing `identity:get_project(project_id=fe62d682160e40e48208c627043f6ee5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:26.859915 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abdc2bb-6cc9-4814-8cec-bd13ebeb675d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:26.862053 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 227/448] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:26 2022] GET /identity/v3/projects/fe62d682160e40e48208c627043f6ee5 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:26.867561 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdc2bb-6cc9-4814-8cec-bd13ebeb675d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:26.885589 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1886799-99fa-4da4-9ab4-31b0b58db4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:26.886585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1886799-99fa-4da4-9ab4-31b0b58db4ee None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:26.887007 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1886799-99fa-4da4-9ab4-31b0b58db4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:26.887367 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1886799-99fa-4da4-9ab4-31b0b58db4ee None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:26.888282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1886799-99fa-4da4-9ab4-31b0b58db4ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:26.888842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1886799-99fa-4da4-9ab4-31b0b58db4ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:26.890409 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1886799-99fa-4da4-9ab4-31b0b58db4ee None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:26.899627 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 222/449] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:26.905718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1886799-99fa-4da4-9ab4-31b0b58db4ee None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:26.940322 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:26.971313 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdc2bb-6cc9-4814-8cec-bd13ebeb675d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:27.006609 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1886799-99fa-4da4-9ab4-31b0b58db4ee None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:27.007097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bdd7c-661e-4cd5-87d7-2b2d9c7d240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:27.007968 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bdd7c-661e-4cd5-87d7-2b2d9c7d240f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:27.008251 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bdd7c-661e-4cd5-87d7-2b2d9c7d240f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:27.008526 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5bdd7c-661e-4cd5-87d7-2b2d9c7d240f None admin] PATH_INFO: `/v3/groups/22b15d65b17f4abfbc24087aea9ddccb` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:27.009736 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bdd7c-661e-4cd5-87d7-2b2d9c7d240f None admin] RBAC: Authorizing `identity:get_group(group_id=22b15d65b17f4abfbc24087aea9ddccb)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:27.011175 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5bdd7c-661e-4cd5-87d7-2b2d9c7d240f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:27.012818 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 228/450] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 16:29:26 2022] GET /identity/v3/groups/22b15d65b17f4abfbc24087aea9ddccb => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:27.018833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bdd7c-661e-4cd5-87d7-2b2d9c7d240f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:27.033429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:27.041593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a7cd5-b192-485e-b426-e58613f94db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:27.042251 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a7cd5-b192-485e-b426-e58613f94db4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:27.050182 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a7cd5-b192-485e-b426-e58613f94db4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:27.050182 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a7cd5-b192-485e-b426-e58613f94db4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:27.112351 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a7cd5-b192-485e-b426-e58613f94db4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:27.113771 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a7cd5-b192-485e-b426-e58613f94db4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:27.119778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5bdd7c-661e-4cd5-87d7-2b2d9c7d240f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:27.147268 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:27.158793 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3b501-9fdd-41ae-acdd-dd2feacbd158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:27.159465 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3b501-9fdd-41ae-acdd-dd2feacbd158 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:27.159752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3b501-9fdd-41ae-acdd-dd2feacbd158 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:27.160041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3b501-9fdd-41ae-acdd-dd2feacbd158 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:27.160885 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3b501-9fdd-41ae-acdd-dd2feacbd158 None admin] RBAC: Adding query filter params (group.id=22b15d65b17f4abfbc24087aea9ddccb, role.id=e92acb6fd9834582bb4fd34409b37f94, scope.project.id=fe62d682160e40e48208c627043f6ee5) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:27.161233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3b501-9fdd-41ae-acdd-dd2feacbd158 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:27.162683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3b501-9fdd-41ae-acdd-dd2feacbd158 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:27.169467 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 229/451] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Jul 18 16:29:27 2022] GET /identity/v3/role_assignments?group.id=22b15d65b17f4abfbc24087aea9ddccb&scope.project.id=fe62d682160e40e48208c627043f6ee5&role.id=e92acb6fd9834582bb4fd34409b37f94 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:27.222858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 223/452] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 18 16:29:27.228915 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3b501-9fdd-41ae-acdd-dd2feacbd158 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:27.313144 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:27.340869 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3b501-9fdd-41ae-acdd-dd2feacbd158 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:27.376695 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899d0ba-b03e-4f5b-b15e-849b32b4a1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:27.377523 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899d0ba-b03e-4f5b-b15e-849b32b4a1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:27.377811 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899d0ba-b03e-4f5b-b15e-849b32b4a1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:27.378085 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899d0ba-b03e-4f5b-b15e-849b32b4a1f5 None admin] PATH_INFO: `/v3/projects/0e39050787a54caf815f78d2aa8ec514` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:27.379277 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899d0ba-b03e-4f5b-b15e-849b32b4a1f5 None admin] RBAC: Authorizing `identity:get_project(project_id=0e39050787a54caf815f78d2aa8ec514)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:27.380722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899d0ba-b03e-4f5b-b15e-849b32b4a1f5 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:27.382449 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 230/453] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:29:27 2022] GET /identity/v3/projects/0e39050787a54caf815f78d2aa8ec514 => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:27.388163 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a7cd5-b192-485e-b426-e58613f94db4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:27.492336 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a7cd5-b192-485e-b426-e58613f94db4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:27.526437 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2ec81-8672-4648-880f-497dd54acf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:27.527305 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2ec81-8672-4648-880f-497dd54acf75 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:27.527589 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2ec81-8672-4648-880f-497dd54acf75 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:27.527867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2ec81-8672-4648-880f-497dd54acf75 None admin] PATH_INFO: `/v3/groups/b89fc04fb72748d4a296bb4e714efcc7` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:27.529114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2ec81-8672-4648-880f-497dd54acf75 None admin] RBAC: Authorizing `identity:get_group(group_id=b89fc04fb72748d4a296bb4e714efcc7)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:27.531110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc2ec81-8672-4648-880f-497dd54acf75 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:27.532759 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 224/454] 10.222.0.76 () {56 vars in 1180 bytes} [Mon Jul 18 16:29:27 2022] GET /identity/v3/groups/b89fc04fb72748d4a296bb4e714efcc7 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:27.538636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899d0ba-b03e-4f5b-b15e-849b32b4a1f5 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:27.638111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899d0ba-b03e-4f5b-b15e-849b32b4a1f5 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:27.671501 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc1860-1369-41b3-beb0-d3e9bc8c7aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:27.672162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc1860-1369-41b3-beb0-d3e9bc8c7aab None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:27.672450 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc1860-1369-41b3-beb0-d3e9bc8c7aab None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:27.672726 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc1860-1369-41b3-beb0-d3e9bc8c7aab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:27.673585 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc1860-1369-41b3-beb0-d3e9bc8c7aab None admin] RBAC: Adding query filter params (group.id=b89fc04fb72748d4a296bb4e714efcc7, role.id=c2d5d80485df4730903a874937d68aa3, scope.project.id=0e39050787a54caf815f78d2aa8ec514) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:27.673897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc1860-1369-41b3-beb0-d3e9bc8c7aab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:27.675331 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc1860-1369-41b3-beb0-d3e9bc8c7aab None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:27.681154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 231/455] 10.222.0.76 () {56 vars in 1376 bytes} [Mon Jul 18 16:29:27 2022] GET /identity/v3/role_assignments?group.id=b89fc04fb72748d4a296bb4e714efcc7&scope.project.id=0e39050787a54caf815f78d2aa8ec514&role.id=c2d5d80485df4730903a874937d68aa3 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:30.196859 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cfcc8-3ed1-4f92-815b-3090bd5931d1 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:30.197840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cfcc8-3ed1-4f92-815b-3090bd5931d1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:30.198321 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011cfcc8-3ed1-4f92-815b-3090bd5931d1 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:30.200204 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 225/456] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:30.206049 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e8ea9-801f-4f2b-8ef2-e4b3c0ca91ab None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:30.206487 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e8ea9-801f-4f2b-8ef2-e4b3c0ca91ab None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:30.206589 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e8ea9-801f-4f2b-8ef2-e4b3c0ca91ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:30.229093 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-745e8ea9-801f-4f2b-8ef2-e4b3c0ca91ab None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:30.230291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-745e8ea9-801f-4f2b-8ef2-e4b3c0ca91ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:30.232339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:30.321402 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 232/457] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:30.346332 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011cfcc8-3ed1-4f92-815b-3090bd5931d1 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:30.349637 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:30.527050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011cfcc8-3ed1-4f92-815b-3090bd5931d1 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:30.576151 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20795b32-c468-4e70-9193-14233cecc6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:30.577979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20795b32-c468-4e70-9193-14233cecc6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:30.578415 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20795b32-c468-4e70-9193-14233cecc6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:30.578837 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20795b32-c468-4e70-9193-14233cecc6a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:30.594555 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20795b32-c468-4e70-9193-14233cecc6a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:30.596294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20795b32-c468-4e70-9193-14233cecc6a6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:30.624827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-20795b32-c468-4e70-9193-14233cecc6a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:30.624827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:30.624827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:30.624827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:30.624827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:30.624827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:30.624827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:30.624827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:30.624827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:30.624827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:30.624827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:30.624827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:30.624827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:30.624827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:30.624827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:30.625945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:30.625945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:30.625945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:30.625945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:30.625945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:30.625945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:30.625945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:30.625945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:30.625945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:30.625945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:30.625945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:30.625945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:30.625945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:30.625945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:30.625945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:30.625945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:30.625945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:30.627028 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:30.627028 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:30.627028 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:30.627028 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:30.629083 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 226/458] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:30.636024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e8ea9-801f-4f2b-8ef2-e4b3c0ca91ab None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:30.695900 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bd764-369d-4d62-92be-6a7cb1dfabb0 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:30.696211 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bd764-369d-4d62-92be-6a7cb1dfabb0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:30.696465 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bd764-369d-4d62-92be-6a7cb1dfabb0 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:30.697881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 227/459] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:29:30.704533 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfe181-c4df-46bc-9871-1884c245e50d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:30.704825 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfe181-c4df-46bc-9871-1884c245e50d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:30.705131 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cfe181-c4df-46bc-9871-1884c245e50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:30.735595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-31cfe181-c4df-46bc-9871-1884c245e50d None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:30.737833 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-31cfe181-c4df-46bc-9871-1884c245e50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:30.807107 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e8ea9-801f-4f2b-8ef2-e4b3c0ca91ab None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:30.810449 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 228/460] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:30.817032 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892d366-c34b-468d-b85d-9c2751944787 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:30.817616 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892d366-c34b-468d-b85d-9c2751944787 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:30.818044 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892d366-c34b-468d-b85d-9c2751944787 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:30.819600 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 229/461] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:30.821850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:30.825257 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb11618-3c8b-4429-81a3-bd46b0f5e59f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:30.825694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb11618-3c8b-4429-81a3-bd46b0f5e59f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:30.826145 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb11618-3c8b-4429-81a3-bd46b0f5e59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:30.846925 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110db61-c687-4215-a732-c0fde29e4d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:30.847969 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110db61-c687-4215-a732-c0fde29e4d64 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:30.848500 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110db61-c687-4215-a732-c0fde29e4d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:30.849097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4110db61-c687-4215-a732-c0fde29e4d64 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:30.850047 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110db61-c687-4215-a732-c0fde29e4d64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:30.850598 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110db61-c687-4215-a732-c0fde29e4d64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:30.852216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4110db61-c687-4215-a732-c0fde29e4d64 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:30.860358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:30.865002 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4fb11618-3c8b-4429-81a3-bd46b0f5e59f None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:30.866401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4fb11618-3c8b-4429-81a3-bd46b0f5e59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:30.870522 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 233/462] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:30.871748 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110db61-c687-4215-a732-c0fde29e4d64 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:30.949108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 230/463] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:30.950210 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb11618-3c8b-4429-81a3-bd46b0f5e59f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:30.995561 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4110db61-c687-4215-a732-c0fde29e4d64 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:31.032138 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03df34-b18e-4263-8faa-f3013e1342bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:31.032946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03df34-b18e-4263-8faa-f3013e1342bd None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:31.033273 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03df34-b18e-4263-8faa-f3013e1342bd None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:31.033558 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03df34-b18e-4263-8faa-f3013e1342bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:31.045132 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03df34-b18e-4263-8faa-f3013e1342bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:31.046682 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03df34-b18e-4263-8faa-f3013e1342bd None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:31.059638 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb11618-3c8b-4429-81a3-bd46b0f5e59f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:31.066341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-4c03df34-b18e-4263-8faa-f3013e1342bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:31.066341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:31.066341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:31.066341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:31.066341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:31.066341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:31.066341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:31.066341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:31.066341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:31.066341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:31.066341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:31.066341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:31.066341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:31.066341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:31.066341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:31.067247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:31.067247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:31.067247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:31.067247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:31.067247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:31.067247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:31.067247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:31.067247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:31.067247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:31.067247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:31.067247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:31.067247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:31.067247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:31.067247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:31.067247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:31.067247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:31.067247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:31.068207 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:31.068207 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:31.068207 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:31.068207 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:31.068207 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 234/464] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:31.068526 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03df34-b18e-4263-8faa-f3013e1342bd None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:31.080993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:31.102641 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca81860-efc1-4fbf-a301-97cb1a1ba28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:31.103563 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca81860-efc1-4fbf-a301-97cb1a1ba28c None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:31.104000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca81860-efc1-4fbf-a301-97cb1a1ba28c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:31.104472 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca81860-efc1-4fbf-a301-97cb1a1ba28c None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:31.105699 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca81860-efc1-4fbf-a301-97cb1a1ba28c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:31.107068 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca81860-efc1-4fbf-a301-97cb1a1ba28c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:31.125801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:31.179138 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03df34-b18e-4263-8faa-f3013e1342bd None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:31.212813 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88831f-bd04-4c95-957f-9a8dc860fbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:31.213659 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88831f-bd04-4c95-957f-9a8dc860fbc3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:31.213928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88831f-bd04-4c95-957f-9a8dc860fbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:31.214208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88831f-bd04-4c95-957f-9a8dc860fbc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:31.225466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 231/465] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 16:29:30 2022] POST /identity/v3/users => generated 246 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:29:31.225466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da47b9-cb98-4482-9f78-a3b854f255ab None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:31.225466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da47b9-cb98-4482-9f78-a3b854f255ab None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:31.225466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da47b9-cb98-4482-9f78-a3b854f255ab None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:31.225466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 232/466] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:31.225466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da47b9-cb98-4482-9f78-a3b854f255ab None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:31.232196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88831f-bd04-4c95-957f-9a8dc860fbc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:31.233850 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88831f-bd04-4c95-957f-9a8dc860fbc3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:31.254058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-7b88831f-bd04-4c95-957f-9a8dc860fbc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:31.254058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:31.254058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:31.254058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:31.254058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:31.254058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:31.254058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:31.254058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:31.254058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:31.254058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:31.254058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:31.254058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:31.254058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:31.254058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:31.254058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:31.255021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:31.255021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:31.255021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:31.255021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:31.255021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:31.255021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:31.255021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:31.255021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:31.255021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:31.255021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:31.255021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:31.255021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:31.255021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:31.255021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:31.255021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:31.255021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:31.255021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:31.255907 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:31.255907 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:31.255907 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:31.255907 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:31.255907 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 235/467] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:31.257087 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5daee9-9f1b-4525-ab8d-e3ed52dcdc5d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:31.257422 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5daee9-9f1b-4525-ab8d-e3ed52dcdc5d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:31.257681 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5daee9-9f1b-4525-ab8d-e3ed52dcdc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:31.280267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-6a5daee9-9f1b-4525-ab8d-e3ed52dcdc5d None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:31.281812 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6a5daee9-9f1b-4525-ab8d-e3ed52dcdc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:31.373620 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 236/468] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:31.374995 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5daee9-9f1b-4525-ab8d-e3ed52dcdc5d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:31.379770 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da47b9-cb98-4482-9f78-a3b854f255ab None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:31.424479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76b300-1ead-4df2-b03f-b5aa3e7ebf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:31.425190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76b300-1ead-4df2-b03f-b5aa3e7ebf49 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:31.425517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:31.425659 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76b300-1ead-4df2-b03f-b5aa3e7ebf49 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:31.425797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d76b300-1ead-4df2-b03f-b5aa3e7ebf49 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:31.427043 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76b300-1ead-4df2-b03f-b5aa3e7ebf49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:31.427586 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76b300-1ead-4df2-b03f-b5aa3e7ebf49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:31.429996 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d76b300-1ead-4df2-b03f-b5aa3e7ebf49 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:31.444642 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 233/469] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:31.445565 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76b300-1ead-4df2-b03f-b5aa3e7ebf49 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:31.483378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:31.516531 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5daee9-9f1b-4525-ab8d-e3ed52dcdc5d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:31.554749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ab2c92-cbeb-4e09-9ca7-48b7558c333b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:31.555439 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab2c92-cbeb-4e09-9ca7-48b7558c333b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:31.555726 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab2c92-cbeb-4e09-9ca7-48b7558c333b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:31.556003 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ab2c92-cbeb-4e09-9ca7-48b7558c333b None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:31.556731 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab2c92-cbeb-4e09-9ca7-48b7558c333b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:31.557185 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab2c92-cbeb-4e09-9ca7-48b7558c333b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:31.558715 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ab2c92-cbeb-4e09-9ca7-48b7558c333b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:31.560460 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d76b300-1ead-4df2-b03f-b5aa3e7ebf49 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:31.576557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 237/470] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:31.576557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e36b0-188d-4c5c-bf80-182f274e04ed None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:31.576557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e36b0-188d-4c5c-bf80-182f274e04ed None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:31.576557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e36b0-188d-4c5c-bf80-182f274e04ed None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:31.576557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 238/471] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:31.576557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e36b0-188d-4c5c-bf80-182f274e04ed None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:31.604368 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8b8da-b5f8-4c29-b9b8-c30bfa162453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:31.605199 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8b8da-b5f8-4c29-b9b8-c30bfa162453 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:31.605481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8b8da-b5f8-4c29-b9b8-c30bfa162453 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:31.605766 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8b8da-b5f8-4c29-b9b8-c30bfa162453 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:31.616438 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8b8da-b5f8-4c29-b9b8-c30bfa162453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:31.617937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8b8da-b5f8-4c29-b9b8-c30bfa162453 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:31.636426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-81e8b8da-b5f8-4c29-b9b8-c30bfa162453 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:31.636426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:31.636426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:31.636426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:31.636426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:31.636426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:31.636426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:31.636426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:31.636426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:31.636426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:31.636426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:31.636426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:31.636426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:31.636426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:31.636426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:31.637435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:31.637435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:31.637435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:31.637435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:31.637435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:31.637435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:31.637435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:31.637435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:31.637435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:31.637435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:31.637435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:31.637435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:31.637435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:31.637435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:31.637435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:31.637435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:31.637435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:31.638319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:31.638319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:31.638319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:31.638319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:31.638319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 234/472] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:31.638584 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8b8da-b5f8-4c29-b9b8-c30bfa162453 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:31.684814 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:31.695733 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e36b0-188d-4c5c-bf80-182f274e04ed None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:31.734966 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a029952-35e7-4520-9399-c1212a127184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:31.735701 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a029952-35e7-4520-9399-c1212a127184 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:31.735944 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a029952-35e7-4520-9399-c1212a127184 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:31.736055 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:31.736236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a029952-35e7-4520-9399-c1212a127184 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:31.736950 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a029952-35e7-4520-9399-c1212a127184 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:31.738428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a029952-35e7-4520-9399-c1212a127184 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:31.757497 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8b8da-b5f8-4c29-b9b8-c30bfa162453 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:31.797090 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ac2f8-1c23-42ce-a820-529b6fbd84d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:31.797611 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ac2f8-1c23-42ce-a820-529b6fbd84d8 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:31.797899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ac2f8-1c23-42ce-a820-529b6fbd84d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:31.798175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ac2f8-1c23-42ce-a820-529b6fbd84d8 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:31.798906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ac2f8-1c23-42ce-a820-529b6fbd84d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:31.800359 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ac2f8-1c23-42ce-a820-529b6fbd84d8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:31.864209 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 239/473] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 16:29:31 2022] POST /identity/v3/users => generated 248 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:29:31.875274 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de33bd-776a-470f-8920-c05f5d23c436 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:31.875565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de33bd-776a-470f-8920-c05f5d23c436 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:31.875847 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de33bd-776a-470f-8920-c05f5d23c436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:31.901737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 235/474] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 16:29:31 2022] POST /identity/v3/users => generated 248 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:29:31.902677 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ac2f8-1c23-42ce-a820-529b6fbd84d8 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:31.903078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-81de33bd-776a-470f-8920-c05f5d23c436 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:31.904572 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-81de33bd-776a-470f-8920-c05f5d23c436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:32.065174 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 240/475] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:32.094365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de33bd-776a-470f-8920-c05f5d23c436 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:32.119750 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ac2f8-1c23-42ce-a820-529b6fbd84d8 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:32.166380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61212a7b-7e20-416d-83d9-472521cf2492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:32.166979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61212a7b-7e20-416d-83d9-472521cf2492 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:32.167265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61212a7b-7e20-416d-83d9-472521cf2492 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:32.167879 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61212a7b-7e20-416d-83d9-472521cf2492 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:32.168651 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61212a7b-7e20-416d-83d9-472521cf2492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:32.168962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61212a7b-7e20-416d-83d9-472521cf2492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:32.170994 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61212a7b-7e20-416d-83d9-472521cf2492 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:32.181401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:32.193072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 236/476] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:32.197282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61212a7b-7e20-416d-83d9-472521cf2492 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:32.215907 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:32.266416 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de33bd-776a-470f-8920-c05f5d23c436 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:32.305428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7e15e-f862-43d0-b9bb-4c74c4919adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:32.306561 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7e15e-f862-43d0-b9bb-4c74c4919adf None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:32.307244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7e15e-f862-43d0-b9bb-4c74c4919adf None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:32.307964 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e7e15e-f862-43d0-b9bb-4c74c4919adf None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:32.309831 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7e15e-f862-43d0-b9bb-4c74c4919adf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:32.312789 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e7e15e-f862-43d0-b9bb-4c74c4919adf None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:32.335174 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61212a7b-7e20-416d-83d9-472521cf2492 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:32.357666 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.sql.core [None req-20e7e15e-f862-43d0-b9bb-4c74c4919adf None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 16:29:32.357666 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 18 16:29:32.357666 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [parameters: {'id': '13c44ff112f844ff8694d70f120f00c1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 18 16:29:32.357666 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80507) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 16:29:32.381089 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8dd43-98ed-4452-bae2-559ea11158ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:32.382208 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8dd43-98ed-4452-bae2-559ea11158ea None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:32.382507 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8dd43-98ed-4452-bae2-559ea11158ea None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:32.382786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8dd43-98ed-4452-bae2-559ea11158ea None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:32.383561 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8dd43-98ed-4452-bae2-559ea11158ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:32.385237 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8dd43-98ed-4452-bae2-559ea11158ea None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:32.394017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-20e7e15e-f862-43d0-b9bb-4c74c4919adf None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 18 16:29:32.394017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:32.394017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 16:29:32.394017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 16:29:32.394017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 16:29:32.394017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 16:29:32.394017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 16:29:32.394017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 16:29:32.394017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 16:29:32.394017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application conn.query(q) Jul 18 16:29:32.394017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 16:29:32.394017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 16:29:32.394017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 16:29:32.394017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application result.read() Jul 18 16:29:32.394017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 16:29:32.401466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 16:29:32.401466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 16:29:32.401466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 16:29:32.401466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 16:29:32.401466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 16:29:32.401466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 16:29:32.401466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 16:29:32.401466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 16:29:32.401466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:32.401466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 16:29:32.401466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:32.401466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:32.401466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 16:29:32.401466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 16:29:32.401466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 18 16:29:32.401466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return ref.to_dict() Jul 18 16:29:32.401466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 16:29:32.401466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application next(self.gen) Jul 18 16:29:32.402474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 16:29:32.402474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application yield resource Jul 18 16:29:32.402474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 16:29:32.402474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application next(self.gen) Jul 18 16:29:32.402474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 16:29:32.402474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 16:29:32.402474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 16:29:32.402474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 16:29:32.402474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 16:29:32.402474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise self.value Jul 18 16:29:32.402474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 16:29:32.402474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 16:29:32.402474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 16:29:32.402474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application session.commit() Jul 18 16:29:32.402474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 16:29:32.402474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 16:29:32.402474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 16:29:32.403341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 16:29:32.403341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 16:29:32.403341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.session.flush() Jul 18 16:29:32.403341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 16:29:32.403341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 16:29:32.403341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 16:29:32.403341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 16:29:32.403341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 16:29:32.403341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application compat.raise_( Jul 18 16:29:32.403341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 16:29:32.403341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception Jul 18 16:29:32.403341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 16:29:32.403341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 16:29:32.403341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 16:29:32.403341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 16:29:32.403341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 16:29:32.403341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 16:29:32.404255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 16:29:32.404255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 16:29:32.404255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 18 16:29:32.404255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 18 16:29:32.404255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 16:29:32.404255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 16:29:32.404255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 16:29:32.404255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 16:29:32.404255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 16:29:32.404255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 16:29:32.404255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 16:29:32.404255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 16:29:32.404255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 16:29:32.404255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 16:29:32.404255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 16:29:32.404255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception Jul 18 16:29:32.407196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 16:29:32.407196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 16:29:32.407196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 16:29:32.407196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 16:29:32.407196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 16:29:32.407196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 16:29:32.407196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 16:29:32.407196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application conn.query(q) Jul 18 16:29:32.407196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 16:29:32.407196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 16:29:32.407196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 16:29:32.407196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application result.read() Jul 18 16:29:32.407196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 16:29:32.407196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 16:29:32.407196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 16:29:32.407196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 16:29:32.409161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 16:29:32.409161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 16:29:32.409161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 16:29:32.409161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 16:29:32.409161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 18 16:29:32.409161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 18 16:29:32.409161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [parameters: {'id': '13c44ff112f844ff8694d70f120f00c1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 18 16:29:32.409161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 16:29:32.409161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:32.409161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:29:32.409161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:32.409161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:32.409161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:32.409161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:32.409161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:32.409161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:32.412158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:32.412158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:32.412158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:32.412158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:32.412158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:32.412158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:32.412158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 18 16:29:32.412158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 18 16:29:32.412158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:32.412158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:32.412158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 18 16:29:32.412158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 18 16:29:32.412158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 16:29:32.412158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 16:29:32.412158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 18 16:29:32.412158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:32.414162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 241/477] 10.222.0.76 () {60 vars in 1131 bytes} [Mon Jul 18 16:29:32 2022] POST /identity/v3/roles => generated 144 bytes in 303 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:32.414162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7e15e-f862-43d0-b9bb-4c74c4919adf None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:32.504285 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 237/478] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 16:29:32 2022] POST /identity/v3/users => generated 249 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:29:32.535058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e7e15e-f862-43d0-b9bb-4c74c4919adf None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:32.574141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98265270-5158-423d-95b1-b1ee501db769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:32.574976 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98265270-5158-423d-95b1-b1ee501db769 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:32.575261 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98265270-5158-423d-95b1-b1ee501db769 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:32.575540 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98265270-5158-423d-95b1-b1ee501db769 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:32.588287 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98265270-5158-423d-95b1-b1ee501db769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:32.596886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-98265270-5158-423d-95b1-b1ee501db769 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:29:32.596886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:32.596886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:32.596886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:32.596886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:32.596886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:32.596886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:32.596886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:32.596886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:32.596886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:32.596886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:32.596886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:32.596886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:32.596886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:32.596886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:32.596886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:32.599089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:32.599089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:32.599089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:32.599089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:32.599089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:32.599089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:32.599089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:32.599089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:32.599089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:32.599089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:32.599089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:32.599089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:32.599089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:32.599089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:32.599089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:32.599089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:32.601023 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:32.601023 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:32.601023 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:32.601023 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:32.601023 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:32.601023 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:32.601023 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:32.601023 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:32.601023 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:32.601023 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:32.601023 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 18 16:29:32.601023 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:32.601023 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 242/479] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 16:29:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:32.608668 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8dd43-98ed-4452-bae2-559ea11158ea None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:32.695033 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:32.808519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8dd43-98ed-4452-bae2-559ea11158ea None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:32.851260 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc18785-020d-4902-b4b4-04d3c0e09a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:32.851942 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc18785-020d-4902-b4b4-04d3c0e09a5d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:32.852231 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc18785-020d-4902-b4b4-04d3c0e09a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:32.852511 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc18785-020d-4902-b4b4-04d3c0e09a5d None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:32.853302 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc18785-020d-4902-b4b4-04d3c0e09a5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:32.853610 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc18785-020d-4902-b4b4-04d3c0e09a5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:32.855000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc18785-020d-4902-b4b4-04d3c0e09a5d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:32.866191 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 238/480] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:33.690768 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf637e-564e-4e42-9338-5ebb13f1162a None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:33.691403 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf637e-564e-4e42-9338-5ebb13f1162a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:33.691403 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf637e-564e-4e42-9338-5ebb13f1162a None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:33.692966 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 243/481] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:33.698295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca636db-55e9-40ad-8342-51c6bc74becc None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:33.698716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca636db-55e9-40ad-8342-51c6bc74becc None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:33.698899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca636db-55e9-40ad-8342-51c6bc74becc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:33.726017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-fca636db-55e9-40ad-8342-51c6bc74becc None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:33.727228 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fca636db-55e9-40ad-8342-51c6bc74becc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:33.823382 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 239/482] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:33.866895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf637e-564e-4e42-9338-5ebb13f1162a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:33.870644 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:34.005785 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf637e-564e-4e42-9338-5ebb13f1162a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:34.048741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686913f-a8db-4119-a209-d75022d776e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:34.049572 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686913f-a8db-4119-a209-d75022d776e9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:34.049855 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686913f-a8db-4119-a209-d75022d776e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:34.050126 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686913f-a8db-4119-a209-d75022d776e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:34.066824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686913f-a8db-4119-a209-d75022d776e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:34.074657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-3686913f-a8db-4119-a209-d75022d776e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:34.074657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:34.074657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:34.074657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:34.074657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:34.074657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:34.074657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:34.074657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:34.074657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:34.074657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:34.074657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:34.074657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:34.074657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:34.074657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:34.074657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:34.074657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:34.075611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:34.075611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:34.075611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:34.075611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:34.075611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:34.075611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:34.075611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:34.075611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:34.075611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:34.075611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:34.075611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:34.075611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:34.075611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:34.075611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:34.075611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:34.075611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:34.076479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:34.076479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:34.076479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:34.076479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:34.076479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:34.076479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:34.076479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:34.076479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:34.076479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:34.076479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:34.076479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:34.076479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:34.076479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 244/483] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:29:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:34.082694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca636db-55e9-40ad-8342-51c6bc74becc None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:34.142772 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:34.224021 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca636db-55e9-40ad-8342-51c6bc74becc None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:34.266154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c78a05-7cda-4f0a-9630-9bbf6419689e None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:34.266462 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c78a05-7cda-4f0a-9630-9bbf6419689e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:34.266741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c78a05-7cda-4f0a-9630-9bbf6419689e None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:34.268368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 245/484] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:34.273898 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d664c6-862f-4359-b4b3-422ff7c9852e None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:34.274193 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d664c6-862f-4359-b4b3-422ff7c9852e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:34.274481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d664c6-862f-4359-b4b3-422ff7c9852e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:34.281722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefec13d-d62e-4cb2-b07c-22a97f4f41c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:34.282522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefec13d-d62e-4cb2-b07c-22a97f4f41c1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:34.282817 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefec13d-d62e-4cb2-b07c-22a97f4f41c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:34.283104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefec13d-d62e-4cb2-b07c-22a97f4f41c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:34.283874 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefec13d-d62e-4cb2-b07c-22a97f4f41c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:34.284190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefec13d-d62e-4cb2-b07c-22a97f4f41c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:34.285638 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefec13d-d62e-4cb2-b07c-22a97f4f41c1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:34.293914 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-00d664c6-862f-4359-b4b3-422ff7c9852e None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:34.295144 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-00d664c6-862f-4359-b4b3-422ff7c9852e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:34.297458 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 240/485] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 16:29:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:34.298889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc11307-2f32-41bf-9ff0-2b45851b2cb3 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:34.299173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc11307-2f32-41bf-9ff0-2b45851b2cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:34.299448 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc11307-2f32-41bf-9ff0-2b45851b2cb3 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:34.300799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 241/486] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:34.301516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc11307-2f32-41bf-9ff0-2b45851b2cb3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:34.372577 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:34.386674 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 246/487] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:34.388013 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e88536-3086-4580-a2b0-1cbdf1df0709 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:34.388301 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e88536-3086-4580-a2b0-1cbdf1df0709 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:34.388578 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e88536-3086-4580-a2b0-1cbdf1df0709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:34.407408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-91e88536-3086-4580-a2b0-1cbdf1df0709 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:34.408625 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-91e88536-3086-4580-a2b0-1cbdf1df0709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:34.450677 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc11307-2f32-41bf-9ff0-2b45851b2cb3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:34.461386 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:34.494591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af87ba-1ba3-46f2-9b3d-f836ce3ecfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:34.495389 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af87ba-1ba3-46f2-9b3d-f836ce3ecfbd None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:34.495814 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af87ba-1ba3-46f2-9b3d-f836ce3ecfbd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:34.495990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af87ba-1ba3-46f2-9b3d-f836ce3ecfbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:34.497135 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 247/488] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:34.498045 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e88536-3086-4580-a2b0-1cbdf1df0709 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:34.509519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af87ba-1ba3-46f2-9b3d-f836ce3ecfbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:34.510979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11af87ba-1ba3-46f2-9b3d-f836ce3ecfbd None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:34.533672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-11af87ba-1ba3-46f2-9b3d-f836ce3ecfbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:34.533672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:34.533672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:34.533672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:34.533672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:34.533672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:34.533672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:34.533672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:34.533672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:34.533672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:34.533672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:34.533672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:34.533672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:34.533672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:34.533672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:34.535786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:34.535786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:34.535786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:34.535786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:34.535786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:34.535786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:34.535786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:34.535786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:34.535786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:34.535786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:34.535786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:34.535786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:34.535786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:34.535786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:34.535786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:34.535786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:34.535786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:34.538112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:34.538112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:34.538112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:34.538112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:34.538112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 242/489] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:34.538112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af87ba-1ba3-46f2-9b3d-f836ce3ecfbd None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:34.630978 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e88536-3086-4580-a2b0-1cbdf1df0709 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:34.665428 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11af87ba-1ba3-46f2-9b3d-f836ce3ecfbd None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:34.667054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:34.679586 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11a9e1-ec5c-408c-884c-08a19413f10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:34.680970 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11a9e1-ec5c-408c-884c-08a19413f10d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:34.681502 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11a9e1-ec5c-408c-884c-08a19413f10d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:34.681980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11a9e1-ec5c-408c-884c-08a19413f10d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:34.694634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11a9e1-ec5c-408c-884c-08a19413f10d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:34.703937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80cfaa-640d-47dc-9506-bef86181f60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:34.704470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-5b11a9e1-ec5c-408c-884c-08a19413f10d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:34.704470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:34.704470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:34.704470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:34.704470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:34.704470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:34.704470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:34.704470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:34.704470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:34.704470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:34.704470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:34.704470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:34.704470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:34.704470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:34.704470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:34.704470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:34.705418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:34.705418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:34.705418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:34.705418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:34.705418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:34.705418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:34.705418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:34.705418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:34.705418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:34.705418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:34.705418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:34.705418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:34.705418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:34.705418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:34.705418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:34.705418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:34.711133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:34.711133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:34.711133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:34.711133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:34.711133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:34.711133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:34.711133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:34.711133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:34.711133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:34.711133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:34.711133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:34.711133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:34.711133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 248/490] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:29:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:34.711133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11a9e1-ec5c-408c-884c-08a19413f10d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:34.713351 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80cfaa-640d-47dc-9506-bef86181f60b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:34.713833 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80cfaa-640d-47dc-9506-bef86181f60b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:34.714323 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf80cfaa-640d-47dc-9506-bef86181f60b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:34.726834 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf80cfaa-640d-47dc-9506-bef86181f60b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:34.735604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-bf80cfaa-640d-47dc-9506-bef86181f60b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:34.735604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:34.735604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:34.735604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:34.735604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:34.735604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:34.735604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:34.735604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:34.735604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:34.735604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:34.735604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:34.735604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:34.735604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:34.735604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:34.735604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:34.735604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:34.736633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:34.736633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:34.736633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:34.736633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:34.736633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:34.736633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:34.736633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:34.736633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:34.736633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:34.736633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:34.736633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:34.736633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:34.736633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:34.736633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:34.736633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:34.736633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:34.737514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:34.737514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:34.737514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:34.737514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:34.737514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:34.737514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:34.737514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:34.737514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:34.737514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:34.737514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:34.737514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:34.737514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:34.745409 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 243/491] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:29:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:34.746952 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80cfaa-640d-47dc-9506-bef86181f60b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:34.772305 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:34.825576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11a9e1-ec5c-408c-884c-08a19413f10d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:34.857064 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf80cfaa-640d-47dc-9506-bef86181f60b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:34.864343 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda6d4b-96a2-4b9a-80f8-00b2f4e1de20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:34.865439 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda6d4b-96a2-4b9a-80f8-00b2f4e1de20 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:34.865934 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda6d4b-96a2-4b9a-80f8-00b2f4e1de20 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:34.866404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdda6d4b-96a2-4b9a-80f8-00b2f4e1de20 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:34.867461 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda6d4b-96a2-4b9a-80f8-00b2f4e1de20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:34.867967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda6d4b-96a2-4b9a-80f8-00b2f4e1de20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:34.869686 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdda6d4b-96a2-4b9a-80f8-00b2f4e1de20 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:34.883696 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 249/492] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:34.884840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda6d4b-96a2-4b9a-80f8-00b2f4e1de20 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:34.898671 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da5bea-fdfc-4349-9ca1-d87cf99a1b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:34.899349 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da5bea-fdfc-4349-9ca1-d87cf99a1b19 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:34.899621 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da5bea-fdfc-4349-9ca1-d87cf99a1b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:34.899904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da5bea-fdfc-4349-9ca1-d87cf99a1b19 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:34.900667 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da5bea-fdfc-4349-9ca1-d87cf99a1b19 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:34.900975 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da5bea-fdfc-4349-9ca1-d87cf99a1b19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:34.902549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da5bea-fdfc-4349-9ca1-d87cf99a1b19 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:34.911823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 244/493] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 16:29:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:34.917156 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da5bea-fdfc-4349-9ca1-d87cf99a1b19 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:34.935362 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:34.998793 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdda6d4b-96a2-4b9a-80f8-00b2f4e1de20 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:35.004338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:35.023437 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da5bea-fdfc-4349-9ca1-d87cf99a1b19 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:35.039735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20a85b-0715-4f42-a7ec-3efdc50ddcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:35.040974 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20a85b-0715-4f42-a7ec-3efdc50ddcff None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:35.041736 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20a85b-0715-4f42-a7ec-3efdc50ddcff None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:35.042220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20a85b-0715-4f42-a7ec-3efdc50ddcff None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:35.043554 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20a85b-0715-4f42-a7ec-3efdc50ddcff None admin] RBAC: Adding query filter params (name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:35.044082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20a85b-0715-4f42-a7ec-3efdc50ddcff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:35.046996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20a85b-0715-4f42-a7ec-3efdc50ddcff None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:35.059183 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 250/494] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 16:29:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:35.060297 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20a85b-0715-4f42-a7ec-3efdc50ddcff None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:35.066164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478c3be-4859-49b6-8370-83ef47237215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:35.067017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478c3be-4859-49b6-8370-83ef47237215 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:35.067350 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478c3be-4859-49b6-8370-83ef47237215 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:35.067638 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4478c3be-4859-49b6-8370-83ef47237215 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:35.077160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478c3be-4859-49b6-8370-83ef47237215 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:35.079122 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4478c3be-4859-49b6-8370-83ef47237215 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:35.098435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-4478c3be-4859-49b6-8370-83ef47237215 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:29:35.098435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:35.098435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:35.098435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:35.098435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:35.098435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:35.098435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:35.098435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:35.098435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:35.098435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:35.098435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:35.098435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:35.098435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:29:35.098435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:29:35.098435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:29:35.098435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:29:35.099420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:35.099420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:35.099420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:29:35.099420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:35.099420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:29:35.099420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:35.099420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:35.099420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:35.099420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:35.099420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:35.099420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:35.099420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:35.099420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:35.099420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:35.099420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:35.099420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:35.099420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:35.099420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:35.100354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:35.100354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:35.100354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:29:35.100354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:29:35.100354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:29:35.100354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:29:35.100354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:29:35.100354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:29:35.100354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:29:35.100354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:35.104438 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 245/495] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Jul 18 16:29:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:35.105505 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478c3be-4859-49b6-8370-83ef47237215 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:35.190636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20a85b-0715-4f42-a7ec-3efdc50ddcff None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:35.194248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:35.220778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4478c3be-4859-49b6-8370-83ef47237215 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:35.229492 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7729d6-7787-4b92-bcbc-4263b01d022a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:35.230340 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7729d6-7787-4b92-bcbc-4263b01d022a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:35.230929 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7729d6-7787-4b92-bcbc-4263b01d022a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:35.231220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7729d6-7787-4b92-bcbc-4263b01d022a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:35.245725 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7729d6-7787-4b92-bcbc-4263b01d022a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:35.247556 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7729d6-7787-4b92-bcbc-4263b01d022a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:35.258424 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef12b076-30ca-4744-aa75-29a3a9766217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:35.259224 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12b076-30ca-4744-aa75-29a3a9766217 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:35.259510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12b076-30ca-4744-aa75-29a3a9766217 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:35.259786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef12b076-30ca-4744-aa75-29a3a9766217 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:35.266485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-1c7729d6-7787-4b92-bcbc-4263b01d022a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:35.266485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:35.266485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:35.266485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:35.266485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:35.266485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:35.266485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:35.266485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:35.266485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:35.266485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:35.266485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:35.266485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:35.266485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:35.266485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:35.266485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:35.267454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:35.267454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:35.267454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:35.267454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:35.267454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:35.267454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:35.267454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:35.267454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:35.267454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:35.267454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:35.267454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:35.267454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:35.267454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:35.267454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:35.267454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:35.267454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:35.267454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:35.268368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:35.268368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:35.268368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:35.268368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:35.268368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 251/496] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:35.268645 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7729d6-7787-4b92-bcbc-4263b01d022a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:35.275867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12b076-30ca-4744-aa75-29a3a9766217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:35.277377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef12b076-30ca-4744-aa75-29a3a9766217 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:35.280553 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:35.297645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-ef12b076-30ca-4744-aa75-29a3a9766217 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:35.297645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:35.297645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:35.297645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:35.297645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:35.297645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:35.297645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:35.297645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:35.297645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:35.297645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:35.297645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:35.297645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:35.297645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:35.297645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:35.297645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:35.298764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:35.298764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:35.298764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:35.298764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:35.298764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:35.298764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:35.298764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:35.298764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:35.298764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:35.298764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:35.298764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:35.298764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:35.298764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:35.298764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:35.298764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:35.298764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:35.298764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:35.304517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:35.304517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:35.304517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:35.304517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:35.304517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 246/497] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:35.304517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3da06c-b670-4fca-ba21-ec896970e0ea None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:35.304517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3da06c-b670-4fca-ba21-ec896970e0ea None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:35.304517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3da06c-b670-4fca-ba21-ec896970e0ea None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:35.304517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 247/498] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:35.305050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3da06c-b670-4fca-ba21-ec896970e0ea None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:35.388301 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7729d6-7787-4b92-bcbc-4263b01d022a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:35.419717 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3da06c-b670-4fca-ba21-ec896970e0ea None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:35.425621 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7751a-780b-481b-b5ed-80919fc63397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:35.426626 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7751a-780b-481b-b5ed-80919fc63397 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:35.427158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7751a-780b-481b-b5ed-80919fc63397 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:35.427987 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7751a-780b-481b-b5ed-80919fc63397 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:35.429038 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7751a-780b-481b-b5ed-80919fc63397 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:35.429852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7751a-780b-481b-b5ed-80919fc63397 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:35.432060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7751a-780b-481b-b5ed-80919fc63397 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:35.454758 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b45941-1838-4720-83c1-7b785d4a1472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:35.455463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b45941-1838-4720-83c1-7b785d4a1472 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:35.455747 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b45941-1838-4720-83c1-7b785d4a1472 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:35.456022 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b45941-1838-4720-83c1-7b785d4a1472 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:35.456740 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b45941-1838-4720-83c1-7b785d4a1472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:35.457074 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b45941-1838-4720-83c1-7b785d4a1472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:35.458466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b45941-1838-4720-83c1-7b785d4a1472 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:35.471063 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 248/499] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:35.471889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b45941-1838-4720-83c1-7b785d4a1472 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:35.486273 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 252/500] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Jul 18 16:29:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:35.488082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439cff0-3c2f-47a8-8f51-af9df9f113a3 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:35.488528 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439cff0-3c2f-47a8-8f51-af9df9f113a3 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:35.488974 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439cff0-3c2f-47a8-8f51-af9df9f113a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:35.507377 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c439cff0-3c2f-47a8-8f51-af9df9f113a3 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:35.508583 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c439cff0-3c2f-47a8-8f51-af9df9f113a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:35.519029 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:35.537514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:35.584604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b45941-1838-4720-83c1-7b785d4a1472 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:35.593059 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 253/501] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:35.593059 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439cff0-3c2f-47a8-8f51-af9df9f113a3 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:35.634177 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c25a7-6faf-41e5-aea3-14000b116b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:35.634852 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c25a7-6faf-41e5-aea3-14000b116b2a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:35.635142 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c25a7-6faf-41e5-aea3-14000b116b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:35.635429 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c25a7-6faf-41e5-aea3-14000b116b2a None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:35.636173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c25a7-6faf-41e5-aea3-14000b116b2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:35.636492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c25a7-6faf-41e5-aea3-14000b116b2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:35.637961 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c25a7-6faf-41e5-aea3-14000b116b2a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:35.666238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 249/502] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:35.666238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c25a7-6faf-41e5-aea3-14000b116b2a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:35.708914 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439cff0-3c2f-47a8-8f51-af9df9f113a3 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:35.742995 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb457d-cfc9-475a-9aca-7f445122fe4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:35.743797 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb457d-cfc9-475a-9aca-7f445122fe4e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:35.744075 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb457d-cfc9-475a-9aca-7f445122fe4e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:35.744347 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb457d-cfc9-475a-9aca-7f445122fe4e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:35.752899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb457d-cfc9-475a-9aca-7f445122fe4e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:35.754368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb457d-cfc9-475a-9aca-7f445122fe4e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:35.755652 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c25a7-6faf-41e5-aea3-14000b116b2a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:35.770680 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:35.772791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-20bb457d-cfc9-475a-9aca-7f445122fe4e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 16:29:35.772791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:35.772791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:35.772791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:35.772791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:35.772791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:35.772791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:35.772791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:35.772791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:35.772791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:35.772791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:35.772791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:35.772791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:29:35.772791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:29:35.772791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:29:35.772791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:29:35.773698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:35.773698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:35.773698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:29:35.773698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:35.773698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:29:35.773698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:35.773698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:35.773698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:35.773698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:35.773698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:35.773698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:35.773698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:35.773698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:35.773698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:35.773698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:35.773698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:35.773698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:35.773698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:35.786795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:35.786795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:35.786795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:29:35.786795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:29:35.786795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:29:35.786795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:29:35.786795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:29:35.786795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:29:35.786795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 16:29:35.786795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:35.786795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 254/503] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:35.786795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb457d-cfc9-475a-9aca-7f445122fe4e None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:35.786795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:35.792044 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f52c7e-dffa-4178-802e-8393b251ec63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:35.792748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f52c7e-dffa-4178-802e-8393b251ec63 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:35.793065 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f52c7e-dffa-4178-802e-8393b251ec63 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:35.793353 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f52c7e-dffa-4178-802e-8393b251ec63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:35.861888 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f52c7e-dffa-4178-802e-8393b251ec63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:35.863373 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f52c7e-dffa-4178-802e-8393b251ec63 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:35.879785 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb457d-cfc9-475a-9aca-7f445122fe4e None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:35.919901 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88756df5-e88e-489e-8675-97efe3a565d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:35.921409 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88756df5-e88e-489e-8675-97efe3a565d9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:35.921872 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88756df5-e88e-489e-8675-97efe3a565d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:35.922335 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88756df5-e88e-489e-8675-97efe3a565d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:35.934827 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88756df5-e88e-489e-8675-97efe3a565d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:35.945154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-88756df5-e88e-489e-8675-97efe3a565d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:35.945154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:35.945154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:35.945154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:35.945154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:35.945154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:35.945154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:35.945154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:35.945154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:35.945154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:35.945154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:35.945154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:35.945154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:35.945154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:35.945154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:35.945154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:35.946074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:35.946074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:35.946074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:35.946074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:35.946074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:35.946074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:35.946074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:35.946074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:35.946074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:35.946074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:35.946074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:35.946074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:35.946074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:35.946074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:35.946074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:35.946074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:35.947199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:35.947199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:35.947199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:35.947199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:35.947199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:35.947199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:35.947199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:35.947199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:35.947199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:35.947199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:35.947199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:35.947199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:35.947199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 255/504] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:29:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:35.947199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88756df5-e88e-489e-8675-97efe3a565d9 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:35.995050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 250/505] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:29:35.996924 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fbdbc-0d47-4c04-9a20-74cc7c9dfa87 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:35.997246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fbdbc-0d47-4c04-9a20-74cc7c9dfa87 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:35.997523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0fbdbc-0d47-4c04-9a20-74cc7c9dfa87 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:35.999721 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 251/506] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:36.000430 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fbdbc-0d47-4c04-9a20-74cc7c9dfa87 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:36.017179 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:36.024623 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:36.063034 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88756df5-e88e-489e-8675-97efe3a565d9 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:36.098452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2fd17-6713-4a2c-b5ce-bb1b2a867e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:36.099262 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2fd17-6713-4a2c-b5ce-bb1b2a867e6f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:36.099549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2fd17-6713-4a2c-b5ce-bb1b2a867e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:36.099825 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c2fd17-6713-4a2c-b5ce-bb1b2a867e6f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:36.107633 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2fd17-6713-4a2c-b5ce-bb1b2a867e6f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:36.109202 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c2fd17-6713-4a2c-b5ce-bb1b2a867e6f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:36.109337 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0fbdbc-0d47-4c04-9a20-74cc7c9dfa87 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:36.124532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-c1c2fd17-6713-4a2c-b5ce-bb1b2a867e6f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 16:29:36.124532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:36.124532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:36.124532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:36.124532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:36.124532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:36.124532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:36.124532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:36.124532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:36.124532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:36.124532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:36.124532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:36.124532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:29:36.124532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:29:36.124532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:29:36.124532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:29:36.125710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:36.125710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:36.125710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:29:36.125710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:36.125710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:29:36.125710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:36.125710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:36.125710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:36.125710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:36.125710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:36.125710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:36.125710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:36.125710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:36.125710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:36.125710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:36.125710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:36.125710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:36.125710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:36.126625 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:36.126625 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:36.126625 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:29:36.126625 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:29:36.126625 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:29:36.126625 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:29:36.126625 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:29:36.126625 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:29:36.126625 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 16:29:36.126625 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:36.126625 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 256/507] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:36.127216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2fd17-6713-4a2c-b5ce-bb1b2a867e6f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:36.156572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c10087-fd64-4b67-b126-abe0cbcaa43f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:36.157273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c10087-fd64-4b67-b126-abe0cbcaa43f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:36.157554 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c10087-fd64-4b67-b126-abe0cbcaa43f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:36.157830 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c10087-fd64-4b67-b126-abe0cbcaa43f None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:36.158666 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c10087-fd64-4b67-b126-abe0cbcaa43f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:36.158972 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c10087-fd64-4b67-b126-abe0cbcaa43f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:36.160602 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c10087-fd64-4b67-b126-abe0cbcaa43f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:36.196581 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 252/508] 10.222.0.76 () {56 vars in 1137 bytes} [Mon Jul 18 16:29:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:36.197445 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c10087-fd64-4b67-b126-abe0cbcaa43f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:36.231379 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c2fd17-6713-4a2c-b5ce-bb1b2a867e6f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:36.263887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:36.280653 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a678c5-60e5-4697-a11c-8591e2f21515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:36.281779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a678c5-60e5-4697-a11c-8591e2f21515 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:36.282238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a678c5-60e5-4697-a11c-8591e2f21515 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:36.282713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a678c5-60e5-4697-a11c-8591e2f21515 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:36.284119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a678c5-60e5-4697-a11c-8591e2f21515 None admin] RBAC: Adding query filter params (name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:36.284643 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a678c5-60e5-4697-a11c-8591e2f21515 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:36.287019 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a678c5-60e5-4697-a11c-8591e2f21515 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:36.292364 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:36.302323 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 257/509] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 16:29:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:36.309469 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b1349-9aa4-45f2-b47a-18b914acd495 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:36.309469 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b1349-9aa4-45f2-b47a-18b914acd495 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:36.309469 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b1349-9aa4-45f2-b47a-18b914acd495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:36.321818 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-6e6b1349-9aa4-45f2-b47a-18b914acd495 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:36.323050 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6e6b1349-9aa4-45f2-b47a-18b914acd495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:36.333655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c10087-fd64-4b67-b126-abe0cbcaa43f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:36.373841 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8404f1-eca9-41df-9fb8-d37dc2d82698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:36.374642 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8404f1-eca9-41df-9fb8-d37dc2d82698 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:36.374927 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8404f1-eca9-41df-9fb8-d37dc2d82698 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:36.375202 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8404f1-eca9-41df-9fb8-d37dc2d82698 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:36.385435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8404f1-eca9-41df-9fb8-d37dc2d82698 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:36.386965 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8404f1-eca9-41df-9fb8-d37dc2d82698 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:36.395669 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 258/510] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:36.396896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b1349-9aa4-45f2-b47a-18b914acd495 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:36.405850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-fd8404f1-eca9-41df-9fb8-d37dc2d82698 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:36.405850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:36.405850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:36.405850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:36.405850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:36.405850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:36.405850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:36.405850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:36.405850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:36.405850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:36.405850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:36.405850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:36.405850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:36.405850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:36.405850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:36.406840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:36.406840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:36.406840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:36.406840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:36.406840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:36.406840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:36.406840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:36.406840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:36.406840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:36.406840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:36.406840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:36.406840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:36.406840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:36.406840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:36.406840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:36.406840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:36.406840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:36.407696 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:36.407696 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:36.407696 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:36.407696 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:36.408757 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 253/511] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:36.409933 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8404f1-eca9-41df-9fb8-d37dc2d82698 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:36.506454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b1349-9aa4-45f2-b47a-18b914acd495 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:36.520640 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8404f1-eca9-41df-9fb8-d37dc2d82698 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:36.528714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:36.543756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:36.553581 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817501f-5dda-44eb-b16c-8523d57c3768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:36.554520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817501f-5dda-44eb-b16c-8523d57c3768 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:36.554847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fc07b-8db8-4561-910e-7d15add69db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:36.554963 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817501f-5dda-44eb-b16c-8523d57c3768 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:36.555290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817501f-5dda-44eb-b16c-8523d57c3768 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:36.555497 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fc07b-8db8-4561-910e-7d15add69db9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:36.555785 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fc07b-8db8-4561-910e-7d15add69db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:36.556067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9fc07b-8db8-4561-910e-7d15add69db9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:36.556422 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817501f-5dda-44eb-b16c-8523d57c3768 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:36.556736 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817501f-5dda-44eb-b16c-8523d57c3768 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:36.558883 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817501f-5dda-44eb-b16c-8523d57c3768 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:36.591114 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 259/512] 10.222.0.76 () {56 vars in 1137 bytes} [Mon Jul 18 16:29:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:36.591114 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817501f-5dda-44eb-b16c-8523d57c3768 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:36.631478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fc07b-8db8-4561-910e-7d15add69db9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:36.632954 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9fc07b-8db8-4561-910e-7d15add69db9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:36.738501 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817501f-5dda-44eb-b16c-8523d57c3768 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:36.775732 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 254/513] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:29:36.776578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fc07b-8db8-4561-910e-7d15add69db9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:36.778835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250f724-8caa-446f-a572-47a2f4939a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:36.782463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250f724-8caa-446f-a572-47a2f4939a2c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:36.782463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250f724-8caa-446f-a572-47a2f4939a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:36.782463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250f724-8caa-446f-a572-47a2f4939a2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:36.792098 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250f724-8caa-446f-a572-47a2f4939a2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:36.793618 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250f724-8caa-446f-a572-47a2f4939a2c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:36.810303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:36.812808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-b250f724-8caa-446f-a572-47a2f4939a2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:36.812808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:36.812808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:36.812808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:36.812808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:36.812808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:36.812808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:36.812808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:36.812808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:36.812808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:36.812808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:36.812808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:36.812808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:36.812808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:36.812808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:36.813713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:36.813713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:36.813713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:36.813713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:36.813713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:36.813713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:36.813713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:36.813713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:36.813713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:36.813713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:36.813713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:36.813713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:36.813713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:36.813713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:36.813713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:36.813713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:36.813713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:36.814560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:36.814560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:36.814560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:36.814560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:36.814560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 260/514] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:36.814837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250f724-8caa-446f-a572-47a2f4939a2c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:36.845324 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:36.899478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9fc07b-8db8-4561-910e-7d15add69db9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:36.923684 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250f724-8caa-446f-a572-47a2f4939a2c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:36.938673 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fe05b-e9eb-4f95-baaf-5a527fe997a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:36.939339 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fe05b-e9eb-4f95-baaf-5a527fe997a9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:36.939625 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fe05b-e9eb-4f95-baaf-5a527fe997a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:36.939938 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fe05b-e9eb-4f95-baaf-5a527fe997a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:36.940693 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fe05b-e9eb-4f95-baaf-5a527fe997a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:36.941044 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fe05b-e9eb-4f95-baaf-5a527fe997a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:36.942420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fe05b-e9eb-4f95-baaf-5a527fe997a9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:36.954573 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 255/515] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:36.955460 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fe05b-e9eb-4f95-baaf-5a527fe997a9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:36.968618 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10258dd-78fc-4d1e-90f3-b35a8b3e68ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:36.969452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10258dd-78fc-4d1e-90f3-b35a8b3e68ea None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:36.969737 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10258dd-78fc-4d1e-90f3-b35a8b3e68ea None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:36.970017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10258dd-78fc-4d1e-90f3-b35a8b3e68ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:36.980207 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10258dd-78fc-4d1e-90f3-b35a8b3e68ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:36.981710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10258dd-78fc-4d1e-90f3-b35a8b3e68ea None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:37.000319 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-b10258dd-78fc-4d1e-90f3-b35a8b3e68ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:37.000319 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:37.000319 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:37.000319 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:37.000319 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:37.000319 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:37.000319 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:37.000319 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:37.000319 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:37.000319 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:37.000319 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:37.000319 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:37.000319 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:37.000319 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:37.000319 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:37.001447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:37.001447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:37.001447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:37.001447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:37.001447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:37.001447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:37.001447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:37.001447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:37.001447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:37.001447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:37.001447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:37.001447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:37.001447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:37.001447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:37.001447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:37.001447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:37.001447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:37.002549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:37.002549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:37.002549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:37.002549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:37.002549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 261/516] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:37.002549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10258dd-78fc-4d1e-90f3-b35a8b3e68ea None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:37.046278 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:37.062448 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fe05b-e9eb-4f95-baaf-5a527fe997a9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:37.084165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:37.097533 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202acd9-3957-481d-916f-69ef9cb8c96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:37.098192 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202acd9-3957-481d-916f-69ef9cb8c96c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:37.098478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202acd9-3957-481d-916f-69ef9cb8c96c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:37.098783 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e202acd9-3957-481d-916f-69ef9cb8c96c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:37.106203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10258dd-78fc-4d1e-90f3-b35a8b3e68ea None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:37.143246 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1c35a-fa47-41df-9413-972da6dcdbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:37.144040 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1c35a-fa47-41df-9413-972da6dcdbbb None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:37.144318 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1c35a-fa47-41df-9413-972da6dcdbbb None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:37.144592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1c35a-fa47-41df-9413-972da6dcdbbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:37.158120 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1c35a-fa47-41df-9413-972da6dcdbbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:37.159575 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1c35a-fa47-41df-9413-972da6dcdbbb None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:37.173110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202acd9-3957-481d-916f-69ef9cb8c96c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:37.174592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e202acd9-3957-481d-916f-69ef9cb8c96c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:37.178247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-44c1c35a-fa47-41df-9413-972da6dcdbbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:37.178247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:37.178247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:37.178247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:37.178247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:37.178247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:37.178247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:37.178247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:37.178247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:37.178247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:37.178247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:37.178247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:37.178247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:37.178247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:37.178247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:37.179219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:37.179219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:37.179219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:37.179219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:37.179219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:37.179219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:37.179219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:37.179219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:37.179219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:37.179219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:37.179219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:37.179219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:37.179219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:37.179219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:37.179219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:37.179219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:37.179219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:37.180227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:37.180227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:37.180227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:37.180227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:37.180227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 262/517] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:37.180227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1c35a-fa47-41df-9413-972da6dcdbbb None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:37.262998 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:37.284037 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1c35a-fa47-41df-9413-972da6dcdbbb None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:37.284921 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 256/518] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:29:37.289680 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202acd9-3957-481d-916f-69ef9cb8c96c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:37.319523 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:37.329178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346e488-975e-46e5-8574-cdebddd019f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:37.329927 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346e488-975e-46e5-8574-cdebddd019f3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:37.330193 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346e488-975e-46e5-8574-cdebddd019f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:37.330474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e346e488-975e-46e5-8574-cdebddd019f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:37.335715 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346e488-975e-46e5-8574-cdebddd019f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:37.335715 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346e488-975e-46e5-8574-cdebddd019f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:37.335715 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e346e488-975e-46e5-8574-cdebddd019f3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:37.344923 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 263/519] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:37.345764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346e488-975e-46e5-8574-cdebddd019f3 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:37.408856 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e202acd9-3957-481d-916f-69ef9cb8c96c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:37.445407 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f8102-95db-453f-bcc4-36b269887370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:37.446251 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f8102-95db-453f-bcc4-36b269887370 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:37.446681 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f8102-95db-453f-bcc4-36b269887370 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:37.446958 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f8102-95db-453f-bcc4-36b269887370 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:37.450033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e346e488-975e-46e5-8574-cdebddd019f3 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:37.453680 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f8102-95db-453f-bcc4-36b269887370 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:37.455153 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f8102-95db-453f-bcc4-36b269887370 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:37.470306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-428f8102-95db-453f-bcc4-36b269887370 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:37.470306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:37.470306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:37.470306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:37.470306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:37.470306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:37.470306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:37.470306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:37.470306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:37.470306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:37.470306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:37.470306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:37.470306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:29:37.470306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:29:37.470306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:29:37.471400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:29:37.471400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:37.471400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:37.471400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:37.471400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:37.471400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:37.471400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:37.471400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:37.471400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:37.471400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:37.471400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:37.471400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:37.471400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:37.471400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:37.471400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:37.471400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:37.471400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:37.472511 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:29:37.472511 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:29:37.472511 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:29:37.472511 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:29:37.472511 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:29:37.472511 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:29:37.472511 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:37.472511 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:37.472511 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 257/520] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:37.472511 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f8102-95db-453f-bcc4-36b269887370 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:37.490680 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f92c4-f9e5-410d-837d-cac894b8caff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:37.491353 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f92c4-f9e5-410d-837d-cac894b8caff None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:37.491636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f92c4-f9e5-410d-837d-cac894b8caff None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:37.491906 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f92c4-f9e5-410d-837d-cac894b8caff None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:37.492662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f92c4-f9e5-410d-837d-cac894b8caff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:37.492963 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f92c4-f9e5-410d-837d-cac894b8caff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:37.494364 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4f92c4-f9e5-410d-837d-cac894b8caff None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:37.507645 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 264/521] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:37.508525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f92c4-f9e5-410d-837d-cac894b8caff None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:37.530164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:37.560000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:37.591577 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f8102-95db-453f-bcc4-36b269887370 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:37.617938 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4f92c4-f9e5-410d-837d-cac894b8caff None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:37.638499 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652acd9-ae6a-441d-8278-eaed4f8fea8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:37.639946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652acd9-ae6a-441d-8278-eaed4f8fea8a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:37.640343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652acd9-ae6a-441d-8278-eaed4f8fea8a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:37.640734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652acd9-ae6a-441d-8278-eaed4f8fea8a None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:37.641852 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652acd9-ae6a-441d-8278-eaed4f8fea8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:37.642294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652acd9-ae6a-441d-8278-eaed4f8fea8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:37.644384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652acd9-ae6a-441d-8278-eaed4f8fea8a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:37.654183 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade742f-c5a5-4de4-a0bb-43d36bff06b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:37.655628 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade742f-c5a5-4de4-a0bb-43d36bff06b9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:37.656043 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade742f-c5a5-4de4-a0bb-43d36bff06b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:37.656327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade742f-c5a5-4de4-a0bb-43d36bff06b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:37.661326 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 258/522] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:37.662490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652acd9-ae6a-441d-8278-eaed4f8fea8a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:37.669490 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade742f-c5a5-4de4-a0bb-43d36bff06b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:37.670977 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade742f-c5a5-4de4-a0bb-43d36bff06b9 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:37.689099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-eade742f-c5a5-4de4-a0bb-43d36bff06b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:37.689099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:37.689099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:37.689099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:37.689099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:37.689099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:37.689099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:37.689099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:37.689099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:37.689099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:37.689099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:37.689099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:37.689099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:37.689099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:37.689099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:37.690170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:37.690170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:37.690170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:37.690170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:37.690170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:37.690170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:37.690170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:37.690170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:37.690170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:37.690170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:37.690170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:37.690170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:37.690170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:37.690170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:37.690170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:37.690170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:37.690170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:37.691022 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:37.691022 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:37.691022 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:37.691022 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:37.691022 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 265/523] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:37.691617 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade742f-c5a5-4de4-a0bb-43d36bff06b9 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:37.777446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652acd9-ae6a-441d-8278-eaed4f8fea8a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:37.780800 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:37.805374 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade742f-c5a5-4de4-a0bb-43d36bff06b9 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:37.807261 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:37.814725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533adf05-8dba-4e24-bf93-4c266bd5a3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:37.815539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533adf05-8dba-4e24-bf93-4c266bd5a3a6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:37.815823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533adf05-8dba-4e24-bf93-4c266bd5a3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:37.816104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533adf05-8dba-4e24-bf93-4c266bd5a3a6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:37.823559 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533adf05-8dba-4e24-bf93-4c266bd5a3a6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:37.825036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533adf05-8dba-4e24-bf93-4c266bd5a3a6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:37.840152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-533adf05-8dba-4e24-bf93-4c266bd5a3a6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 16:29:37.840152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:37.840152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:37.840152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:37.840152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:37.840152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:37.840152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:37.840152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:37.840152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:37.840152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:37.840152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:37.840152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:37.840152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:29:37.840152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:29:37.840152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:29:37.840152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:29:37.841121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:37.841121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:37.841121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:29:37.841121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:37.841121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:29:37.841121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:37.841121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:37.841121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:37.841121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:37.841121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:37.841121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:37.841121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:37.841121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:37.841121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:37.841121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:37.841121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:37.841121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:37.841121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:37.842253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:37.842253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:37.842253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:29:37.842253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:29:37.842253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:29:37.842253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:29:37.842253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:29:37.842253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:29:37.842253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 16:29:37.842253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:37.842253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 259/524] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:29:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:37.842253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533adf05-8dba-4e24-bf93-4c266bd5a3a6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:37.847807 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773f524-a8fd-4ffe-9c79-a9c5ea088b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:37.848489 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773f524-a8fd-4ffe-9c79-a9c5ea088b4c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:37.848954 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773f524-a8fd-4ffe-9c79-a9c5ea088b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:37.849343 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773f524-a8fd-4ffe-9c79-a9c5ea088b4c None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:37.850937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773f524-a8fd-4ffe-9c79-a9c5ea088b4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:37.850937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773f524-a8fd-4ffe-9c79-a9c5ea088b4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:37.853421 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9773f524-a8fd-4ffe-9c79-a9c5ea088b4c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:37.879487 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 266/525] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:29:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:37.880326 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773f524-a8fd-4ffe-9c79-a9c5ea088b4c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:37.966462 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533adf05-8dba-4e24-bf93-4c266bd5a3a6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:38.001877 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08fb32-2813-4188-9e09-4510b1cfa226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:38.002551 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08fb32-2813-4188-9e09-4510b1cfa226 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:38.002835 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08fb32-2813-4188-9e09-4510b1cfa226 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:38.003114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08fb32-2813-4188-9e09-4510b1cfa226 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:38.003846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08fb32-2813-4188-9e09-4510b1cfa226 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:38.005313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08fb32-2813-4188-9e09-4510b1cfa226 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:38.006709 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773f524-a8fd-4ffe-9c79-a9c5ea088b4c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:38.054353 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9cc35-3361-41ad-933a-417d7a8f4315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:38.055484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9cc35-3361-41ad-933a-417d7a8f4315 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:38.055885 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9cc35-3361-41ad-933a-417d7a8f4315 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:38.056278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9cc35-3361-41ad-933a-417d7a8f4315 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:38.066512 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9cc35-3361-41ad-933a-417d7a8f4315 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:38.068300 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9cc35-3361-41ad-933a-417d7a8f4315 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:38.092014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-99b9cc35-3361-41ad-933a-417d7a8f4315 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:38.092014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:38.092014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:38.092014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:38.092014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:38.092014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:38.092014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:38.092014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:38.092014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:38.092014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:38.092014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:38.092014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:38.092014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:29:38.092014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:29:38.092014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:29:38.093197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:29:38.093197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:38.093197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:38.093197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:38.093197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:38.093197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:38.093197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:38.093197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:38.093197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:38.093197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:38.093197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:38.093197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:38.093197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:38.093197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:38.093197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:38.093197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:38.093197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:38.094284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:29:38.094284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:29:38.094284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:29:38.094284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:29:38.094284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:29:38.094284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:29:38.094284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:38.094284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:38.094284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 267/526] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:38.095135 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9cc35-3361-41ad-933a-417d7a8f4315 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:38.126397 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 260/527] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 16:29:37 2022] POST /identity/v3/users => generated 247 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:29:38.127223 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08fb32-2813-4188-9e09-4510b1cfa226 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:38.130410 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:38.152982 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:38.236417 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9cc35-3361-41ad-933a-417d7a8f4315 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:38.253737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08fb32-2813-4188-9e09-4510b1cfa226 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:38.279244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fec77-8592-43ce-a3b0-d1637516cd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:38.282725 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fec77-8592-43ce-a3b0-d1637516cd95 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:38.283008 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fec77-8592-43ce-a3b0-d1637516cd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:38.283283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fec77-8592-43ce-a3b0-d1637516cd95 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:38.284053 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fec77-8592-43ce-a3b0-d1637516cd95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:38.284359 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fec77-8592-43ce-a3b0-d1637516cd95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:38.286581 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fec77-8592-43ce-a3b0-d1637516cd95 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:38.300159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 268/528] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:38.300329 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fec77-8592-43ce-a3b0-d1637516cd95 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:38.305209 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96f16d-5f46-4548-8633-feb049ee0d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:38.305898 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96f16d-5f46-4548-8633-feb049ee0d63 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:38.306455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96f16d-5f46-4548-8633-feb049ee0d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:38.306455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96f16d-5f46-4548-8633-feb049ee0d63 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:38.307741 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96f16d-5f46-4548-8633-feb049ee0d63 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:38.307741 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96f16d-5f46-4548-8633-feb049ee0d63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:38.309037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96f16d-5f46-4548-8633-feb049ee0d63 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:38.332324 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 261/529] 10.222.0.76 () {56 vars in 1139 bytes} [Mon Jul 18 16:29:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:38.333251 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96f16d-5f46-4548-8633-feb049ee0d63 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:38.422718 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:38.423874 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:38.442509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fec77-8592-43ce-a3b0-d1637516cd95 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:38.446510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96f16d-5f46-4548-8633-feb049ee0d63 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:38.481820 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47251ec3-3d89-4ac4-a318-ab8c5c2c802a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:38.482528 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47251ec3-3d89-4ac4-a318-ab8c5c2c802a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:38.482819 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47251ec3-3d89-4ac4-a318-ab8c5c2c802a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:38.483100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47251ec3-3d89-4ac4-a318-ab8c5c2c802a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:38.484170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47251ec3-3d89-4ac4-a318-ab8c5c2c802a None admin] RBAC: Adding query filter params (role.id=ce6bff4fd8b6468b94dc4af858dde77b, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=381cf4381ce64379b285d75e2909813d) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:38.484510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47251ec3-3d89-4ac4-a318-ab8c5c2c802a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:38.485849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e5585-494c-4d6e-9ea3-f7d068c4004c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:38.485993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47251ec3-3d89-4ac4-a318-ab8c5c2c802a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:38.486844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e5585-494c-4d6e-9ea3-f7d068c4004c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:38.487318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e5585-494c-4d6e-9ea3-f7d068c4004c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:38.487781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88e5585-494c-4d6e-9ea3-f7d068c4004c None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:38.488945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e5585-494c-4d6e-9ea3-f7d068c4004c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:38.490023 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e5585-494c-4d6e-9ea3-f7d068c4004c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:38.492113 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88e5585-494c-4d6e-9ea3-f7d068c4004c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:38.492631 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 269/530] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:38 2022] GET /identity/v3/role_assignments?user.id=381cf4381ce64379b285d75e2909813d&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=ce6bff4fd8b6468b94dc4af858dde77b => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:38.493636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47251ec3-3d89-4ac4-a318-ab8c5c2c802a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:38.526712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 262/531] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:29:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:38.526712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e5585-494c-4d6e-9ea3-f7d068c4004c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:38.634995 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47251ec3-3d89-4ac4-a318-ab8c5c2c802a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:38.669562 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88e5585-494c-4d6e-9ea3-f7d068c4004c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:38.683338 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97339d-ef2b-418e-be45-be4860d5c272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:38.684985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97339d-ef2b-418e-be45-be4860d5c272 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:38.685462 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97339d-ef2b-418e-be45-be4860d5c272 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:38.686468 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b97339d-ef2b-418e-be45-be4860d5c272 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:38.696079 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97339d-ef2b-418e-be45-be4860d5c272 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:38.698207 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b97339d-ef2b-418e-be45-be4860d5c272 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:38.715287 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42132827-9358-461c-bdda-a753e73fc4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:38.716485 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42132827-9358-461c-bdda-a753e73fc4dc None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:38.717363 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42132827-9358-461c-bdda-a753e73fc4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:38.717937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42132827-9358-461c-bdda-a753e73fc4dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:38.719151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-9b97339d-ef2b-418e-be45-be4860d5c272 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:38.719151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:38.719151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:38.719151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:38.719151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:38.719151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:38.719151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:38.719151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:38.719151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:38.719151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:38.719151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:38.719151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:38.719151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:29:38.719151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:29:38.719151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:29:38.720160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:29:38.720160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:38.720160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:38.720160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:38.720160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:38.720160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:38.720160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:38.720160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:38.720160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:38.720160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:38.720160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:38.720160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:38.720160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:38.720160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:38.720160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:38.720160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:38.720160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:38.721263 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:29:38.721263 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:29:38.721263 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:29:38.721263 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:29:38.721263 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:29:38.721263 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:29:38.721263 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:38.721263 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:38.723117 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 270/532] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:38.725465 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97339d-ef2b-418e-be45-be4860d5c272 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:38.732603 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:38.739505 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:38.811091 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42132827-9358-461c-bdda-a753e73fc4dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:38.812901 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42132827-9358-461c-bdda-a753e73fc4dc None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:38.862386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b97339d-ef2b-418e-be45-be4860d5c272 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:38.912793 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d64e9-d339-4c00-aa94-fd9a212bae83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:38.913688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d64e9-d339-4c00-aa94-fd9a212bae83 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:38.914178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d64e9-d339-4c00-aa94-fd9a212bae83 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:38.914619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476d64e9-d339-4c00-aa94-fd9a212bae83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:38.915976 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d64e9-d339-4c00-aa94-fd9a212bae83 None admin] RBAC: Adding query filter params (role.id=ce6bff4fd8b6468b94dc4af858dde77b, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=a1e1900754214020931b202e98f660a0) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:38.916694 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d64e9-d339-4c00-aa94-fd9a212bae83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:38.919201 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476d64e9-d339-4c00-aa94-fd9a212bae83 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:38.934760 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 271/533] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:38 2022] GET /identity/v3/role_assignments?user.id=a1e1900754214020931b202e98f660a0&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=ce6bff4fd8b6468b94dc4af858dde77b => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:38.936130 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d64e9-d339-4c00-aa94-fd9a212bae83 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:38.937217 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 263/534] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:29:38.944929 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42132827-9358-461c-bdda-a753e73fc4dc None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:39.016946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:39.101528 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:39.160492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42132827-9358-461c-bdda-a753e73fc4dc None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:39.178072 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476d64e9-d339-4c00-aa94-fd9a212bae83 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:39.196812 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970151d1-c4b9-425a-8987-65b8bb6f60be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:39.197566 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970151d1-c4b9-425a-8987-65b8bb6f60be None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:39.197855 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970151d1-c4b9-425a-8987-65b8bb6f60be None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:39.198134 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970151d1-c4b9-425a-8987-65b8bb6f60be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:39.210265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970151d1-c4b9-425a-8987-65b8bb6f60be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:39.211761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970151d1-c4b9-425a-8987-65b8bb6f60be None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:39.231385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-970151d1-c4b9-425a-8987-65b8bb6f60be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:39.231385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:39.231385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:39.231385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:39.231385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:39.231385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:39.231385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:39.231385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:39.231385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:39.231385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:39.231385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:39.231385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:39.231385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:39.231385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:39.231385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:39.232345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:39.232345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:39.232345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:39.232345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:39.232345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:39.232345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:39.232345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:39.232345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:39.232345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:39.232345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:39.232345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:39.232345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:39.232345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:39.232345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:39.232345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:39.232345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:39.232345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:39.233256 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:39.233256 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:39.233256 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:39.233256 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:39.245038 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 264/535] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:39.245038 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970151d1-c4b9-425a-8987-65b8bb6f60be None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:39.273754 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca89dd-3976-42de-abf1-c83b3aafce61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:39.274439 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca89dd-3976-42de-abf1-c83b3aafce61 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:39.274720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca89dd-3976-42de-abf1-c83b3aafce61 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:39.274994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca89dd-3976-42de-abf1-c83b3aafce61 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:39.275797 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca89dd-3976-42de-abf1-c83b3aafce61 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:39.276107 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca89dd-3976-42de-abf1-c83b3aafce61 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:39.277594 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca89dd-3976-42de-abf1-c83b3aafce61 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:39.312229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 272/536] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:29:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:39.317989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca89dd-3976-42de-abf1-c83b3aafce61 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:39.343089 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:39.367182 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970151d1-c4b9-425a-8987-65b8bb6f60be None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:39.445273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26d7cd-3980-462e-9c36-24c548c0f4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:39.445961 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26d7cd-3980-462e-9c36-24c548c0f4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:39.446248 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26d7cd-3980-462e-9c36-24c548c0f4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:39.446533 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c26d7cd-3980-462e-9c36-24c548c0f4c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:39.447330 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26d7cd-3980-462e-9c36-24c548c0f4c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:39.447586 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26d7cd-3980-462e-9c36-24c548c0f4c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:39.449047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c26d7cd-3980-462e-9c36-24c548c0f4c1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:39.471447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca89dd-3976-42de-abf1-c83b3aafce61 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:39.479650 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 265/537] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:39.481697 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26d7cd-3980-462e-9c36-24c548c0f4c1 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:39.535358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:39.546826 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a5abf-2392-40cc-a782-ed9f3c766225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:39.547505 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a5abf-2392-40cc-a782-ed9f3c766225 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:39.547791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a5abf-2392-40cc-a782-ed9f3c766225 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:39.548072 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a5abf-2392-40cc-a782-ed9f3c766225 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:39.548918 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a5abf-2392-40cc-a782-ed9f3c766225 None admin] RBAC: Adding query filter params (role.id=ce6bff4fd8b6468b94dc4af858dde77b, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=55d75cd269ff4f0daf51a728b159888a) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:39.549263 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a5abf-2392-40cc-a782-ed9f3c766225 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:39.550719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a5abf-2392-40cc-a782-ed9f3c766225 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:39.565427 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 273/538] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:39 2022] GET /identity/v3/role_assignments?user.id=55d75cd269ff4f0daf51a728b159888a&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=ce6bff4fd8b6468b94dc4af858dde77b => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:39.632444 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c26d7cd-3980-462e-9c36-24c548c0f4c1 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:39.682855 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d472fd0-c608-4e17-9308-34eb5508dad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:39.683697 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d472fd0-c608-4e17-9308-34eb5508dad6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:39.683983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d472fd0-c608-4e17-9308-34eb5508dad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:39.684260 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d472fd0-c608-4e17-9308-34eb5508dad6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:39.692320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d472fd0-c608-4e17-9308-34eb5508dad6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:39.693853 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d472fd0-c608-4e17-9308-34eb5508dad6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:39.717793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-9d472fd0-c608-4e17-9308-34eb5508dad6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:39.717793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:39.717793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:39.717793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:39.717793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:39.717793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:39.717793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:39.717793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:39.717793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:39.717793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:39.717793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:39.717793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:39.717793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:29:39.717793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:29:39.717793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:29:39.718734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:29:39.718734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:39.718734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:39.718734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:39.718734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:39.718734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:39.718734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:39.718734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:39.718734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:39.718734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:39.718734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:39.718734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:39.718734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:39.718734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:39.718734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:39.718734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:39.718734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:39.719597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:29:39.719597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:29:39.719597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:29:39.719597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:29:39.719597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:29:39.719597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:29:39.719597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:39.719597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:39.719597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 266/539] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:39.725481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a5abf-2392-40cc-a782-ed9f3c766225 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:39.854035 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a5abf-2392-40cc-a782-ed9f3c766225 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:39.900788 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705da178-f6d9-40e7-afce-fc0ab3ebc091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:39.901685 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705da178-f6d9-40e7-afce-fc0ab3ebc091 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:39.901777 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705da178-f6d9-40e7-afce-fc0ab3ebc091 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:39.902050 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705da178-f6d9-40e7-afce-fc0ab3ebc091 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:39.902850 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705da178-f6d9-40e7-afce-fc0ab3ebc091 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:39.903162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705da178-f6d9-40e7-afce-fc0ab3ebc091 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:39.904719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705da178-f6d9-40e7-afce-fc0ab3ebc091 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:39.921115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 274/540] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:29:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:39.924798 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d472fd0-c608-4e17-9308-34eb5508dad6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:39.939592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:40.057202 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d472fd0-c608-4e17-9308-34eb5508dad6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:40.108472 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5ca6a6-380c-41fd-88e8-b94b5b796b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:40.109175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ca6a6-380c-41fd-88e8-b94b5b796b75 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:40.109465 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ca6a6-380c-41fd-88e8-b94b5b796b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:40.109748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ca6a6-380c-41fd-88e8-b94b5b796b75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:40.110604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ca6a6-380c-41fd-88e8-b94b5b796b75 None admin] RBAC: Adding query filter params (role.id=ce6bff4fd8b6468b94dc4af858dde77b, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=e9dcca05df70446090cd525c0644cfc8) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:40.110921 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ca6a6-380c-41fd-88e8-b94b5b796b75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:40.112379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5ca6a6-380c-41fd-88e8-b94b5b796b75 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:40.121263 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 267/541] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:39 2022] GET /identity/v3/role_assignments?user.id=e9dcca05df70446090cd525c0644cfc8&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=ce6bff4fd8b6468b94dc4af858dde77b => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:40.627403 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce8ca2-2324-45ca-925e-6965fee2edc8 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:40.629212 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce8ca2-2324-45ca-925e-6965fee2edc8 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:40.629212 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fce8ca2-2324-45ca-925e-6965fee2edc8 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:40.630582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 275/542] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:29:40.636488 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36359c-f1c7-45cd-a5f7-f54cb5928aab None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:40.637104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36359c-f1c7-45cd-a5f7-f54cb5928aab None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:40.637604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a36359c-f1c7-45cd-a5f7-f54cb5928aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:40.656993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4a36359c-f1c7-45cd-a5f7-f54cb5928aab None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:40.658633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4a36359c-f1c7-45cd-a5f7-f54cb5928aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:40.734459 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 268/543] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:40.758715 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce8ca2-2324-45ca-925e-6965fee2edc8 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:40.827970 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:40.906765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fce8ca2-2324-45ca-925e-6965fee2edc8 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:40.958679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22707ea1-184b-49f2-981b-412dc9f483f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:40.959851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22707ea1-184b-49f2-981b-412dc9f483f0 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:40.960328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22707ea1-184b-49f2-981b-412dc9f483f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:40.960844 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22707ea1-184b-49f2-981b-412dc9f483f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:40.971917 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22707ea1-184b-49f2-981b-412dc9f483f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:40.979958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-22707ea1-184b-49f2-981b-412dc9f483f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:40.979958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:40.979958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:40.979958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:40.979958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:40.979958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:40.979958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:40.979958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:40.979958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:40.979958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:40.979958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:40.979958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:40.979958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:40.979958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:40.979958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:40.979958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:40.980899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:40.980899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:40.980899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:40.980899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:40.980899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:40.980899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:40.980899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:40.980899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:40.980899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:40.980899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:40.980899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:40.980899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:40.980899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:40.980899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:40.980899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:40.980899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:40.981723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:40.981723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:40.981723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:40.981723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:40.981723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:40.981723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:40.981723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:40.981723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:40.981723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:40.981723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:40.981723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:40.981723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:40.984721 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 276/544] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:29:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:40.990826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36359c-f1c7-45cd-a5f7-f54cb5928aab None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:41.008346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:41.112354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a36359c-f1c7-45cd-a5f7-f54cb5928aab None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:41.161763 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38bccf-8a3c-48cb-8429-3ef4342fbdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:41.162389 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38bccf-8a3c-48cb-8429-3ef4342fbdd8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:41.162681 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38bccf-8a3c-48cb-8429-3ef4342fbdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:41.162964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38bccf-8a3c-48cb-8429-3ef4342fbdd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:41.163741 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38bccf-8a3c-48cb-8429-3ef4342fbdd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:41.164056 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38bccf-8a3c-48cb-8429-3ef4342fbdd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:41.165483 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce38bccf-8a3c-48cb-8429-3ef4342fbdd8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:41.180431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df508884-3122-414a-b9df-cac9c45fca24 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:41.181237 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df508884-3122-414a-b9df-cac9c45fca24 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:41.181814 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df508884-3122-414a-b9df-cac9c45fca24 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:41.184112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 269/545] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 16:29:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:41.184890 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 277/546] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:41.190661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d230d78-ccf7-42ac-bd4d-9ba5b596abc3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:41.191201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d230d78-ccf7-42ac-bd4d-9ba5b596abc3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:41.191662 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d230d78-ccf7-42ac-bd4d-9ba5b596abc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:41.195113 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df508884-3122-414a-b9df-cac9c45fca24 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:41.231244 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0d230d78-ccf7-42ac-bd4d-9ba5b596abc3 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:41.234452 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0d230d78-ccf7-42ac-bd4d-9ba5b596abc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:41.345039 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:41.354049 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 270/547] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:41.389352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d230d78-ccf7-42ac-bd4d-9ba5b596abc3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:41.434898 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df508884-3122-414a-b9df-cac9c45fca24 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:41.472534 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:41.501896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabb4ed-aea8-42da-88b8-a7bdd9799dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:41.502876 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabb4ed-aea8-42da-88b8-a7bdd9799dfb None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:41.503161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabb4ed-aea8-42da-88b8-a7bdd9799dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:41.503751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aabb4ed-aea8-42da-88b8-a7bdd9799dfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:41.516599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabb4ed-aea8-42da-88b8-a7bdd9799dfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:41.518352 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aabb4ed-aea8-42da-88b8-a7bdd9799dfb None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:41.544097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-5aabb4ed-aea8-42da-88b8-a7bdd9799dfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:41.544097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:41.544097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:41.544097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:41.544097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:41.544097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:41.544097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:41.544097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:41.544097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:41.544097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:41.544097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:41.544097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:41.544097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:41.544097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:41.544097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:41.545590 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:41.545590 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:41.545590 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:41.545590 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:41.545590 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:41.545590 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:41.545590 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:41.545590 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:41.545590 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:41.545590 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:41.545590 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:41.545590 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:41.545590 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:41.545590 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:41.545590 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:41.545590 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:41.545590 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:41.546965 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:41.546965 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:41.546965 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:41.546965 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:41.550387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 278/548] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:41.553197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabb4ed-aea8-42da-88b8-a7bdd9799dfb None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:41.599513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d230d78-ccf7-42ac-bd4d-9ba5b596abc3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:41.646464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d179b4d-d29e-4552-a116-c6bcfdbdc93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:41.647302 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d179b4d-d29e-4552-a116-c6bcfdbdc93c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:41.647583 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d179b4d-d29e-4552-a116-c6bcfdbdc93c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:41.647856 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d179b4d-d29e-4552-a116-c6bcfdbdc93c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:41.664351 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d179b4d-d29e-4552-a116-c6bcfdbdc93c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:41.679663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-4d179b4d-d29e-4552-a116-c6bcfdbdc93c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:41.679663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:41.679663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:41.679663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:41.679663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:41.679663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:41.679663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:41.679663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:41.679663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:41.679663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:41.679663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:41.679663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:41.679663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:41.679663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:41.679663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:41.679663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:41.680691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:41.680691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:41.680691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:41.680691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:41.680691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:41.680691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:41.680691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:41.680691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:41.680691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:41.680691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:41.680691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:41.680691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:41.680691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:41.680691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:41.680691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:41.680691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:41.681552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:41.681552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:41.681552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:41.681552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:41.681552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:41.681552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:41.681552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:41.681552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:41.681552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:41.681552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:41.681552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:41.681552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:41.683184 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 271/549] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:29:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:41.694315 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d179b4d-d29e-4552-a116-c6bcfdbdc93c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:41.748991 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aabb4ed-aea8-42da-88b8-a7bdd9799dfb None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:41.797204 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b99ea-328d-49d2-920e-d6e290d0ed19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:41.797897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b99ea-328d-49d2-920e-d6e290d0ed19 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:41.798172 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b99ea-328d-49d2-920e-d6e290d0ed19 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:41.798452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b99ea-328d-49d2-920e-d6e290d0ed19 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:41.799194 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b99ea-328d-49d2-920e-d6e290d0ed19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:41.799536 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b99ea-328d-49d2-920e-d6e290d0ed19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:41.800930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b99ea-328d-49d2-920e-d6e290d0ed19 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:41.824726 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:41.825141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 279/550] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:41.833846 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf48110-51e1-4d75-a062-bd415fb5532d None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:41.834261 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf48110-51e1-4d75-a062-bd415fb5532d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:41.834397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf48110-51e1-4d75-a062-bd415fb5532d None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:41.835994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 280/551] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:29:41.836708 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf48110-51e1-4d75-a062-bd415fb5532d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:41.872251 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:41.888564 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d179b4d-d29e-4552-a116-c6bcfdbdc93c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:41.943656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72271d63-d142-4afc-88e3-7cc7dcc6725c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:41.944278 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72271d63-d142-4afc-88e3-7cc7dcc6725c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:41.944668 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72271d63-d142-4afc-88e3-7cc7dcc6725c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:41.944960 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72271d63-d142-4afc-88e3-7cc7dcc6725c None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:41.945809 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72271d63-d142-4afc-88e3-7cc7dcc6725c None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:41.946120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72271d63-d142-4afc-88e3-7cc7dcc6725c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:41.947627 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72271d63-d142-4afc-88e3-7cc7dcc6725c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:41.963189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 272/552] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 16:29:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:41.964717 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8e413-65d9-4cac-83a7-6d4f91c2242e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:41.965031 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8e413-65d9-4cac-83a7-6d4f91c2242e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:41.965391 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8e413-65d9-4cac-83a7-6d4f91c2242e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:41.982242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf48110-51e1-4d75-a062-bd415fb5532d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:41.982792 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d7c8e413-65d9-4cac-83a7-6d4f91c2242e None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:41.983817 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d7c8e413-65d9-4cac-83a7-6d4f91c2242e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:42.040574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca0a3e-fc19-4ec4-ab0a-03f1ea1fb107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:42.042279 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca0a3e-fc19-4ec4-ab0a-03f1ea1fb107 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:42.043038 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca0a3e-fc19-4ec4-ab0a-03f1ea1fb107 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:42.043527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca0a3e-fc19-4ec4-ab0a-03f1ea1fb107 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:42.054047 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca0a3e-fc19-4ec4-ab0a-03f1ea1fb107 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:42.056718 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca0a3e-fc19-4ec4-ab0a-03f1ea1fb107 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:42.069394 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 273/553] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:42.070302 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8e413-65d9-4cac-83a7-6d4f91c2242e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:42.076221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-94ca0a3e-fc19-4ec4-ab0a-03f1ea1fb107 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:29:42.076221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:42.076221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:42.076221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:42.076221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:42.076221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:42.076221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:42.076221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:42.076221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:42.076221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:42.076221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:42.076221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:42.076221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:29:42.076221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:29:42.076221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:29:42.076221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:29:42.077476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:42.077476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:42.077476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:29:42.077476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:42.077476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:29:42.077476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:42.077476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:42.077476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:42.077476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:42.077476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:42.077476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:42.077476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:42.077476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:42.077476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:42.077476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:42.077476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:42.077476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:42.077476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:42.078400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:42.078400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:42.078400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:29:42.078400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:29:42.078400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:29:42.078400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:29:42.078400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:29:42.078400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:29:42.078400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:29:42.078400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:42.082314 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 281/554] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:29:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:42.088788 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca0a3e-fc19-4ec4-ab0a-03f1ea1fb107 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:42.143520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:42.203584 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8e413-65d9-4cac-83a7-6d4f91c2242e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:42.215003 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:42.240862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca0a3e-fc19-4ec4-ab0a-03f1ea1fb107 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:42.249756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696156a5-8678-4a07-ad65-e6d8dce8ee9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:42.250569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696156a5-8678-4a07-ad65-e6d8dce8ee9c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:42.250852 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696156a5-8678-4a07-ad65-e6d8dce8ee9c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:42.251126 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696156a5-8678-4a07-ad65-e6d8dce8ee9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:42.265715 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696156a5-8678-4a07-ad65-e6d8dce8ee9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:42.267358 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696156a5-8678-4a07-ad65-e6d8dce8ee9c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:42.286822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-696156a5-8678-4a07-ad65-e6d8dce8ee9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:42.286822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:42.286822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:42.286822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:42.286822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:42.286822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:42.286822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:42.286822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:42.286822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:42.286822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:42.286822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:42.286822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:42.286822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:42.286822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:42.286822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:42.287761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:42.287761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:42.287761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:42.287761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:42.287761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:42.287761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:42.287761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:42.287761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:42.287761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:42.287761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:42.287761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:42.287761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:42.287761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:42.287761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:42.287761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:42.287761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:42.287761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:42.288711 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:42.288711 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:42.288711 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:42.288711 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:42.289490 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011424ab-51f5-4fb9-b818-9e20a391beab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:42.289490 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011424ab-51f5-4fb9-b818-9e20a391beab None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:42.289490 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011424ab-51f5-4fb9-b818-9e20a391beab None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:42.289490 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011424ab-51f5-4fb9-b818-9e20a391beab None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:42.289782 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011424ab-51f5-4fb9-b818-9e20a391beab None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:42.289782 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011424ab-51f5-4fb9-b818-9e20a391beab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:42.291229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011424ab-51f5-4fb9-b818-9e20a391beab None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:42.292750 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 274/555] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:42.293718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696156a5-8678-4a07-ad65-e6d8dce8ee9c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:42.315865 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 282/556] 10.222.0.76 () {56 vars in 1135 bytes} [Mon Jul 18 16:29:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:42.315865 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a6731-007a-4662-a51c-20879945308a None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:42.315865 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a6731-007a-4662-a51c-20879945308a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:42.315865 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a6731-007a-4662-a51c-20879945308a None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:42.315865 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 283/557] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:42.315865 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a6731-007a-4662-a51c-20879945308a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:42.406019 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:42.409045 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696156a5-8678-4a07-ad65-e6d8dce8ee9c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:42.431219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a6731-007a-4662-a51c-20879945308a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:42.447765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f18dc4-85a0-4245-914d-a5884fbe6db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:42.448558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f18dc4-85a0-4245-914d-a5884fbe6db9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:42.448842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f18dc4-85a0-4245-914d-a5884fbe6db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:42.449158 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f18dc4-85a0-4245-914d-a5884fbe6db9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:42.461552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f18dc4-85a0-4245-914d-a5884fbe6db9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:42.469501 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacf7ff-2b34-4364-921c-747aaa24cf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:42.470181 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacf7ff-2b34-4364-921c-747aaa24cf61 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:42.470466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacf7ff-2b34-4364-921c-747aaa24cf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:42.470747 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacf7ff-2b34-4364-921c-747aaa24cf61 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:42.471124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-57f18dc4-85a0-4245-914d-a5884fbe6db9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:42.471124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:42.471124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:42.471124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:42.471124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:42.471124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:42.471124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:42.471124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:42.471124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:42.471124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:42.471124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:42.471124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:42.471124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:42.471124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:42.471124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:42.471124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:42.472520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:42.472520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:42.472520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:42.472520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:42.472520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:42.472520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:42.472520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:42.472520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:42.472520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:42.472520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:42.472520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:42.472520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:42.472520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:42.472520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:42.472520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:42.472520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:42.473476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:42.473476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:42.473476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:42.473476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:42.473476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:42.473476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:42.473476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:42.473476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:42.473476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:42.473476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:42.473476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:42.473476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:42.474105 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddacf7ff-2b34-4364-921c-747aaa24cf61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:42.474105 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddacf7ff-2b34-4364-921c-747aaa24cf61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:42.474105 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddacf7ff-2b34-4364-921c-747aaa24cf61 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:42.477437 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 275/558] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:29:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:42.478882 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f18dc4-85a0-4245-914d-a5884fbe6db9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:42.491279 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 284/559] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:42.492453 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbca16-4f44-42a1-bce8-8bd62a4d6fe7 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:42.492746 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbca16-4f44-42a1-bce8-8bd62a4d6fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:42.493040 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dbca16-4f44-42a1-bce8-8bd62a4d6fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:42.502559 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:42.514819 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c1dbca16-4f44-42a1-bce8-8bd62a4d6fe7 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:42.516063 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c1dbca16-4f44-42a1-bce8-8bd62a4d6fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:42.594841 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 285/560] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:42.595482 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbca16-4f44-42a1-bce8-8bd62a4d6fe7 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:42.611895 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f18dc4-85a0-4245-914d-a5884fbe6db9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:42.648733 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa7ca59-5717-4031-882d-ffbdbce2e000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:42.649455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7ca59-5717-4031-882d-ffbdbce2e000 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:42.649731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7ca59-5717-4031-882d-ffbdbce2e000 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:42.650005 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa7ca59-5717-4031-882d-ffbdbce2e000 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:42.680019 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:42.710481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dbca16-4f44-42a1-bce8-8bd62a4d6fe7 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:42.721388 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7ca59-5717-4031-882d-ffbdbce2e000 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:42.722786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa7ca59-5717-4031-882d-ffbdbce2e000 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:42.745150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e354b-1e62-4432-a5df-153e5ac63dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:42.746081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e354b-1e62-4432-a5df-153e5ac63dab None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:42.746368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e354b-1e62-4432-a5df-153e5ac63dab None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:42.746640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e354b-1e62-4432-a5df-153e5ac63dab None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:42.747385 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e354b-1e62-4432-a5df-153e5ac63dab None admin] RBAC: Adding query filter params (name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:42.748184 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e354b-1e62-4432-a5df-153e5ac63dab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:42.749689 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e354b-1e62-4432-a5df-153e5ac63dab None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:42.751054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:42.758481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 286/561] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 16:29:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:42.759266 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e354b-1e62-4432-a5df-153e5ac63dab None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:42.828251 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 276/562] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:29:42.829638 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ab6ed-f920-4209-bf9f-024ed853f19b None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:42.829927 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ab6ed-f920-4209-bf9f-024ed853f19b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:42.830203 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ab6ed-f920-4209-bf9f-024ed853f19b None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:42.831656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 277/563] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:42.835886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ab6ed-f920-4209-bf9f-024ed853f19b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:42.864140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e354b-1e62-4432-a5df-153e5ac63dab None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:42.898695 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:42.899685 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769b47e-2426-4ce2-ad24-3e1c60903bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:42.900492 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769b47e-2426-4ce2-ad24-3e1c60903bd7 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:42.900774 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769b47e-2426-4ce2-ad24-3e1c60903bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:42.901099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769b47e-2426-4ce2-ad24-3e1c60903bd7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:42.908887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769b47e-2426-4ce2-ad24-3e1c60903bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:42.911201 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769b47e-2426-4ce2-ad24-3e1c60903bd7 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:42.924515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-3769b47e-2426-4ce2-ad24-3e1c60903bd7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:29:42.924515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:42.924515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:42.924515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:42.924515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:42.924515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:42.924515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:42.924515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:42.924515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:42.924515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:42.924515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:42.924515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:42.924515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:29:42.924515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:29:42.924515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:29:42.924515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:29:42.925582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:42.925582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:42.925582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:29:42.925582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:42.925582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:29:42.925582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:42.925582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:42.925582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:42.925582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:42.925582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:42.925582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:42.925582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:42.925582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:42.925582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:42.925582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:42.925582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:42.925582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:42.925582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:42.926603 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:42.926603 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:42.926603 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:29:42.926603 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:29:42.926603 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:29:42.926603 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:29:42.926603 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:29:42.926603 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:29:42.926603 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:29:42.926603 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:42.926603 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 287/564] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Jul 18 16:29:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:42.926603 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769b47e-2426-4ce2-ad24-3e1c60903bd7 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:42.944713 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ab6ed-f920-4209-bf9f-024ed853f19b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:42.979774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c8f0a-f123-478f-b601-a9eca85677e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:42.980481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c8f0a-f123-478f-b601-a9eca85677e5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:42.980779 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c8f0a-f123-478f-b601-a9eca85677e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:42.981088 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c8f0a-f123-478f-b601-a9eca85677e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:42.984907 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:42.992635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c8f0a-f123-478f-b601-a9eca85677e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:43.001377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-506c8f0a-f123-478f-b601-a9eca85677e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:43.001377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:43.001377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:43.001377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:43.001377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:43.001377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:43.001377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:43.001377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:43.001377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:43.001377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:43.001377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:43.001377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:43.001377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:43.001377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:43.001377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:43.001377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:43.002544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:43.002544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:43.002544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:43.002544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:43.002544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:43.002544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:43.002544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:43.002544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:43.002544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:43.002544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:43.002544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:43.002544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:43.002544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:43.002544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:43.002544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:43.002544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:43.003496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:43.003496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:43.003496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:43.003496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:43.003496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:43.003496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:43.003496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:43.003496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:43.003496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:43.003496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:43.003496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:43.003496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:43.003496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 278/565] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:29:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:43.004327 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c8f0a-f123-478f-b601-a9eca85677e5 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:43.032302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769b47e-2426-4ce2-ad24-3e1c60903bd7 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:43.066575 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7a556-e7fa-4eea-b4b6-fe82f5e2ce4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:43.067367 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7a556-e7fa-4eea-b4b6-fe82f5e2ce4a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:43.067648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7a556-e7fa-4eea-b4b6-fe82f5e2ce4a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:43.067920 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7a556-e7fa-4eea-b4b6-fe82f5e2ce4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:43.079541 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7a556-e7fa-4eea-b4b6-fe82f5e2ce4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:43.080993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7a556-e7fa-4eea-b4b6-fe82f5e2ce4a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:43.099033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-3cc7a556-e7fa-4eea-b4b6-fe82f5e2ce4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:43.099033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:43.099033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:43.099033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:43.099033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:43.099033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:43.099033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:43.099033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:43.099033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:43.099033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:43.099033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:43.099033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:43.099033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:43.099033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:43.099033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:43.099959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:43.099959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:43.099959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:43.099959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:43.099959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:43.099959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:43.099959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:43.099959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:43.099959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:43.099959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:43.099959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:43.099959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:43.099959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:43.099959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:43.099959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:43.099959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:43.099959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:43.100920 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:43.100920 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:43.100920 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:43.100920 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:43.100920 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 288/566] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:43.101635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896d9ec-2cb5-47d2-949c-d4c988506955 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:43.101917 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896d9ec-2cb5-47d2-949c-d4c988506955 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:43.102195 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8896d9ec-2cb5-47d2-949c-d4c988506955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:43.108746 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c8f0a-f123-478f-b601-a9eca85677e5 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:43.119100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-8896d9ec-2cb5-47d2-949c-d4c988506955 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:43.120333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8896d9ec-2cb5-47d2-949c-d4c988506955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:43.128817 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:43.143617 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db594f63-cda4-4e6e-8822-8a6954cf8e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:43.145921 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db594f63-cda4-4e6e-8822-8a6954cf8e26 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:43.145921 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db594f63-cda4-4e6e-8822-8a6954cf8e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:43.145921 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db594f63-cda4-4e6e-8822-8a6954cf8e26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:43.157574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db594f63-cda4-4e6e-8822-8a6954cf8e26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:43.159045 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db594f63-cda4-4e6e-8822-8a6954cf8e26 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:43.176624 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-db594f63-cda4-4e6e-8822-8a6954cf8e26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:43.176624 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:43.176624 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:43.176624 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:43.176624 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:43.176624 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:43.176624 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:43.176624 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:43.176624 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:43.176624 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:43.176624 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:43.176624 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:43.176624 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:43.176624 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:43.176624 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:43.177722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:43.177722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:43.177722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:43.177722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:43.177722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:43.177722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:43.177722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:43.177722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:43.177722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:43.177722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:43.177722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:43.177722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:43.177722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:43.177722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:43.177722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:43.177722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:43.177722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:43.178616 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:43.178616 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:43.178616 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:43.178616 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:43.178616 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 279/567] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:43.179341 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db594f63-cda4-4e6e-8822-8a6954cf8e26 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:43.193399 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 289/568] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:43.194234 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896d9ec-2cb5-47d2-949c-d4c988506955 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:43.248036 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:43.284130 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db594f63-cda4-4e6e-8822-8a6954cf8e26 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:43.309320 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8896d9ec-2cb5-47d2-949c-d4c988506955 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:43.317626 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d81578-6a7f-4471-afca-a578390de129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:43.318297 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d81578-6a7f-4471-afca-a578390de129 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:43.318579 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d81578-6a7f-4471-afca-a578390de129 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:43.318857 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d81578-6a7f-4471-afca-a578390de129 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:43.319693 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d81578-6a7f-4471-afca-a578390de129 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:43.319998 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d81578-6a7f-4471-afca-a578390de129 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:43.321492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d81578-6a7f-4471-afca-a578390de129 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:43.339773 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 280/569] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Jul 18 16:29:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:43.340602 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d81578-6a7f-4471-afca-a578390de129 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:43.345136 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca282ae-7fa9-42d2-8368-99c2d43f6719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:43.345832 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca282ae-7fa9-42d2-8368-99c2d43f6719 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:43.346116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca282ae-7fa9-42d2-8368-99c2d43f6719 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:43.346397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca282ae-7fa9-42d2-8368-99c2d43f6719 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:43.347151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca282ae-7fa9-42d2-8368-99c2d43f6719 None admin] RBAC: Adding query filter params (name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:43.347461 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca282ae-7fa9-42d2-8368-99c2d43f6719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:43.348856 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca282ae-7fa9-42d2-8368-99c2d43f6719 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:43.357490 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 290/570] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 16:29:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:43.358277 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca282ae-7fa9-42d2-8368-99c2d43f6719 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:43.376447 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:43.450581 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d81578-6a7f-4471-afca-a578390de129 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:43.457870 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:43.461287 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca282ae-7fa9-42d2-8368-99c2d43f6719 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:43.487099 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fccf9f-625e-4aa0-886e-47f7d26387d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:43.487766 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fccf9f-625e-4aa0-886e-47f7d26387d1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:43.488092 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fccf9f-625e-4aa0-886e-47f7d26387d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:43.488333 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fccf9f-625e-4aa0-886e-47f7d26387d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:43.489085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fccf9f-625e-4aa0-886e-47f7d26387d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:43.489442 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fccf9f-625e-4aa0-886e-47f7d26387d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:43.490908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fccf9f-625e-4aa0-886e-47f7d26387d1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:43.494184 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f9772-04a5-4f14-9f06-c61d02d9b121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:43.494891 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f9772-04a5-4f14-9f06-c61d02d9b121 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:43.495182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f9772-04a5-4f14-9f06-c61d02d9b121 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:43.495685 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41f9772-04a5-4f14-9f06-c61d02d9b121 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:43.496834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f9772-04a5-4f14-9f06-c61d02d9b121 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:43.497217 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f9772-04a5-4f14-9f06-c61d02d9b121 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:43.499687 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41f9772-04a5-4f14-9f06-c61d02d9b121 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:43.503541 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 281/571] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:43.504353 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fccf9f-625e-4aa0-886e-47f7d26387d1 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:43.517534 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 291/572] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:43.517534 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f9772-04a5-4f14-9f06-c61d02d9b121 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:43.605088 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:43.614521 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fccf9f-625e-4aa0-886e-47f7d26387d1 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:43.619848 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41f9772-04a5-4f14-9f06-c61d02d9b121 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:43.652327 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c4786-afd0-4612-9d5c-e4d60d26ccb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:43.653163 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c4786-afd0-4612-9d5c-e4d60d26ccb4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:43.653444 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c4786-afd0-4612-9d5c-e4d60d26ccb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:43.653720 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c4786-afd0-4612-9d5c-e4d60d26ccb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:43.657302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d9489-7e9e-44bd-b92f-e59ba4ded7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:43.658378 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d9489-7e9e-44bd-b92f-e59ba4ded7bd None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:43.658680 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d9489-7e9e-44bd-b92f-e59ba4ded7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:43.659886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d9489-7e9e-44bd-b92f-e59ba4ded7bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:43.665088 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c4786-afd0-4612-9d5c-e4d60d26ccb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:43.669130 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d9489-7e9e-44bd-b92f-e59ba4ded7bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:43.670657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d9489-7e9e-44bd-b92f-e59ba4ded7bd None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:43.672989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-8e8c4786-afd0-4612-9d5c-e4d60d26ccb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:43.672989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:43.672989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:43.672989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:43.672989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:43.672989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:43.672989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:43.672989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:43.672989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:43.672989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:43.672989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:43.672989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:43.672989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:43.672989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:43.672989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:43.672989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:43.674180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:43.674180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:43.674180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:43.674180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:43.674180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:43.674180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:43.674180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:43.674180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:43.674180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:43.674180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:43.674180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:43.674180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:43.674180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:43.674180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:43.674180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:43.674180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:43.675222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:43.675222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:43.675222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:43.675222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:43.675222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:43.675222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:43.675222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:43.675222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:43.675222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:43.675222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:43.675222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:43.675222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:43.675222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 282/573] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:29:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:43.675222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c4786-afd0-4612-9d5c-e4d60d26ccb4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:43.692074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-f47d9489-7e9e-44bd-b92f-e59ba4ded7bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:43.692074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:43.692074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:43.692074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:43.692074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:43.692074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:43.692074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:43.692074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:43.692074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:43.692074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:43.692074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:43.692074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:43.692074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:43.692074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:43.692074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:43.693245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:43.693245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:43.693245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:43.693245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:43.693245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:43.693245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:43.693245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:43.693245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:43.693245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:43.693245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:43.693245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:43.693245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:43.693245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:43.693245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:43.693245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:43.693245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:43.693245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:43.694157 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:43.694157 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:43.694157 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:43.694157 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:43.694157 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 292/574] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:43.694157 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d9489-7e9e-44bd-b92f-e59ba4ded7bd None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:43.713812 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:43.784582 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c4786-afd0-4612-9d5c-e4d60d26ccb4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:43.801608 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d9489-7e9e-44bd-b92f-e59ba4ded7bd None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:43.819925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9dbca-4b93-4047-a931-c781ad467498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:43.820885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9dbca-4b93-4047-a931-c781ad467498 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:43.821182 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9dbca-4b93-4047-a931-c781ad467498 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:43.821469 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac9dbca-4b93-4047-a931-c781ad467498 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:43.832362 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9dbca-4b93-4047-a931-c781ad467498 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:43.833866 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac9dbca-4b93-4047-a931-c781ad467498 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:43.836187 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca2675-ab93-47ff-885a-e5a7c473e688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:43.836989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca2675-ab93-47ff-885a-e5a7c473e688 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:43.837305 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca2675-ab93-47ff-885a-e5a7c473e688 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:43.837618 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca2675-ab93-47ff-885a-e5a7c473e688 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:43.844887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca2675-ab93-47ff-885a-e5a7c473e688 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:43.846344 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ca2675-ab93-47ff-885a-e5a7c473e688 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:43.851466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-6ac9dbca-4b93-4047-a931-c781ad467498 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:43.851466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:43.851466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:43.851466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:43.851466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:43.851466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:43.851466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:43.851466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:43.851466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:43.851466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:43.851466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:43.851466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:43.851466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:43.851466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:43.851466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:43.852477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:43.852477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:43.852477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:43.852477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:43.852477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:43.852477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:43.852477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:43.852477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:43.852477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:43.852477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:43.852477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:43.852477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:43.852477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:43.852477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:43.852477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:43.852477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:43.852477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:43.853582 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:43.853582 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:43.853582 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:43.853582 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:43.853582 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 283/575] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:43.853921 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9dbca-4b93-4047-a931-c781ad467498 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:43.856336 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:43.866131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-58ca2675-ab93-47ff-885a-e5a7c473e688 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 16:29:43.866131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:43.866131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:43.866131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:43.866131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:43.866131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:43.866131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:43.866131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:43.866131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:43.866131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:43.866131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:43.866131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:43.866131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:29:43.866131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:29:43.866131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:29:43.866131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:29:43.873442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:43.873442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:43.873442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:29:43.873442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:43.873442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:29:43.873442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:43.873442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:43.873442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:43.873442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:43.873442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:43.873442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:43.873442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:43.873442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:43.873442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:43.873442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:43.873442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:43.873442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:43.873442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:43.874600 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:43.874600 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:43.874600 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:29:43.874600 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:29:43.874600 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:29:43.874600 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:29:43.874600 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:29:43.874600 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:29:43.874600 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 16:29:43.874600 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:43.874600 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 293/576] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:43.874600 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca2675-ab93-47ff-885a-e5a7c473e688 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:43.944774 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:43.962165 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac9dbca-4b93-4047-a931-c781ad467498 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:43.978722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ca2675-ab93-47ff-885a-e5a7c473e688 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:43.998372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93b480-786e-42de-a36b-9d3b33243e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:43.999201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93b480-786e-42de-a36b-9d3b33243e4d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:43.999489 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93b480-786e-42de-a36b-9d3b33243e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:43.999865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93b480-786e-42de-a36b-9d3b33243e4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:44.007493 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93b480-786e-42de-a36b-9d3b33243e4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:44.008979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93b480-786e-42de-a36b-9d3b33243e4d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:44.015369 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b4f17-bb29-47b8-a432-54c2e931ebb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:44.016042 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b4f17-bb29-47b8-a432-54c2e931ebb9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:44.016325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b4f17-bb29-47b8-a432-54c2e931ebb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:44.016599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b4f17-bb29-47b8-a432-54c2e931ebb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:44.017399 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b4f17-bb29-47b8-a432-54c2e931ebb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:44.017691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b4f17-bb29-47b8-a432-54c2e931ebb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:44.019056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b4f17-bb29-47b8-a432-54c2e931ebb9 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:44.024303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-3b93b480-786e-42de-a36b-9d3b33243e4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:44.024303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:44.024303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:44.024303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:44.024303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:44.024303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:44.024303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:44.024303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:44.024303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:44.024303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:44.024303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:44.024303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:44.024303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:29:44.024303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:29:44.024303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:29:44.025463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:29:44.025463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:44.025463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:44.025463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:44.025463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:44.025463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:44.025463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:44.025463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:44.025463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:44.025463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:44.025463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:44.025463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:44.025463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:44.025463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:44.025463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:44.025463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:44.025463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:44.026584 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:29:44.026584 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:29:44.026584 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:29:44.026584 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:29:44.026584 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:29:44.026584 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:29:44.026584 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:44.026584 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:44.026584 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 284/577] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:44.026584 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93b480-786e-42de-a36b-9d3b33243e4d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:44.030829 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 294/578] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 16:29:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:44.032026 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b4f17-bb29-47b8-a432-54c2e931ebb9 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:44.087601 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:44.130228 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93b480-786e-42de-a36b-9d3b33243e4d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:44.135702 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b4f17-bb29-47b8-a432-54c2e931ebb9 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:44.165627 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd888193-ccc1-4d0c-9500-43acb36baa8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:44.166297 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd888193-ccc1-4d0c-9500-43acb36baa8a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:44.166585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd888193-ccc1-4d0c-9500-43acb36baa8a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:44.166866 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd888193-ccc1-4d0c-9500-43acb36baa8a None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:44.167604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd888193-ccc1-4d0c-9500-43acb36baa8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:44.167914 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd888193-ccc1-4d0c-9500-43acb36baa8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:44.169336 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd888193-ccc1-4d0c-9500-43acb36baa8a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:44.174901 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74364497-d75d-4cf7-af09-9c68dec3e4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:44.175579 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74364497-d75d-4cf7-af09-9c68dec3e4b9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:44.175863 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74364497-d75d-4cf7-af09-9c68dec3e4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:44.176150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74364497-d75d-4cf7-af09-9c68dec3e4b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:44.176941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74364497-d75d-4cf7-af09-9c68dec3e4b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:44.177287 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74364497-d75d-4cf7-af09-9c68dec3e4b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:44.178696 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74364497-d75d-4cf7-af09-9c68dec3e4b9 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:44.180248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:44.181227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 285/579] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:44.182045 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd888193-ccc1-4d0c-9500-43acb36baa8a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:44.193532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 295/580] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:44.193532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74364497-d75d-4cf7-af09-9c68dec3e4b9 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:44.288954 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd888193-ccc1-4d0c-9500-43acb36baa8a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:44.295977 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74364497-d75d-4cf7-af09-9c68dec3e4b9 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:44.312961 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:44.324765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0208ad-6f59-4b4a-a94c-62ee347420ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:44.325479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0208ad-6f59-4b4a-a94c-62ee347420ab None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:44.325860 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0208ad-6f59-4b4a-a94c-62ee347420ab None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:44.327549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0208ad-6f59-4b4a-a94c-62ee347420ab None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:44.327549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0208ad-6f59-4b4a-a94c-62ee347420ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:44.327549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0208ad-6f59-4b4a-a94c-62ee347420ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:44.328887 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0208ad-6f59-4b4a-a94c-62ee347420ab None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:44.331244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fde7f5-1bb0-4a74-bb3a-f7079d291cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:44.331917 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fde7f5-1bb0-4a74-bb3a-f7079d291cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:44.332202 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fde7f5-1bb0-4a74-bb3a-f7079d291cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:44.332482 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fde7f5-1bb0-4a74-bb3a-f7079d291cc8 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:44.333348 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fde7f5-1bb0-4a74-bb3a-f7079d291cc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:44.333661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fde7f5-1bb0-4a74-bb3a-f7079d291cc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:44.335076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fde7f5-1bb0-4a74-bb3a-f7079d291cc8 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:44.346721 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 286/581] 10.222.0.76 () {56 vars in 1137 bytes} [Mon Jul 18 16:29:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:44.352353 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 296/582] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:29:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:44.352516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0208ad-6f59-4b4a-a94c-62ee347420ab None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:44.352613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fde7f5-1bb0-4a74-bb3a-f7079d291cc8 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:44.404589 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:44.450610 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fde7f5-1bb0-4a74-bb3a-f7079d291cc8 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:44.456335 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0208ad-6f59-4b4a-a94c-62ee347420ab None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:44.485180 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27201172-94bf-40d2-927c-e4cb1fbfdf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:44.485987 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27201172-94bf-40d2-927c-e4cb1fbfdf64 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:44.486273 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27201172-94bf-40d2-927c-e4cb1fbfdf64 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:44.486556 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27201172-94bf-40d2-927c-e4cb1fbfdf64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:44.490877 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4d77d-cde1-4011-992a-74042cbbb56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:44.491677 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4d77d-cde1-4011-992a-74042cbbb56f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:44.491961 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4d77d-cde1-4011-992a-74042cbbb56f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:44.492234 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a4d77d-cde1-4011-992a-74042cbbb56f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:44.495021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27201172-94bf-40d2-927c-e4cb1fbfdf64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:44.496746 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27201172-94bf-40d2-927c-e4cb1fbfdf64 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:44.502833 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4d77d-cde1-4011-992a-74042cbbb56f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:44.504295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a4d77d-cde1-4011-992a-74042cbbb56f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:44.511514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-27201172-94bf-40d2-927c-e4cb1fbfdf64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:44.511514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:44.511514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:44.511514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:44.511514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:44.511514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:44.511514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:44.511514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:44.511514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:44.511514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:44.511514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:44.511514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:44.511514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:29:44.511514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:29:44.511514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:29:44.512574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:29:44.512574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:44.512574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:44.512574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:44.512574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:44.512574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:44.512574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:44.512574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:44.512574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:44.512574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:44.512574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:44.512574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:44.512574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:44.512574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:44.512574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:44.512574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:44.512574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:44.514594 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:29:44.514594 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:29:44.514594 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:29:44.514594 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:29:44.514594 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:29:44.514594 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:29:44.514594 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:44.514594 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:44.514594 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 297/583] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:44.514594 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27201172-94bf-40d2-927c-e4cb1fbfdf64 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:44.522593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-38a4d77d-cde1-4011-992a-74042cbbb56f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:44.522593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:44.522593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:44.522593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:44.522593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:44.522593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:44.522593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:44.522593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:44.522593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:44.522593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:44.522593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:44.522593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:44.522593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:44.522593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:44.522593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:44.523661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:44.523661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:44.523661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:44.523661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:44.523661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:44.523661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:44.523661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:44.523661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:44.523661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:44.523661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:44.523661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:44.523661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:44.523661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:44.523661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:44.523661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:44.523661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:44.523661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:44.524607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:44.524607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:44.524607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:44.524607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:44.524607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 287/584] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:44.524898 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4d77d-cde1-4011-992a-74042cbbb56f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:44.556574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:44.625472 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a4d77d-cde1-4011-992a-74042cbbb56f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:44.625662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27201172-94bf-40d2-927c-e4cb1fbfdf64 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:44.640537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:44.660863 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedddce9-3b7d-4f69-8c8a-3184f4467ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:44.661476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7f31d-4470-417a-b96c-c4ba805e5770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:44.661689 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedddce9-3b7d-4f69-8c8a-3184f4467ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:44.661977 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedddce9-3b7d-4f69-8c8a-3184f4467ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:44.662256 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedddce9-3b7d-4f69-8c8a-3184f4467ec6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:44.662350 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7f31d-4470-417a-b96c-c4ba805e5770 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:44.662537 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7f31d-4470-417a-b96c-c4ba805e5770 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:44.662810 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7f31d-4470-417a-b96c-c4ba805e5770 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:44.669401 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedddce9-3b7d-4f69-8c8a-3184f4467ec6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:44.671183 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedddce9-3b7d-4f69-8c8a-3184f4467ec6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:44.672765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7f31d-4470-417a-b96c-c4ba805e5770 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:44.674290 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7f31d-4470-417a-b96c-c4ba805e5770 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:44.686859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-fedddce9-3b7d-4f69-8c8a-3184f4467ec6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 16:29:44.686859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:44.686859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:44.686859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:44.686859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:44.686859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:44.686859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:44.686859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:44.686859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:44.686859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:44.686859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:44.686859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:44.686859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:29:44.686859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:29:44.686859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:29:44.686859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:29:44.688081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:44.688081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:44.688081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:29:44.688081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:44.688081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:29:44.688081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:44.688081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:44.688081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:44.688081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:44.688081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:44.688081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:44.688081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:44.688081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:44.688081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:44.688081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:44.688081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:44.688081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:44.688081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:44.689476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:44.689476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:44.689476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:29:44.689476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:29:44.689476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:29:44.689476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:29:44.689476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:29:44.689476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:29:44.689476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 16:29:44.689476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:44.689476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 298/585] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:44.689476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedddce9-3b7d-4f69-8c8a-3184f4467ec6 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:44.691912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-85b7f31d-4470-417a-b96c-c4ba805e5770 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:44.691912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:44.691912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:44.691912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:44.691912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:44.691912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:44.691912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:44.691912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:44.691912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:44.691912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:44.691912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:44.691912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:44.691912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:44.691912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:44.691912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:44.693201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:44.693201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:44.693201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:44.693201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:44.693201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:44.693201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:44.693201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:44.693201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:44.693201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:44.693201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:44.693201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:44.693201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:44.693201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:44.693201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:44.693201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:44.693201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:44.693201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:44.695585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:44.695585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:44.695585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:44.695585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:44.695585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 288/586] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:44.695585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7f31d-4470-417a-b96c-c4ba805e5770 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:44.780308 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:44.795762 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7f31d-4470-417a-b96c-c4ba805e5770 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:44.798614 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedddce9-3b7d-4f69-8c8a-3184f4467ec6 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:44.830587 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caeadf-5eab-4d17-91ad-9414fbc64f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:44.831265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caeadf-5eab-4d17-91ad-9414fbc64f2b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:44.831550 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caeadf-5eab-4d17-91ad-9414fbc64f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:44.831826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99caeadf-5eab-4d17-91ad-9414fbc64f2b None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:44.832614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99caeadf-5eab-4d17-91ad-9414fbc64f2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:44.832923 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99caeadf-5eab-4d17-91ad-9414fbc64f2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:44.834470 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99caeadf-5eab-4d17-91ad-9414fbc64f2b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:44.834921 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59037360-c28a-4bb4-a1e2-27419113b8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:44.835612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59037360-c28a-4bb4-a1e2-27419113b8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:44.835892 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59037360-c28a-4bb4-a1e2-27419113b8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:44.836167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59037360-c28a-4bb4-a1e2-27419113b8e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:44.836989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59037360-c28a-4bb4-a1e2-27419113b8e3 None admin] RBAC: Adding query filter params (role.id=ce6bff4fd8b6468b94dc4af858dde77b, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=50bc0fa34b414328a342d685bc1eaca3) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:44.837324 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59037360-c28a-4bb4-a1e2-27419113b8e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:44.838737 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59037360-c28a-4bb4-a1e2-27419113b8e3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:44.844953 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 299/587] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:44 2022] GET /identity/v3/role_assignments?user.id=50bc0fa34b414328a342d685bc1eaca3&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=ce6bff4fd8b6468b94dc4af858dde77b => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:44.845752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59037360-c28a-4bb4-a1e2-27419113b8e3 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:44.859082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 289/588] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:29:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:44.860612 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caeadf-5eab-4d17-91ad-9414fbc64f2b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:44.897169 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:44.969001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59037360-c28a-4bb4-a1e2-27419113b8e3 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:44.979284 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99caeadf-5eab-4d17-91ad-9414fbc64f2b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:45.011994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f49169-4b13-440f-8780-e7be0c1a2f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:45.013399 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f49169-4b13-440f-8780-e7be0c1a2f06 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:45.013751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f49169-4b13-440f-8780-e7be0c1a2f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:45.013973 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f49169-4b13-440f-8780-e7be0c1a2f06 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:45.014712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f49169-4b13-440f-8780-e7be0c1a2f06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:45.015022 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f49169-4b13-440f-8780-e7be0c1a2f06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:45.016410 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f49169-4b13-440f-8780-e7be0c1a2f06 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:45.024089 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacff67-273d-4633-91a4-ddf23e2e80e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:45.024773 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacff67-273d-4633-91a4-ddf23e2e80e8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:45.025208 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacff67-273d-4633-91a4-ddf23e2e80e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:45.025490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacff67-273d-4633-91a4-ddf23e2e80e8 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:45.026337 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacff67-273d-4633-91a4-ddf23e2e80e8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:45.026652 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacff67-273d-4633-91a4-ddf23e2e80e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:45.028109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacff67-273d-4633-91a4-ddf23e2e80e8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:45.029436 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 300/589] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:45.031269 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f49169-4b13-440f-8780-e7be0c1a2f06 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:45.051569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 290/590] 10.222.0.76 () {56 vars in 1137 bytes} [Mon Jul 18 16:29:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:45.052812 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacff67-273d-4633-91a4-ddf23e2e80e8 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:45.057983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:45.144794 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:45.149201 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f49169-4b13-440f-8780-e7be0c1a2f06 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:45.166327 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacff67-273d-4633-91a4-ddf23e2e80e8 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:45.192944 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a9a09-8ef6-49b0-88a6-4d9835c169ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:45.194152 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a9a09-8ef6-49b0-88a6-4d9835c169ae None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:45.194938 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a9a09-8ef6-49b0-88a6-4d9835c169ae None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:45.195581 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a9a09-8ef6-49b0-88a6-4d9835c169ae None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:45.196599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a9a09-8ef6-49b0-88a6-4d9835c169ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:45.197280 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a9a09-8ef6-49b0-88a6-4d9835c169ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:45.199407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a9a09-8ef6-49b0-88a6-4d9835c169ae None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:45.202682 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b2d77-7f51-4cf0-933c-675003238254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:45.203587 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b2d77-7f51-4cf0-933c-675003238254 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:45.203876 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b2d77-7f51-4cf0-933c-675003238254 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:45.204160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b2d77-7f51-4cf0-933c-675003238254 None admin] PATH_INFO: `/v3/projects/30a4824228ec47519a01574d82879b25/users/381cf4381ce64379b285d75e2909813d/roles/ce6bff4fd8b6468b94dc4af858dde77b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:45.217193 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 301/591] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:45.218246 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a9a09-8ef6-49b0-88a6-4d9835c169ae None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:45.224315 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b2d77-7f51-4cf0-933c-675003238254 None admin] RBAC: Authorizing `identity:create_grant(project_id=30a4824228ec47519a01574d82879b25, user_id=381cf4381ce64379b285d75e2909813d, role_id=ce6bff4fd8b6468b94dc4af858dde77b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:45.225813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b2d77-7f51-4cf0-933c-675003238254 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:45.319797 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a9a09-8ef6-49b0-88a6-4d9835c169ae None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:45.325327 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 291/592] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:29:45 2022] PUT /identity/v3/projects/30a4824228ec47519a01574d82879b25/users/381cf4381ce64379b285d75e2909813d/roles/ce6bff4fd8b6468b94dc4af858dde77b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:29:45.327193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b2d77-7f51-4cf0-933c-675003238254 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:45.367728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd582cd5-501b-4f54-b556-33217f65d840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:45.368597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd582cd5-501b-4f54-b556-33217f65d840 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:45.368894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd582cd5-501b-4f54-b556-33217f65d840 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:45.369259 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd582cd5-501b-4f54-b556-33217f65d840 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:45.378382 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd582cd5-501b-4f54-b556-33217f65d840 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:45.380217 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd582cd5-501b-4f54-b556-33217f65d840 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:45.398481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-dd582cd5-501b-4f54-b556-33217f65d840 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 16:29:45.398481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:45.398481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:45.398481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:45.398481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:45.398481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:45.398481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:45.398481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:45.398481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:45.398481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:45.398481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:45.398481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:45.398481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:29:45.398481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:29:45.398481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:29:45.398481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:29:45.399634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:45.399634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:45.399634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:29:45.399634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:45.399634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:29:45.399634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:45.399634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:45.399634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:45.399634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:45.399634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:45.399634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:45.399634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:45.399634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:45.399634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:45.399634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:45.399634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:45.399634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:45.399634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:45.400595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:45.400595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:45.400595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:29:45.400595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:29:45.400595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:29:45.400595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:29:45.400595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:29:45.400595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:29:45.400595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 16:29:45.400595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:45.405760 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 302/593] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:29:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:45.406746 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd582cd5-501b-4f54-b556-33217f65d840 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:45.408627 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:45.428624 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:45.475005 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b2d77-7f51-4cf0-933c-675003238254 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:45.530658 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8cc62-1f3b-4090-b4cf-725a09b92965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:45.531316 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8cc62-1f3b-4090-b4cf-725a09b92965 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:45.531605 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8cc62-1f3b-4090-b4cf-725a09b92965 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:45.531883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8cc62-1f3b-4090-b4cf-725a09b92965 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:45.532129 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd582cd5-501b-4f54-b556-33217f65d840 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:45.547299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8cc62-1f3b-4090-b4cf-725a09b92965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:45.548226 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8cc62-1f3b-4090-b4cf-725a09b92965 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:45.568365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-bfb8cc62-1f3b-4090-b4cf-725a09b92965 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:45.568365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:45.568365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:45.568365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:45.568365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:45.568365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:45.568365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:45.568365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:45.568365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:45.568365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:45.568365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:45.568365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:45.568365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:45.568365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:45.568365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:45.569372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:45.569372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:45.569372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:45.569372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:45.569372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:45.569372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:45.569372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:45.569372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:45.569372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:45.569372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:45.569372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:45.569372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:45.569372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:45.569372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:45.569372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:45.569372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:45.569372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:45.570614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:45.570614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:45.570614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:45.570614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:45.570614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 292/594] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:45.570614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8cc62-1f3b-4090-b4cf-725a09b92965 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:45.585046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b37cf-d4f5-4e16-a59f-6cf053238522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:45.586323 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b37cf-d4f5-4e16-a59f-6cf053238522 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:45.586810 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b37cf-d4f5-4e16-a59f-6cf053238522 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:45.587286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b37cf-d4f5-4e16-a59f-6cf053238522 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:45.595455 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b37cf-d4f5-4e16-a59f-6cf053238522 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:45.597285 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b37cf-d4f5-4e16-a59f-6cf053238522 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:45.612393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-3a2b37cf-d4f5-4e16-a59f-6cf053238522 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:45.612393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:45.612393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:45.612393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:45.612393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:45.612393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:45.612393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:45.612393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:45.612393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:45.612393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:45.612393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:45.612393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:45.612393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:29:45.612393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:29:45.612393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:29:45.613371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:29:45.613371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:45.613371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:45.613371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:45.613371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:45.613371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:45.613371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:45.613371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:45.613371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:45.613371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:45.613371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:45.613371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:45.613371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:45.613371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:45.613371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:45.613371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:45.613371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:45.614318 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:29:45.614318 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:29:45.614318 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:29:45.614318 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:29:45.614318 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:29:45.614318 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:29:45.614318 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:45.614318 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:45.621134 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 303/595] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:45.622326 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b37cf-d4f5-4e16-a59f-6cf053238522 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:45.703123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8cc62-1f3b-4090-b4cf-725a09b92965 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:45.706323 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:45.721426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:45.741906 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b37cf-d4f5-4e16-a59f-6cf053238522 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:45.756696 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c92976-182d-4de6-b9fa-e57b6074ba93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:45.757805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c92976-182d-4de6-b9fa-e57b6074ba93 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:45.758621 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c92976-182d-4de6-b9fa-e57b6074ba93 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:45.759443 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c92976-182d-4de6-b9fa-e57b6074ba93 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:45.760580 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c92976-182d-4de6-b9fa-e57b6074ba93 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:45.761550 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c92976-182d-4de6-b9fa-e57b6074ba93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:45.765323 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c92976-182d-4de6-b9fa-e57b6074ba93 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:45.796366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0c6dc-3ffe-47fe-9632-0c87e96a9e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:45.796366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0c6dc-3ffe-47fe-9632-0c87e96a9e44 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:45.796366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0c6dc-3ffe-47fe-9632-0c87e96a9e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:45.796366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0c6dc-3ffe-47fe-9632-0c87e96a9e44 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:45.796786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0c6dc-3ffe-47fe-9632-0c87e96a9e44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:45.796786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0c6dc-3ffe-47fe-9632-0c87e96a9e44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:45.796786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af0c6dc-3ffe-47fe-9632-0c87e96a9e44 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:45.797297 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 293/596] 10.222.0.76 () {56 vars in 1139 bytes} [Mon Jul 18 16:29:45 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:45.800753 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c92976-182d-4de6-b9fa-e57b6074ba93 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:45.816275 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 304/597] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:45.816275 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0c6dc-3ffe-47fe-9632-0c87e96a9e44 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:45.926699 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af0c6dc-3ffe-47fe-9632-0c87e96a9e44 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:45.950270 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c92976-182d-4de6-b9fa-e57b6074ba93 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:45.970073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560e420-cf8f-455c-a1fa-e3f5bb5b8219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:45.971391 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560e420-cf8f-455c-a1fa-e3f5bb5b8219 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:45.972493 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560e420-cf8f-455c-a1fa-e3f5bb5b8219 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:45.973119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560e420-cf8f-455c-a1fa-e3f5bb5b8219 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:45.984066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:45.989840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560e420-cf8f-455c-a1fa-e3f5bb5b8219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:45.990191 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa948a6b-aaaf-4d09-99e6-7a5c7b6ee1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:45.991003 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa948a6b-aaaf-4d09-99e6-7a5c7b6ee1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:45.991354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa948a6b-aaaf-4d09-99e6-7a5c7b6ee1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:45.997285 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa948a6b-aaaf-4d09-99e6-7a5c7b6ee1f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:45.997524 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560e420-cf8f-455c-a1fa-e3f5bb5b8219 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:45.997632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa948a6b-aaaf-4d09-99e6-7a5c7b6ee1f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:45.997632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa948a6b-aaaf-4d09-99e6-7a5c7b6ee1f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:45.997632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa948a6b-aaaf-4d09-99e6-7a5c7b6ee1f9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:46.009049 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 294/598] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:29:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:46.010277 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa948a6b-aaaf-4d09-99e6-7a5c7b6ee1f9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:46.018150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-0560e420-cf8f-455c-a1fa-e3f5bb5b8219 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:46.018150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:46.018150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:46.018150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:46.018150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:46.018150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:46.018150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:46.018150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:46.018150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:46.018150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:46.018150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:46.018150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:46.018150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:46.018150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:46.018150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:46.019582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:46.019582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:46.019582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:46.019582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:46.019582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:46.019582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:46.019582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:46.019582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:46.019582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:46.019582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:46.019582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:46.019582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:46.019582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:46.019582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:46.019582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:46.019582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:46.019582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:46.020498 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:46.020498 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:46.020498 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:46.020498 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:46.027803 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 305/599] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:46.027803 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560e420-cf8f-455c-a1fa-e3f5bb5b8219 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:46.056155 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:46.154308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560e420-cf8f-455c-a1fa-e3f5bb5b8219 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:46.158245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa948a6b-aaaf-4d09-99e6-7a5c7b6ee1f9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:46.193995 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da219a56-a3a3-44b4-a5f0-fa608c6ff314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:46.195610 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da219a56-a3a3-44b4-a5f0-fa608c6ff314 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:46.195610 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da219a56-a3a3-44b4-a5f0-fa608c6ff314 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:46.195976 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da219a56-a3a3-44b4-a5f0-fa608c6ff314 None admin] PATH_INFO: `/v3/projects/30a4824228ec47519a01574d82879b25/users/a1e1900754214020931b202e98f660a0/roles/ce6bff4fd8b6468b94dc4af858dde77b` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:46.206045 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a254f8-2fb1-426b-810b-6b4df8df8278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:46.208115 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a254f8-2fb1-426b-810b-6b4df8df8278 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:46.208765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a254f8-2fb1-426b-810b-6b4df8df8278 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:46.209416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a254f8-2fb1-426b-810b-6b4df8df8278 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:46.214359 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da219a56-a3a3-44b4-a5f0-fa608c6ff314 None admin] RBAC: Authorizing `identity:create_grant(project_id=30a4824228ec47519a01574d82879b25, user_id=a1e1900754214020931b202e98f660a0, role_id=ce6bff4fd8b6468b94dc4af858dde77b)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:46.215811 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da219a56-a3a3-44b4-a5f0-fa608c6ff314 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:46.218767 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a254f8-2fb1-426b-810b-6b4df8df8278 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:46.221451 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a254f8-2fb1-426b-810b-6b4df8df8278 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:46.236591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-a1a254f8-2fb1-426b-810b-6b4df8df8278 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:46.236591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:46.236591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:46.236591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:46.236591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:46.236591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:46.236591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:46.236591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:46.236591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:46.236591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:46.236591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:46.236591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:46.236591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:29:46.236591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:29:46.236591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:29:46.237764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:29:46.237764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:46.237764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:46.237764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:46.237764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:46.237764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:46.237764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:46.237764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:46.237764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:46.237764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:46.237764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:46.237764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:46.237764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:46.237764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:46.237764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:46.237764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:46.237764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:46.238671 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:29:46.238671 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:29:46.238671 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:29:46.238671 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:29:46.238671 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:29:46.238671 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:29:46.238671 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:46.238671 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:46.238671 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 295/600] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:46.238671 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a254f8-2fb1-426b-810b-6b4df8df8278 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:46.285905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 306/601] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:29:46 2022] PUT /identity/v3/projects/30a4824228ec47519a01574d82879b25/users/a1e1900754214020931b202e98f660a0/roles/ce6bff4fd8b6468b94dc4af858dde77b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:29:46.287796 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da219a56-a3a3-44b4-a5f0-fa608c6ff314 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:46.337394 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:46.351049 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:46.372107 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a254f8-2fb1-426b-810b-6b4df8df8278 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:46.426648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da219a56-a3a3-44b4-a5f0-fa608c6ff314 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:46.470985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebefe6-ca58-4860-8afe-17b75ba97222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:46.472142 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebefe6-ca58-4860-8afe-17b75ba97222 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:46.472664 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebefe6-ca58-4860-8afe-17b75ba97222 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:46.473195 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebefe6-ca58-4860-8afe-17b75ba97222 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:46.474363 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebefe6-ca58-4860-8afe-17b75ba97222 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:46.474890 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebefe6-ca58-4860-8afe-17b75ba97222 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:46.476582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebefe6-ca58-4860-8afe-17b75ba97222 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:46.479321 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70818fa-362d-4987-a253-4818f1c4a2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:46.480016 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70818fa-362d-4987-a253-4818f1c4a2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:46.480305 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70818fa-362d-4987-a253-4818f1c4a2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:46.480589 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70818fa-362d-4987-a253-4818f1c4a2d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:46.481375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70818fa-362d-4987-a253-4818f1c4a2d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:46.481688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70818fa-362d-4987-a253-4818f1c4a2d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:46.483991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70818fa-362d-4987-a253-4818f1c4a2d6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:46.498609 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 307/602] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:29:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:46.504909 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebefe6-ca58-4860-8afe-17b75ba97222 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:46.523522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 296/603] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:46.530419 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70818fa-362d-4987-a253-4818f1c4a2d6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:46.687675 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:46.693158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebefe6-ca58-4860-8afe-17b75ba97222 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:46.705343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70818fa-362d-4987-a253-4818f1c4a2d6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:46.764816 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e07fe0-4400-41bc-aef5-6d146651e96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:46.766115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e07fe0-4400-41bc-aef5-6d146651e96a None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:46.766626 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e07fe0-4400-41bc-aef5-6d146651e96a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:46.767109 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e07fe0-4400-41bc-aef5-6d146651e96a None admin] PATH_INFO: `/v3/projects/30a4824228ec47519a01574d82879b25/users/55d75cd269ff4f0daf51a728b159888a/roles/ce6bff4fd8b6468b94dc4af858dde77b` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:46.779292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83c0fe-e345-4c08-b8de-88997bcfa07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:46.780474 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83c0fe-e345-4c08-b8de-88997bcfa07b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:46.780971 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83c0fe-e345-4c08-b8de-88997bcfa07b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:46.782004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83c0fe-e345-4c08-b8de-88997bcfa07b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:46.793664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83c0fe-e345-4c08-b8de-88997bcfa07b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:46.796386 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83c0fe-e345-4c08-b8de-88997bcfa07b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:46.800453 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e07fe0-4400-41bc-aef5-6d146651e96a None admin] RBAC: Authorizing `identity:create_grant(project_id=30a4824228ec47519a01574d82879b25, user_id=55d75cd269ff4f0daf51a728b159888a, role_id=ce6bff4fd8b6468b94dc4af858dde77b)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:46.802176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e07fe0-4400-41bc-aef5-6d146651e96a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:46.819273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-1c83c0fe-e345-4c08-b8de-88997bcfa07b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:46.819273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:46.819273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:46.819273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:46.819273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:46.819273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:46.819273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:46.819273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:46.819273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:46.819273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:46.819273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:46.819273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:46.819273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:29:46.819273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:29:46.819273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:29:46.826441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:29:46.826441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:46.826441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:46.826441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:46.826441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:46.826441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:46.826441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:46.826441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:46.826441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:46.826441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:46.826441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:46.826441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:46.826441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:46.826441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:46.826441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:46.826441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:46.826441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:46.827334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:29:46.827334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:29:46.827334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:29:46.827334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:29:46.827334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:29:46.827334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:29:46.827334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:46.827334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:46.828276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 297/604] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:46.829955 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83c0fe-e345-4c08-b8de-88997bcfa07b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:46.839246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:46.908519 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 308/605] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:29:46 2022] PUT /identity/v3/projects/30a4824228ec47519a01574d82879b25/users/55d75cd269ff4f0daf51a728b159888a/roles/ce6bff4fd8b6468b94dc4af858dde77b => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:29:46.943978 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83c0fe-e345-4c08-b8de-88997bcfa07b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:46.982857 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a8c9f-952c-426e-ae8f-d9288d8a1c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:46.983695 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a8c9f-952c-426e-ae8f-d9288d8a1c51 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:46.984112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a8c9f-952c-426e-ae8f-d9288d8a1c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:46.984501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a8c9f-952c-426e-ae8f-d9288d8a1c51 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:46.985454 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a8c9f-952c-426e-ae8f-d9288d8a1c51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:46.985875 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a8c9f-952c-426e-ae8f-d9288d8a1c51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:46.987440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a8c9f-952c-426e-ae8f-d9288d8a1c51 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:46.996113 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1d044-eb97-47e3-9bad-efc4572fd018 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:46.996403 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1d044-eb97-47e3-9bad-efc4572fd018 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:46.996730 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1d044-eb97-47e3-9bad-efc4572fd018 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:47.001171 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 309/606] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:29:47.001822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 298/607] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:29:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:47.004572 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d64d1-77df-4964-9f4d-4958e573eee1 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:47.004867 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d64d1-77df-4964-9f4d-4958e573eee1 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:47.005254 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d64d1-77df-4964-9f4d-4958e573eee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:47.008064 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a8c9f-952c-426e-ae8f-d9288d8a1c51 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:47.024933 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-7a7d64d1-77df-4964-9f4d-4958e573eee1 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:47.026169 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7a7d64d1-77df-4964-9f4d-4958e573eee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:47.077062 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:47.151957 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 310/608] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:29:47.157311 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a8c9f-952c-426e-ae8f-d9288d8a1c51 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:47.176998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d64d1-77df-4964-9f4d-4958e573eee1 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:47.202251 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045da2ba-fb5b-4456-bff3-9e2b0a5356e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:47.203167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045da2ba-fb5b-4456-bff3-9e2b0a5356e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:47.203500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045da2ba-fb5b-4456-bff3-9e2b0a5356e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:47.203737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045da2ba-fb5b-4456-bff3-9e2b0a5356e3 None admin] PATH_INFO: `/v3/projects/30a4824228ec47519a01574d82879b25/users/e9dcca05df70446090cd525c0644cfc8/roles/ce6bff4fd8b6468b94dc4af858dde77b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:47.220692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045da2ba-fb5b-4456-bff3-9e2b0a5356e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=30a4824228ec47519a01574d82879b25, user_id=e9dcca05df70446090cd525c0644cfc8, role_id=ce6bff4fd8b6468b94dc4af858dde77b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:47.223076 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045da2ba-fb5b-4456-bff3-9e2b0a5356e3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:47.287978 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:47.309565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d64d1-77df-4964-9f4d-4958e573eee1 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:47.320376 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 299/609] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:29:47 2022] PUT /identity/v3/projects/30a4824228ec47519a01574d82879b25/users/e9dcca05df70446090cd525c0644cfc8/roles/ce6bff4fd8b6468b94dc4af858dde77b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:29:47.349248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07eb00-fb7f-4a40-8042-6f15faf444c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:47.350333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07eb00-fb7f-4a40-8042-6f15faf444c9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:47.350617 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07eb00-fb7f-4a40-8042-6f15faf444c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:47.350902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07eb00-fb7f-4a40-8042-6f15faf444c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:47.363484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07eb00-fb7f-4a40-8042-6f15faf444c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:47.372018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-fe07eb00-fb7f-4a40-8042-6f15faf444c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:47.372018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:47.372018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:47.372018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:47.372018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:47.372018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:47.372018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:47.372018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:47.372018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:47.372018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:47.372018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:47.372018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:47.372018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:47.372018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:47.372018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:47.372018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:47.378221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:47.378221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:47.378221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:47.378221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:47.378221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:47.378221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:47.378221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:47.378221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:47.378221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:47.378221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:47.378221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:47.378221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:47.378221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:47.378221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:47.378221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:47.378221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:47.379265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:47.379265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:47.379265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:47.379265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:47.379265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:47.379265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:47.379265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:47.379265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:47.379265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:47.379265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:47.379265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:47.379265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:47.379265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 311/610] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:29:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:47.386230 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045da2ba-fb5b-4456-bff3-9e2b0a5356e3 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:47.551349 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045da2ba-fb5b-4456-bff3-9e2b0a5356e3 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:47.573516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:47.603013 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a67d82-b3e5-4966-a058-960b368f0b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:47.603857 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a67d82-b3e5-4966-a058-960b368f0b86 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:47.604143 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a67d82-b3e5-4966-a058-960b368f0b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:47.604421 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a67d82-b3e5-4966-a058-960b368f0b86 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:47.605240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a67d82-b3e5-4966-a058-960b368f0b86 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:47.605552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a67d82-b3e5-4966-a058-960b368f0b86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:47.607022 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a67d82-b3e5-4966-a058-960b368f0b86 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:47.621430 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 300/611] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 16:29:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:47.627369 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07eb00-fb7f-4a40-8042-6f15faf444c9 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:47.741075 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07eb00-fb7f-4a40-8042-6f15faf444c9 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:47.765111 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbba07-029f-42de-846e-f0d41bf852df None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:47.765409 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbba07-029f-42de-846e-f0d41bf852df None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:47.765692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbba07-029f-42de-846e-f0d41bf852df None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:47.767230 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 301/612] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:47.772669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fd21b-5ee6-409f-bf66-ab2c0d8010e8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:47.773237 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fd21b-5ee6-409f-bf66-ab2c0d8010e8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:47.773723 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34fd21b-5ee6-409f-bf66-ab2c0d8010e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:47.783040 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826dc75-4282-4dc4-a716-dfad3da67646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:47.783853 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826dc75-4282-4dc4-a716-dfad3da67646 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:47.784202 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826dc75-4282-4dc4-a716-dfad3da67646 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:47.784487 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3826dc75-4282-4dc4-a716-dfad3da67646 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:47.793310 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c34fd21b-5ee6-409f-bf66-ab2c0d8010e8 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:47.795707 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c34fd21b-5ee6-409f-bf66-ab2c0d8010e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:47.797808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826dc75-4282-4dc4-a716-dfad3da67646 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:47.799294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3826dc75-4282-4dc4-a716-dfad3da67646 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:47.801672 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:47.818640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-3826dc75-4282-4dc4-a716-dfad3da67646 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:47.818640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:47.818640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:47.818640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:47.818640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:47.818640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:47.818640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:47.818640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:47.818640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:47.818640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:47.818640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:47.818640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:47.818640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:47.818640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:47.818640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:47.819622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:47.819622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:47.819622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:47.819622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:47.819622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:47.819622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:47.819622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:47.819622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:47.819622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:47.819622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:47.819622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:47.819622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:47.819622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:47.819622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:47.819622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:47.819622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:47.819622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:47.821150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:47.821150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:47.821150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:47.821150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:47.821150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 312/613] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:47.825874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826dc75-4282-4dc4-a716-dfad3da67646 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:47.909231 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 302/614] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:29:47.926690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fd21b-5ee6-409f-bf66-ab2c0d8010e8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:47.939203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3826dc75-4282-4dc4-a716-dfad3da67646 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:47.975615 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac830c88-c3b7-4cfd-84e0-1a6636e68a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:47.976293 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac830c88-c3b7-4cfd-84e0-1a6636e68a2b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:47.976581 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac830c88-c3b7-4cfd-84e0-1a6636e68a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:47.976859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac830c88-c3b7-4cfd-84e0-1a6636e68a2b None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:47.977619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac830c88-c3b7-4cfd-84e0-1a6636e68a2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:47.977926 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac830c88-c3b7-4cfd-84e0-1a6636e68a2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:47.979298 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac830c88-c3b7-4cfd-84e0-1a6636e68a2b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:47.992337 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 313/615] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:47.998059 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac830c88-c3b7-4cfd-84e0-1a6636e68a2b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:48.038965 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34fd21b-5ee6-409f-bf66-ab2c0d8010e8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:48.056219 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:48.076588 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f33f7-f6a5-4c6f-ac4a-181419a1cde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:48.077711 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f33f7-f6a5-4c6f-ac4a-181419a1cde6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:48.079541 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f33f7-f6a5-4c6f-ac4a-181419a1cde6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:48.079541 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f33f7-f6a5-4c6f-ac4a-181419a1cde6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:48.090066 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f33f7-f6a5-4c6f-ac4a-181419a1cde6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:48.101712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-a46f33f7-f6a5-4c6f-ac4a-181419a1cde6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:48.101712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:48.101712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:48.101712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:48.101712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:48.101712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:48.101712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:48.101712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:48.101712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:48.101712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:48.101712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:48.101712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:48.101712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:48.101712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:48.101712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:48.101712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:48.102883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:48.102883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:48.102883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:48.102883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:48.102883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:48.102883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:48.102883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:48.102883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:48.102883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:48.102883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:48.102883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:48.102883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:48.102883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:48.102883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:48.102883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:48.102883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:48.103950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:48.103950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:48.103950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:48.103950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:48.103950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:48.103950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:48.103950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:48.103950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:48.103950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:48.103950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:48.103950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:48.103950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:48.110996 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 303/616] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:29:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:48.113390 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f33f7-f6a5-4c6f-ac4a-181419a1cde6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:48.141325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:48.244088 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f33f7-f6a5-4c6f-ac4a-181419a1cde6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:48.284875 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac830c88-c3b7-4cfd-84e0-1a6636e68a2b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:48.300384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64f38d-0b5b-48fc-b40c-aa717e49fa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:48.301334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64f38d-0b5b-48fc-b40c-aa717e49fa9c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:48.301764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64f38d-0b5b-48fc-b40c-aa717e49fa9c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:48.302184 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64f38d-0b5b-48fc-b40c-aa717e49fa9c None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:48.303103 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64f38d-0b5b-48fc-b40c-aa717e49fa9c None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:48.303616 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64f38d-0b5b-48fc-b40c-aa717e49fa9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:48.305211 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64f38d-0b5b-48fc-b40c-aa717e49fa9c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:48.320917 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 304/617] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 16:29:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:48.328476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64f38d-0b5b-48fc-b40c-aa717e49fa9c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:48.369357 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e401b7-e86e-4ed3-b05b-6bf9089794a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:48.371194 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e401b7-e86e-4ed3-b05b-6bf9089794a4 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:48.374643 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e401b7-e86e-4ed3-b05b-6bf9089794a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:48.375161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e401b7-e86e-4ed3-b05b-6bf9089794a4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:48.386788 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e401b7-e86e-4ed3-b05b-6bf9089794a4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:48.389341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e401b7-e86e-4ed3-b05b-6bf9089794a4 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:48.393365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:48.405115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-a7e401b7-e86e-4ed3-b05b-6bf9089794a4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:29:48.405115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:48.405115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:48.405115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:48.405115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:48.405115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:48.405115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:48.405115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:48.405115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:48.405115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:48.405115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:48.405115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:48.405115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:29:48.405115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:29:48.405115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:29:48.405115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:29:48.406407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:48.406407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:48.406407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:29:48.406407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:48.406407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:29:48.406407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:48.406407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:48.406407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:48.406407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:48.406407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:48.406407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:48.406407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:48.406407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:48.406407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:48.406407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:48.406407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:48.406407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:48.406407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:48.407373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:48.407373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:48.407373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:29:48.407373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:29:48.407373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:29:48.407373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:29:48.407373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:29:48.407373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:29:48.407373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:29:48.407373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:48.407921 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 314/618] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:29:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:48.413710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e401b7-e86e-4ed3-b05b-6bf9089794a4 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:48.550185 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64f38d-0b5b-48fc-b40c-aa717e49fa9c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:48.606449 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e401b7-e86e-4ed3-b05b-6bf9089794a4 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:48.621226 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097c70d-d822-4959-9ad0-62f55174c650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:48.622044 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097c70d-d822-4959-9ad0-62f55174c650 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:48.622905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097c70d-d822-4959-9ad0-62f55174c650 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:48.623190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097c70d-d822-4959-9ad0-62f55174c650 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:48.645363 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:48.654161 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097c70d-d822-4959-9ad0-62f55174c650 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:48.655671 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097c70d-d822-4959-9ad0-62f55174c650 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:48.659801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a545f-a9fd-452e-97f8-f1875cb3729f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:48.660610 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a545f-a9fd-452e-97f8-f1875cb3729f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:48.665703 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a545f-a9fd-452e-97f8-f1875cb3729f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:48.665703 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a545f-a9fd-452e-97f8-f1875cb3729f None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:48.665703 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a545f-a9fd-452e-97f8-f1875cb3729f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:48.665703 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a545f-a9fd-452e-97f8-f1875cb3729f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:48.665703 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a545f-a9fd-452e-97f8-f1875cb3729f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:48.682695 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 315/619] 10.222.0.76 () {56 vars in 1135 bytes} [Mon Jul 18 16:29:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:48.688688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a545f-a9fd-452e-97f8-f1875cb3729f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:48.695181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-b097c70d-d822-4959-9ad0-62f55174c650 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:48.695181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:48.695181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:48.695181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:48.695181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:48.695181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:48.695181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:48.695181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:48.695181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:48.695181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:48.695181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:48.695181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:48.695181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:48.695181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:48.695181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:48.696905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:48.696905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:48.696905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:48.696905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:48.696905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:48.696905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:48.696905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:48.696905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:48.696905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:48.696905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:48.696905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:48.696905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:48.696905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:48.696905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:48.696905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:48.696905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:48.696905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:48.697847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:48.697847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:48.697847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:48.697847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:48.705527 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 305/620] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:48.720752 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097c70d-d822-4959-9ad0-62f55174c650 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:48.805653 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a545f-a9fd-452e-97f8-f1875cb3729f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:48.841882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4463e-0765-4819-b434-a9af8887ca01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:48.842692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4463e-0765-4819-b434-a9af8887ca01 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:48.842976 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4463e-0765-4819-b434-a9af8887ca01 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:48.843254 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4463e-0765-4819-b434-a9af8887ca01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:48.854379 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4463e-0765-4819-b434-a9af8887ca01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:48.855941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4463e-0765-4819-b434-a9af8887ca01 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:48.875236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-f4d4463e-0765-4819-b434-a9af8887ca01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:48.875236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:48.875236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:48.875236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:48.875236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:48.875236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:48.875236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:48.875236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:48.875236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:48.875236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:48.875236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:48.875236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:48.875236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:48.875236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:48.875236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:48.876151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:48.876151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:48.876151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:48.876151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:48.876151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:48.876151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:48.876151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:48.876151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:48.876151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:48.876151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:48.876151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:48.876151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:48.876151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:48.876151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:48.876151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:48.876151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:48.876151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:48.877066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:48.877066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:48.877066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:48.877066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:48.877066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 316/621] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:48.883304 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4463e-0765-4819-b434-a9af8887ca01 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:48.883913 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:48.922277 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097c70d-d822-4959-9ad0-62f55174c650 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:48.927511 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:48.992023 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251125d-59fd-45f4-aaa5-338d7565cbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:48.994019 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251125d-59fd-45f4-aaa5-338d7565cbcc None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:48.994691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251125d-59fd-45f4-aaa5-338d7565cbcc None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:48.996515 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251125d-59fd-45f4-aaa5-338d7565cbcc None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:48.997665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251125d-59fd-45f4-aaa5-338d7565cbcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:48.998319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251125d-59fd-45f4-aaa5-338d7565cbcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:48.999919 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251125d-59fd-45f4-aaa5-338d7565cbcc None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:49.013957 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 306/622] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:49.015701 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111b077-b78e-4ef5-8646-d7794267487b None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:49.016223 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111b077-b78e-4ef5-8646-d7794267487b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:49.016703 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111b077-b78e-4ef5-8646-d7794267487b None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:49.018607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 307/623] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:49.019563 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111b077-b78e-4ef5-8646-d7794267487b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:49.051615 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4463e-0765-4819-b434-a9af8887ca01 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:49.090171 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1a142-c546-48e8-a1ad-d21e8786c7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:49.091376 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1a142-c546-48e8-a1ad-d21e8786c7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:49.091964 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1a142-c546-48e8-a1ad-d21e8786c7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:49.092462 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1a142-c546-48e8-a1ad-d21e8786c7f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:49.093547 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1a142-c546-48e8-a1ad-d21e8786c7f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:49.094077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1a142-c546-48e8-a1ad-d21e8786c7f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:49.095923 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1a142-c546-48e8-a1ad-d21e8786c7f0 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:49.110657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 317/624] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:49.115578 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3dc21-0157-49ac-a36b-b4b79878515c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:49.115578 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3dc21-0157-49ac-a36b-b4b79878515c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:49.115578 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3dc21-0157-49ac-a36b-b4b79878515c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:49.135052 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8111b077-b78e-4ef5-8646-d7794267487b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:49.139070 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-57e3dc21-0157-49ac-a36b-b4b79878515c None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:49.140551 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-57e3dc21-0157-49ac-a36b-b4b79878515c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:49.175243 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ce03a-07bc-4006-8365-dba8a431fc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:49.176063 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ce03a-07bc-4006-8365-dba8a431fc66 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:49.176348 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ce03a-07bc-4006-8365-dba8a431fc66 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:49.176645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ce03a-07bc-4006-8365-dba8a431fc66 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:49.185115 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ce03a-07bc-4006-8365-dba8a431fc66 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:49.186718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503ce03a-07bc-4006-8365-dba8a431fc66 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:49.188605 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:49.203306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-503ce03a-07bc-4006-8365-dba8a431fc66 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:29:49.203306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:49.203306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:49.203306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:49.203306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:49.203306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:49.203306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:49.203306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:49.203306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:49.203306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:49.203306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:49.203306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:49.203306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:29:49.203306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:29:49.203306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:29:49.203306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:29:49.206082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:49.206082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:49.206082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:29:49.206082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:49.206082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:29:49.206082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:49.206082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:49.206082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:49.206082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:49.206082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:49.206082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:49.206082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:49.206082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:49.206082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:49.206082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:49.206082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:49.206082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:49.206082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:49.207047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:49.207047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:49.207047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:29:49.207047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:29:49.207047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:29:49.207047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:29:49.207047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:29:49.207047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:29:49.207047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:29:49.207047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:49.207047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 308/625] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Jul 18 16:29:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:49.207047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ce03a-07bc-4006-8365-dba8a431fc66 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:49.236360 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 318/626] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:49.237313 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3dc21-0157-49ac-a36b-b4b79878515c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:49.253500 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:49.340689 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ce03a-07bc-4006-8365-dba8a431fc66 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:49.352174 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3dc21-0157-49ac-a36b-b4b79878515c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:49.389312 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624aaed4-a187-48bd-8358-50a75d553434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:49.389914 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aaed4-a187-48bd-8358-50a75d553434 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:49.390193 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aaed4-a187-48bd-8358-50a75d553434 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:49.390468 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624aaed4-a187-48bd-8358-50a75d553434 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:49.390867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd8fe0-5b6d-4c1c-a328-05c2b1e39f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:49.391307 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624aaed4-a187-48bd-8358-50a75d553434 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:49.391612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624aaed4-a187-48bd-8358-50a75d553434 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:49.392317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd8fe0-5b6d-4c1c-a328-05c2b1e39f32 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:49.392811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd8fe0-5b6d-4c1c-a328-05c2b1e39f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:49.393110 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624aaed4-a187-48bd-8358-50a75d553434 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:49.393629 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd8fe0-5b6d-4c1c-a328-05c2b1e39f32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:49.404286 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd8fe0-5b6d-4c1c-a328-05c2b1e39f32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:49.406064 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd8fe0-5b6d-4c1c-a328-05c2b1e39f32 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:49.412061 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 319/627] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Jul 18 16:29:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:49.412954 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624aaed4-a187-48bd-8358-50a75d553434 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:49.426378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-7ddd8fe0-5b6d-4c1c-a328-05c2b1e39f32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:49.426378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:49.426378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:49.426378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:49.426378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:49.426378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:49.426378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:49.426378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:49.426378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:49.426378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:49.426378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:49.426378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:49.426378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:29:49.426378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:29:49.426378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:29:49.427325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:29:49.427325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:49.427325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:49.427325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:49.427325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:49.427325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:49.427325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:49.427325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:49.427325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:49.427325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:49.427325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:49.427325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:49.427325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:49.427325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:49.427325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:49.427325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:49.427325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:49.428292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:29:49.428292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:29:49.428292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:29:49.428292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:29:49.428292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:29:49.428292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:29:49.428292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:49.428292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:49.428292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 309/628] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:49.429728 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de4fd4-e8bb-44d8-b219-ee27c1cc9d93 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:49.429728 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de4fd4-e8bb-44d8-b219-ee27c1cc9d93 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:49.429728 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de4fd4-e8bb-44d8-b219-ee27c1cc9d93 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:49.430931 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 310/629] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:49.431640 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de4fd4-e8bb-44d8-b219-ee27c1cc9d93 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:49.497769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:49.498520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:49.532868 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624aaed4-a187-48bd-8358-50a75d553434 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:49.542028 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de4fd4-e8bb-44d8-b219-ee27c1cc9d93 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:49.569219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d829c-dbed-4139-9bf0-5c46f6fbef2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:49.570198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d829c-dbed-4139-9bf0-5c46f6fbef2a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:49.570592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d829c-dbed-4139-9bf0-5c46f6fbef2a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:49.571087 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d829c-dbed-4139-9bf0-5c46f6fbef2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:49.581060 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a586d-f42f-43d3-92f6-4368badde84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:49.581719 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a586d-f42f-43d3-92f6-4368badde84b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:49.582008 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a586d-f42f-43d3-92f6-4368badde84b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:49.582291 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a586d-f42f-43d3-92f6-4368badde84b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:49.583074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d829c-dbed-4139-9bf0-5c46f6fbef2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:49.591719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-f08d829c-dbed-4139-9bf0-5c46f6fbef2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:49.591719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:49.591719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:49.591719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:49.591719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:49.591719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:49.591719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:49.591719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:49.591719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:49.591719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:49.591719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:49.591719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:49.591719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:49.591719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:49.591719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:49.591719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:49.592775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:49.592775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:49.592775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:49.592775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:49.592775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:49.592775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:49.592775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:49.592775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:49.592775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:49.592775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:49.592775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:49.592775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:49.592775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:49.592775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:49.592775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:49.592775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:49.598574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:49.598574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:49.598574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:49.598574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:49.598574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:49.598574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:49.598574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:49.598574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:49.598574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:49.598574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:49.598574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:49.598574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:49.598574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 320/630] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:29:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:49.598574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b76ae8-3f68-4319-9694-46c5bc35feae None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:49.599586 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b76ae8-3f68-4319-9694-46c5bc35feae None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:49.599586 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b76ae8-3f68-4319-9694-46c5bc35feae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:49.613738 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a9b76ae8-3f68-4319-9694-46c5bc35feae None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:49.615177 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a9b76ae8-3f68-4319-9694-46c5bc35feae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:49.667247 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a586d-f42f-43d3-92f6-4368badde84b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:49.669136 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a586d-f42f-43d3-92f6-4368badde84b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:49.690454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 321/631] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:49.691479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b76ae8-3f68-4319-9694-46c5bc35feae None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:49.746489 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:49.769820 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:49.795452 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 311/632] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:29:49.796307 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a586d-f42f-43d3-92f6-4368badde84b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:49.821927 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b76ae8-3f68-4319-9694-46c5bc35feae None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:49.859109 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e846aa-5857-4804-b0ba-58c5cb913e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:49.859781 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e846aa-5857-4804-b0ba-58c5cb913e60 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:49.860067 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e846aa-5857-4804-b0ba-58c5cb913e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:49.860352 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e846aa-5857-4804-b0ba-58c5cb913e60 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:49.861179 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e846aa-5857-4804-b0ba-58c5cb913e60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:49.861492 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e846aa-5857-4804-b0ba-58c5cb913e60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:49.862933 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e846aa-5857-4804-b0ba-58c5cb913e60 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:49.880689 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 322/633] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:29:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:49.881854 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e846aa-5857-4804-b0ba-58c5cb913e60 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:49.906455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a586d-f42f-43d3-92f6-4368badde84b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:49.940141 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54490171-358e-4d51-8609-59d4f1b8a839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:49.940738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54490171-358e-4d51-8609-59d4f1b8a839 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:49.941039 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54490171-358e-4d51-8609-59d4f1b8a839 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:49.941326 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54490171-358e-4d51-8609-59d4f1b8a839 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:49.942076 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54490171-358e-4d51-8609-59d4f1b8a839 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:49.942385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54490171-358e-4d51-8609-59d4f1b8a839 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:49.943750 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54490171-358e-4d51-8609-59d4f1b8a839 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:49.952626 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 312/634] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 16:29:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:49.953468 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54490171-358e-4d51-8609-59d4f1b8a839 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:49.975551 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:49.988344 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e846aa-5857-4804-b0ba-58c5cb913e60 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:50.008864 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:50.023096 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece06355-089c-4c15-86cb-e7d846d1cfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:50.023897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece06355-089c-4c15-86cb-e7d846d1cfe1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:50.024247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece06355-089c-4c15-86cb-e7d846d1cfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:50.024525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece06355-089c-4c15-86cb-e7d846d1cfe1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:50.035936 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece06355-089c-4c15-86cb-e7d846d1cfe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:50.043723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-ece06355-089c-4c15-86cb-e7d846d1cfe1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:50.043723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:50.043723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:50.043723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:50.043723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:50.043723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:50.043723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:50.043723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:50.043723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:50.043723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:50.043723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:50.043723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:50.043723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:50.043723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:50.043723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:50.043723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:50.045200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:50.045200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:50.045200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:50.045200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:50.045200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:50.045200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:50.045200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:50.045200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:50.045200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:50.045200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:50.045200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:50.045200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:50.045200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:50.045200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:50.045200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:50.045200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:50.046077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:50.046077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:50.046077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:50.046077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:50.046077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:50.046077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:50.046077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:50.046077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:50.046077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:50.046077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:50.046077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:50.046077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:50.049162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 323/635] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:29:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:50.050183 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece06355-089c-4c15-86cb-e7d846d1cfe1 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:50.057408 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54490171-358e-4d51-8609-59d4f1b8a839 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:50.091876 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205c74f1-1b6d-4ebe-b032-1ee813a74370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:50.092671 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c74f1-1b6d-4ebe-b032-1ee813a74370 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:50.092962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c74f1-1b6d-4ebe-b032-1ee813a74370 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:50.093301 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205c74f1-1b6d-4ebe-b032-1ee813a74370 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:50.103373 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c74f1-1b6d-4ebe-b032-1ee813a74370 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:50.104815 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205c74f1-1b6d-4ebe-b032-1ee813a74370 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:50.123523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-205c74f1-1b6d-4ebe-b032-1ee813a74370 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:50.123523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:50.123523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:50.123523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:50.123523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:50.123523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:50.123523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:50.123523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:50.123523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:50.123523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:50.123523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:50.123523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:50.123523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:50.123523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:50.123523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:50.124513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:50.124513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:50.124513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:50.124513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:50.124513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:50.124513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:50.124513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:50.124513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:50.124513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:50.124513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:50.124513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:50.124513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:50.124513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:50.124513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:50.124513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:50.124513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:50.124513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:50.125446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:50.125446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:50.125446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:50.125446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:50.125952 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 313/636] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:50.127521 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5375a61-f89b-49e4-91e3-159028536de7 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:50.127807 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5375a61-f89b-49e4-91e3-159028536de7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:50.128169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5375a61-f89b-49e4-91e3-159028536de7 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:50.130565 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 314/637] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:50.131298 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5375a61-f89b-49e4-91e3-159028536de7 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:50.155170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece06355-089c-4c15-86cb-e7d846d1cfe1 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:50.192497 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd031e-dcde-487c-ba08-8a0b9b297c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:50.193346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd031e-dcde-487c-ba08-8a0b9b297c7a None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:50.193630 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd031e-dcde-487c-ba08-8a0b9b297c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:50.193916 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd031e-dcde-487c-ba08-8a0b9b297c7a None admin] PATH_INFO: `/v3/projects/30a4824228ec47519a01574d82879b25/users/50bc0fa34b414328a342d685bc1eaca3/roles/ce6bff4fd8b6468b94dc4af858dde77b` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:50.207893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:50.208278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd031e-dcde-487c-ba08-8a0b9b297c7a None admin] RBAC: Authorizing `identity:create_grant(project_id=30a4824228ec47519a01574d82879b25, user_id=50bc0fa34b414328a342d685bc1eaca3, role_id=ce6bff4fd8b6468b94dc4af858dde77b)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:50.209767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd031e-dcde-487c-ba08-8a0b9b297c7a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:50.239107 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5375a61-f89b-49e4-91e3-159028536de7 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:50.273395 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136ead7-c918-414b-81f2-219472b7c9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:50.274181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136ead7-c918-414b-81f2-219472b7c9e9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:50.274471 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136ead7-c918-414b-81f2-219472b7c9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:50.274769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136ead7-c918-414b-81f2-219472b7c9e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:50.285426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136ead7-c918-414b-81f2-219472b7c9e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:50.286886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136ead7-c918-414b-81f2-219472b7c9e9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:50.304858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-d136ead7-c918-414b-81f2-219472b7c9e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:50.304858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:50.304858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:50.304858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:50.304858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:50.304858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:50.304858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:50.304858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:50.304858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:50.304858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:50.304858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:50.304858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:50.304858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:50.304858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:50.304858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:50.306015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:50.306015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:50.306015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:50.306015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:50.306015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:50.306015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:50.306015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:50.306015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:50.306015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:50.306015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:50.306015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:50.306015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:50.306015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:50.306015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:50.306015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:50.306015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:50.306015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:50.307187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:50.307187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:50.307187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:50.307187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:50.307187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 315/638] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:50.307187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136ead7-c918-414b-81f2-219472b7c9e9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:50.324205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 324/639] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:29:50 2022] PUT /identity/v3/projects/30a4824228ec47519a01574d82879b25/users/50bc0fa34b414328a342d685bc1eaca3/roles/ce6bff4fd8b6468b94dc4af858dde77b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:29:50.325146 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd031e-dcde-487c-ba08-8a0b9b297c7a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:50.383238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:50.427559 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136ead7-c918-414b-81f2-219472b7c9e9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:50.455053 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:50.465275 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd031e-dcde-487c-ba08-8a0b9b297c7a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:50.468773 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2eaf53-6ccb-4aa9-9ad2-8dad1978d94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:50.470654 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2eaf53-6ccb-4aa9-9ad2-8dad1978d94c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:50.470938 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2eaf53-6ccb-4aa9-9ad2-8dad1978d94c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:50.471215 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2eaf53-6ccb-4aa9-9ad2-8dad1978d94c None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:50.471994 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2eaf53-6ccb-4aa9-9ad2-8dad1978d94c None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:50.472308 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2eaf53-6ccb-4aa9-9ad2-8dad1978d94c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:50.473767 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2eaf53-6ccb-4aa9-9ad2-8dad1978d94c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:50.489916 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 316/640] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 16:29:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:50.489916 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d91a9-bb90-40ca-ac1b-c67cb83430a3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:50.489916 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d91a9-bb90-40ca-ac1b-c67cb83430a3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:50.489916 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d91a9-bb90-40ca-ac1b-c67cb83430a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:50.506995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-785d91a9-bb90-40ca-ac1b-c67cb83430a3 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:50.508213 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-785d91a9-bb90-40ca-ac1b-c67cb83430a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:50.513827 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c920c-d9ea-4e4d-911c-d0c131f20f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:50.514594 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c920c-d9ea-4e4d-911c-d0c131f20f39 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:50.514877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c920c-d9ea-4e4d-911c-d0c131f20f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:50.515150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c920c-d9ea-4e4d-911c-d0c131f20f39 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:50.515882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c920c-d9ea-4e4d-911c-d0c131f20f39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:50.516197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c920c-d9ea-4e4d-911c-d0c131f20f39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:50.517614 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c920c-d9ea-4e4d-911c-d0c131f20f39 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:50.530513 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 325/641] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:50.531157 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c920c-d9ea-4e4d-911c-d0c131f20f39 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:50.587737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 317/642] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:50.587737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d91a9-bb90-40ca-ac1b-c67cb83430a3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:50.646821 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:50.660103 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c920c-d9ea-4e4d-911c-d0c131f20f39 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:50.693892 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d91a9-bb90-40ca-ac1b-c67cb83430a3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:50.703627 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd51d5-6f21-49e7-b0b9-7be19fcd48b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:50.704771 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd51d5-6f21-49e7-b0b9-7be19fcd48b6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:50.705144 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd51d5-6f21-49e7-b0b9-7be19fcd48b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:50.705381 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cd51d5-6f21-49e7-b0b9-7be19fcd48b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:50.706559 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd51d5-6f21-49e7-b0b9-7be19fcd48b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:50.707147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd51d5-6f21-49e7-b0b9-7be19fcd48b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:50.708848 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cd51d5-6f21-49e7-b0b9-7be19fcd48b6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:50.712057 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:50.723488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 326/643] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:50.724325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd51d5-6f21-49e7-b0b9-7be19fcd48b6 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:50.735556 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a4db3-64be-469f-a6f3-fe1cb7db3d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:50.736543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a4db3-64be-469f-a6f3-fe1cb7db3d12 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:50.736825 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a4db3-64be-469f-a6f3-fe1cb7db3d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:50.737144 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5a4db3-64be-469f-a6f3-fe1cb7db3d12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:50.749241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a4db3-64be-469f-a6f3-fe1cb7db3d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:50.750802 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5a4db3-64be-469f-a6f3-fe1cb7db3d12 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:50.769371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-cd5a4db3-64be-469f-a6f3-fe1cb7db3d12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:50.769371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:50.769371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:50.769371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:50.769371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:50.769371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:50.769371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:50.769371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:50.769371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:50.769371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:50.769371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:50.769371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:50.769371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:50.769371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:50.769371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:50.770393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:50.770393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:50.770393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:50.770393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:50.770393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:50.770393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:50.770393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:50.770393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:50.770393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:50.770393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:50.770393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:50.770393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:50.770393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:50.770393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:50.770393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:50.770393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:50.770393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:50.771303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:50.771303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:50.771303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:50.771303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:50.775388 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 318/644] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:50.776110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a4db3-64be-469f-a6f3-fe1cb7db3d12 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:50.843541 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cd51d5-6f21-49e7-b0b9-7be19fcd48b6 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:50.881337 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6cc92d-ff72-4228-9c27-a5a0be27babf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:50.882157 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cc92d-ff72-4228-9c27-a5a0be27babf None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:50.882438 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cc92d-ff72-4228-9c27-a5a0be27babf None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:50.882714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6cc92d-ff72-4228-9c27-a5a0be27babf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:50.890074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6cc92d-ff72-4228-9c27-a5a0be27babf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:50.891512 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6cc92d-ff72-4228-9c27-a5a0be27babf None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:50.896027 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5a4db3-64be-469f-a6f3-fe1cb7db3d12 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:50.906046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-dd6cc92d-ff72-4228-9c27-a5a0be27babf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:50.906046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:50.906046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:50.906046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:50.906046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:50.906046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:50.906046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:50.906046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:50.906046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:50.906046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:50.906046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:50.906046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:50.906046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:29:50.906046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:29:50.906046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:29:50.907012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:29:50.907012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:50.907012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:50.907012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:50.907012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:50.907012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:50.907012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:50.907012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:50.907012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:50.907012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:50.907012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:50.907012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:50.907012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:50.907012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:50.907012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:50.907012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:50.907012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:50.908088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:29:50.908088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:29:50.908088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:29:50.908088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:29:50.908088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:29:50.908088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:29:50.908088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:50.908088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:50.908088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 327/645] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:50.908088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6cc92d-ff72-4228-9c27-a5a0be27babf None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:50.924063 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:50.939418 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019c44f-44e0-45a1-8756-34d28e647571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:50.940307 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019c44f-44e0-45a1-8756-34d28e647571 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:50.940597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019c44f-44e0-45a1-8756-34d28e647571 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:50.940878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4019c44f-44e0-45a1-8756-34d28e647571 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:50.952144 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4019c44f-44e0-45a1-8756-34d28e647571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:50.960123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-4019c44f-44e0-45a1-8756-34d28e647571 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:50.960123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:50.960123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:50.960123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:50.960123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:50.960123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:50.960123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:50.960123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:50.960123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:50.960123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:50.960123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:50.960123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:50.960123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:50.960123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:50.960123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:50.960123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:50.961119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:50.961119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:50.961119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:50.961119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:50.961119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:50.961119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:50.961119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:50.961119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:50.961119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:50.961119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:50.961119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:50.961119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:50.961119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:50.961119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:50.961119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:50.961119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:50.961977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:50.961977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:50.961977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:50.961977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:50.961977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:50.961977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:50.961977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:50.961977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:50.961977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:50.961977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:50.961977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:50.961977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:50.961977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 319/646] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:29:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:50.963329 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019c44f-44e0-45a1-8756-34d28e647571 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:50.994979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:51.029433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6cc92d-ff72-4228-9c27-a5a0be27babf None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:51.065344 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a390f7-aa97-499b-a26e-1ad29b3eaa03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:51.066193 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a390f7-aa97-499b-a26e-1ad29b3eaa03 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:51.066477 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a390f7-aa97-499b-a26e-1ad29b3eaa03 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:51.066752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a390f7-aa97-499b-a26e-1ad29b3eaa03 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:51.074470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a390f7-aa97-499b-a26e-1ad29b3eaa03 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:51.074611 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4019c44f-44e0-45a1-8756-34d28e647571 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:51.076023 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a390f7-aa97-499b-a26e-1ad29b3eaa03 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:51.090517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-31a390f7-aa97-499b-a26e-1ad29b3eaa03 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 18 16:29:51.090517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:51.090517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:51.090517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:51.090517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:51.090517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:51.090517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:51.090517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:51.090517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:51.090517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:51.090517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:51.090517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:51.090517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:29:51.090517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:29:51.090517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:29:51.090517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:29:51.092176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:51.092176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:51.092176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:29:51.092176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:51.092176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:29:51.092176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:51.092176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:51.092176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:51.092176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:51.092176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:51.092176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:51.092176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:51.092176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:51.092176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:51.092176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:51.092176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:51.092176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:51.092176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:51.093176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:51.093176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:51.093176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:29:51.093176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:29:51.093176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:29:51.093176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:29:51.093176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:29:51.093176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:29:51.093176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 18 16:29:51.093176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:51.093176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 328/647] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:51.094378 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a390f7-aa97-499b-a26e-1ad29b3eaa03 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:51.120103 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7fdd8-b30c-4d69-8ae9-932a90b3e909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:51.121065 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7fdd8-b30c-4d69-8ae9-932a90b3e909 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:51.121358 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7fdd8-b30c-4d69-8ae9-932a90b3e909 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:51.121665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc7fdd8-b30c-4d69-8ae9-932a90b3e909 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:51.122973 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7fdd8-b30c-4d69-8ae9-932a90b3e909 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:51.123291 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7fdd8-b30c-4d69-8ae9-932a90b3e909 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:51.124672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc7fdd8-b30c-4d69-8ae9-932a90b3e909 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:51.136328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 320/648] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:51.137181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7fdd8-b30c-4d69-8ae9-932a90b3e909 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:51.180228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:51.213740 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a390f7-aa97-499b-a26e-1ad29b3eaa03 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:51.245302 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:51.251972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b4b58-f224-427a-ae82-8f4b03ee3a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:51.252843 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b4b58-f224-427a-ae82-8f4b03ee3a12 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:51.252956 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b4b58-f224-427a-ae82-8f4b03ee3a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:51.253698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b4b58-f224-427a-ae82-8f4b03ee3a12 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:51.254078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b4b58-f224-427a-ae82-8f4b03ee3a12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:51.254387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b4b58-f224-427a-ae82-8f4b03ee3a12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:51.255881 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b4b58-f224-427a-ae82-8f4b03ee3a12 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:51.258450 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc7fdd8-b30c-4d69-8ae9-932a90b3e909 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:51.269821 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 329/649] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:29:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:51.270635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b4b58-f224-427a-ae82-8f4b03ee3a12 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:51.300750 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547b46b-1f07-4664-a96a-bff25afcf112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:51.301466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547b46b-1f07-4664-a96a-bff25afcf112 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:51.301755 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547b46b-1f07-4664-a96a-bff25afcf112 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:51.302037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547b46b-1f07-4664-a96a-bff25afcf112 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:51.302799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547b46b-1f07-4664-a96a-bff25afcf112 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:51.303110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547b46b-1f07-4664-a96a-bff25afcf112 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:51.304488 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547b46b-1f07-4664-a96a-bff25afcf112 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:51.313030 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 321/650] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 16:29:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:51.313857 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547b46b-1f07-4664-a96a-bff25afcf112 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:51.382907 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b4b58-f224-427a-ae82-8f4b03ee3a12 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:51.415138 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:51.423143 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e3631-a91e-4c11-a49b-38d28fb69c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:51.423833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e3631-a91e-4c11-a49b-38d28fb69c43 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:51.424123 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e3631-a91e-4c11-a49b-38d28fb69c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:51.429437 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e3631-a91e-4c11-a49b-38d28fb69c43 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:51.429437 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e3631-a91e-4c11-a49b-38d28fb69c43 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:51.429437 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e3631-a91e-4c11-a49b-38d28fb69c43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:51.429664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547b46b-1f07-4664-a96a-bff25afcf112 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:51.430068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e3631-a91e-4c11-a49b-38d28fb69c43 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:51.444931 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 330/651] 10.222.0.76 () {56 vars in 1137 bytes} [Mon Jul 18 16:29:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:51.445927 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e3631-a91e-4c11-a49b-38d28fb69c43 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:51.473319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6fe9d-155f-4216-aa8f-294debda8ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:51.474367 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6fe9d-155f-4216-aa8f-294debda8ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:51.474821 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6fe9d-155f-4216-aa8f-294debda8ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:51.475100 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6fe9d-155f-4216-aa8f-294debda8ad0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:51.483928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6fe9d-155f-4216-aa8f-294debda8ad0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:51.485432 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6fe9d-155f-4216-aa8f-294debda8ad0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:51.501004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-c9c6fe9d-155f-4216-aa8f-294debda8ad0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 16:29:51.501004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:51.501004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:51.501004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:51.501004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:51.501004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:51.501004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:51.501004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:51.501004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:51.501004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:51.501004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:51.501004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:51.501004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:29:51.501004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:29:51.501004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:29:51.501004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:29:51.502036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:51.502036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:51.502036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:29:51.502036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:51.502036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:29:51.502036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:51.502036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:51.502036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:51.502036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:51.502036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:51.502036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:51.502036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:51.502036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:51.502036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:51.502036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:51.502036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:51.502036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:51.502036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:51.502993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:51.502993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:51.502993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:29:51.502993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:29:51.502993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:29:51.502993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:29:51.502993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:29:51.502993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:29:51.502993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 16:29:51.502993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:51.506744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 322/652] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:51.507624 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6fe9d-155f-4216-aa8f-294debda8ad0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:51.521449 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:51.567189 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e3631-a91e-4c11-a49b-38d28fb69c43 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:51.605383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b1f6a-2f54-4d04-b731-b3a623fe2e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:51.606047 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b1f6a-2f54-4d04-b731-b3a623fe2e4c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:51.606379 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b1f6a-2f54-4d04-b731-b3a623fe2e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:51.606676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b1f6a-2f54-4d04-b731-b3a623fe2e4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:51.607515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b1f6a-2f54-4d04-b731-b3a623fe2e4c None admin] RBAC: Adding query filter params (role.id=ce6bff4fd8b6468b94dc4af858dde77b, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=381cf4381ce64379b285d75e2909813d) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:51.607830 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b1f6a-2f54-4d04-b731-b3a623fe2e4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:51.609326 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b1f6a-2f54-4d04-b731-b3a623fe2e4c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:51.616450 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6fe9d-155f-4216-aa8f-294debda8ad0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:51.625521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 331/653] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:51 2022] GET /identity/v3/role_assignments?user.id=381cf4381ce64379b285d75e2909813d&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=ce6bff4fd8b6468b94dc4af858dde77b => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:51.637086 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b1f6a-2f54-4d04-b731-b3a623fe2e4c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:51.681346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd37bc2-af74-471f-91a1-86e6bdd65cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:51.682280 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd37bc2-af74-471f-91a1-86e6bdd65cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:51.682645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd37bc2-af74-471f-91a1-86e6bdd65cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:51.683001 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd37bc2-af74-471f-91a1-86e6bdd65cd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:51.699976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd37bc2-af74-471f-91a1-86e6bdd65cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:51.703025 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:51.705510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd37bc2-af74-471f-91a1-86e6bdd65cd5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:51.728420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-7cd37bc2-af74-471f-91a1-86e6bdd65cd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:51.728420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:51.728420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:51.728420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:51.728420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:51.728420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:51.728420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:51.728420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:51.728420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:51.728420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:51.728420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:51.728420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:51.728420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:51.728420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:51.728420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:51.729574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:51.729574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:51.729574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:51.729574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:51.729574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:51.729574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:51.729574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:51.729574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:51.729574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:51.729574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:51.729574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:51.729574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:51.729574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:51.729574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:51.729574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:51.729574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:51.729574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:51.730983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:51.730983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:51.730983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:51.730983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:51.730983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 323/654] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:51.730983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd37bc2-af74-471f-91a1-86e6bdd65cd5 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:51.773859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b1f6a-2f54-4d04-b731-b3a623fe2e4c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:51.806741 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:51.829797 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c96aba-bf84-41aa-9643-e0db82065588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:51.830473 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c96aba-bf84-41aa-9643-e0db82065588 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:51.830754 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c96aba-bf84-41aa-9643-e0db82065588 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:51.831031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c96aba-bf84-41aa-9643-e0db82065588 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:51.866010 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd37bc2-af74-471f-91a1-86e6bdd65cd5 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:51.909234 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689f77a-d3ae-4175-97c1-3138977d7ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:51.909983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689f77a-d3ae-4175-97c1-3138977d7ceb None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:51.910269 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689f77a-d3ae-4175-97c1-3138977d7ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:51.910542 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689f77a-d3ae-4175-97c1-3138977d7ceb None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:51.911378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689f77a-d3ae-4175-97c1-3138977d7ceb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:51.911767 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689f77a-d3ae-4175-97c1-3138977d7ceb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:51.913356 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689f77a-d3ae-4175-97c1-3138977d7ceb None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:51.930960 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c96aba-bf84-41aa-9643-e0db82065588 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:51.932530 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c96aba-bf84-41aa-9643-e0db82065588 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:51.935632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 324/655] 10.222.0.76 () {56 vars in 1137 bytes} [Mon Jul 18 16:29:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:51.936486 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689f77a-d3ae-4175-97c1-3138977d7ceb None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:51.994889 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:52.046801 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689f77a-d3ae-4175-97c1-3138977d7ceb None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:52.047806 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 332/656] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:29:52.048486 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c96aba-bf84-41aa-9643-e0db82065588 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:52.071067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:52.087486 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a9a6b-e855-4078-a329-8708eaaac910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:52.088540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a9a6b-e855-4078-a329-8708eaaac910 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:52.089084 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a9a6b-e855-4078-a329-8708eaaac910 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:52.089566 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a9a6b-e855-4078-a329-8708eaaac910 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:52.090523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a9a6b-e855-4078-a329-8708eaaac910 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:52.091124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a9a6b-e855-4078-a329-8708eaaac910 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:52.092771 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a9a6b-e855-4078-a329-8708eaaac910 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:52.106158 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 325/657] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:52.107929 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a9a6b-e855-4078-a329-8708eaaac910 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:52.164695 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c96aba-bf84-41aa-9643-e0db82065588 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:52.209485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a974e-cf4c-4361-aeb7-78a0d49621b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:52.210158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a974e-cf4c-4361-aeb7-78a0d49621b0 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:52.210445 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a974e-cf4c-4361-aeb7-78a0d49621b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:52.210726 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a974e-cf4c-4361-aeb7-78a0d49621b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:52.218751 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a9a6b-e855-4078-a329-8708eaaac910 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:52.234540 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:52.256903 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669afd6-1a3a-42eb-b3dd-a5684b66e46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:52.258100 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669afd6-1a3a-42eb-b3dd-a5684b66e46e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:52.258606 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669afd6-1a3a-42eb-b3dd-a5684b66e46e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:52.259083 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9669afd6-1a3a-42eb-b3dd-a5684b66e46e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:52.271483 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669afd6-1a3a-42eb-b3dd-a5684b66e46e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:52.273336 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9669afd6-1a3a-42eb-b3dd-a5684b66e46e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:52.288157 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a974e-cf4c-4361-aeb7-78a0d49621b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:52.289660 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a974e-cf4c-4361-aeb7-78a0d49621b0 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:52.295685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-9669afd6-1a3a-42eb-b3dd-a5684b66e46e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:52.295685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:52.295685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:52.295685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:52.295685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:52.295685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:52.295685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:52.295685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:52.295685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:52.295685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:52.295685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:52.295685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:52.295685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:52.295685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:52.295685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:52.296590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:52.296590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:52.296590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:52.296590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:52.296590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:52.296590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:52.296590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:52.296590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:52.296590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:52.296590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:52.296590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:52.296590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:52.296590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:52.296590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:52.296590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:52.296590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:52.296590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:52.297520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:52.297520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:52.297520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:52.297520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:52.300046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 326/658] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:52.301276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669afd6-1a3a-42eb-b3dd-a5684b66e46e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:52.337390 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:52.398950 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 333/659] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:29:52.399865 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a974e-cf4c-4361-aeb7-78a0d49621b0 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:52.413521 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9669afd6-1a3a-42eb-b3dd-a5684b66e46e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:52.452276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcb81b-0143-4513-b45c-a611bc7fc997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:52.453200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcb81b-0143-4513-b45c-a611bc7fc997 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:52.453401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcb81b-0143-4513-b45c-a611bc7fc997 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:52.453677 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bcb81b-0143-4513-b45c-a611bc7fc997 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:52.457106 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:52.462282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcb81b-0143-4513-b45c-a611bc7fc997 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:52.463735 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bcb81b-0143-4513-b45c-a611bc7fc997 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:52.478784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-d1bcb81b-0143-4513-b45c-a611bc7fc997 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 16:29:52.478784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:52.478784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:52.478784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:52.478784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:52.478784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:52.478784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:52.478784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:52.478784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:52.478784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:52.478784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:52.478784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:52.478784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:29:52.478784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:29:52.478784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:29:52.478784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:29:52.479775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:52.479775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:52.479775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:29:52.479775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:52.479775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:29:52.479775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:52.479775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:52.479775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:52.479775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:52.479775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:52.479775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:52.479775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:52.479775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:52.479775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:52.479775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:52.479775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:52.479775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:52.479775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:52.480718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:52.480718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:52.480718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:29:52.480718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:29:52.480718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:29:52.480718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:29:52.480718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:29:52.480718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:29:52.480718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 18 16:29:52.480718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:52.480718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 327/660] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:29:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:52.482520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcb81b-0143-4513-b45c-a611bc7fc997 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:52.513480 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a974e-cf4c-4361-aeb7-78a0d49621b0 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:52.553391 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cad636-3bdd-4505-84df-0430c814ef85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:52.554071 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cad636-3bdd-4505-84df-0430c814ef85 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:52.554356 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cad636-3bdd-4505-84df-0430c814ef85 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:52.554634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cad636-3bdd-4505-84df-0430c814ef85 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:52.556120 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cad636-3bdd-4505-84df-0430c814ef85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:52.556534 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cad636-3bdd-4505-84df-0430c814ef85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:52.558091 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cad636-3bdd-4505-84df-0430c814ef85 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:52.574759 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 334/661] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:52.575920 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20381c89-0796-4885-981c-1e988cd4d81c None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:52.576214 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20381c89-0796-4885-981c-1e988cd4d81c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:52.576491 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20381c89-0796-4885-981c-1e988cd4d81c None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:52.577812 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 335/662] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:52.582451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20381c89-0796-4885-981c-1e988cd4d81c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:52.584360 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:52.597884 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bcb81b-0143-4513-b45c-a611bc7fc997 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:52.634146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fc4d1-712a-47c5-9d0b-cc3ab046ac67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:52.634946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fc4d1-712a-47c5-9d0b-cc3ab046ac67 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:52.635229 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fc4d1-712a-47c5-9d0b-cc3ab046ac67 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:52.635545 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504fc4d1-712a-47c5-9d0b-cc3ab046ac67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:52.647376 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fc4d1-712a-47c5-9d0b-cc3ab046ac67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:52.648997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504fc4d1-712a-47c5-9d0b-cc3ab046ac67 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:52.670097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-504fc4d1-712a-47c5-9d0b-cc3ab046ac67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:52.670097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:52.670097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:52.670097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:52.670097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:52.670097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:52.670097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:52.670097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:52.670097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:52.670097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:52.670097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:52.670097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:52.670097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:52.670097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:52.670097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:52.671109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:52.671109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:52.671109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:52.671109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:52.671109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:52.671109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:52.671109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:52.671109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:52.671109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:52.671109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:52.671109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:52.671109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:52.671109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:52.671109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:52.671109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:52.671109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:52.671109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:52.677164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:52.677164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:52.677164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:52.677164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:52.677164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 328/663] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:52.677164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fc4d1-712a-47c5-9d0b-cc3ab046ac67 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:52.694363 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20381c89-0796-4885-981c-1e988cd4d81c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:52.710547 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:52.736586 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7df1a6-5536-4b7c-a329-809bdbf9ba80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:52.737296 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df1a6-5536-4b7c-a329-809bdbf9ba80 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:52.737585 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df1a6-5536-4b7c-a329-809bdbf9ba80 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:52.737868 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7df1a6-5536-4b7c-a329-809bdbf9ba80 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:52.738712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7df1a6-5536-4b7c-a329-809bdbf9ba80 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:52.739097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7df1a6-5536-4b7c-a329-809bdbf9ba80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:52.740532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7df1a6-5536-4b7c-a329-809bdbf9ba80 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:52.759976 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 336/664] 10.222.0.76 () {56 vars in 1139 bytes} [Mon Jul 18 16:29:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:52.761256 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2a5de-d520-4450-8ee4-7e07d0011b63 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:52.761543 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2a5de-d520-4450-8ee4-7e07d0011b63 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:52.761926 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d2a5de-d520-4450-8ee4-7e07d0011b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:52.779542 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-39d2a5de-d520-4450-8ee4-7e07d0011b63 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:52.780695 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-39d2a5de-d520-4450-8ee4-7e07d0011b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:52.800278 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504fc4d1-712a-47c5-9d0b-cc3ab046ac67 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:52.838882 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224766c0-d60d-4b84-8401-32a4a1842d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:52.839676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224766c0-d60d-4b84-8401-32a4a1842d81 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:52.839954 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224766c0-d60d-4b84-8401-32a4a1842d81 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:52.840233 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224766c0-d60d-4b84-8401-32a4a1842d81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:52.847957 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224766c0-d60d-4b84-8401-32a4a1842d81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:52.849475 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224766c0-d60d-4b84-8401-32a4a1842d81 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:52.851935 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 337/665] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:52.852768 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2a5de-d520-4450-8ee4-7e07d0011b63 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:52.872789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-224766c0-d60d-4b84-8401-32a4a1842d81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:52.872789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:52.872789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:52.872789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:52.872789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:52.872789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:52.872789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:52.872789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:52.872789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:52.872789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:52.872789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:52.872789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:52.872789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:29:52.872789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:29:52.872789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:29:52.873805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:29:52.873805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:52.873805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:52.873805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:52.873805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:52.873805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:52.873805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:52.873805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:52.873805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:52.873805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:52.873805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:52.873805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:52.873805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:52.873805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:52.873805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:52.873805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:52.873805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:52.874742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:29:52.874742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:29:52.874742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:29:52.874742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:29:52.874742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:29:52.874742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:29:52.874742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:52.874742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:52.877032 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 329/666] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:52.878214 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224766c0-d60d-4b84-8401-32a4a1842d81 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:52.883195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:52.958491 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:52.962544 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d2a5de-d520-4450-8ee4-7e07d0011b63 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:52.986317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224766c0-d60d-4b84-8401-32a4a1842d81 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:53.000506 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192aebd-daa3-4454-b008-04a43225bc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:53.001312 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192aebd-daa3-4454-b008-04a43225bc07 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:53.001667 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192aebd-daa3-4454-b008-04a43225bc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:53.002018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192aebd-daa3-4454-b008-04a43225bc07 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:53.002755 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192aebd-daa3-4454-b008-04a43225bc07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:53.003063 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192aebd-daa3-4454-b008-04a43225bc07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:53.004444 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192aebd-daa3-4454-b008-04a43225bc07 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:53.017471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 338/667] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:53.021914 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192aebd-daa3-4454-b008-04a43225bc07 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:53.029940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684aa1f-c4ad-4af8-84b6-769ed2c31b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:53.030532 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684aa1f-c4ad-4af8-84b6-769ed2c31b2e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:53.030819 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684aa1f-c4ad-4af8-84b6-769ed2c31b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:53.031100 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684aa1f-c4ad-4af8-84b6-769ed2c31b2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:53.102348 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684aa1f-c4ad-4af8-84b6-769ed2c31b2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:53.103806 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684aa1f-c4ad-4af8-84b6-769ed2c31b2e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:53.107087 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:53.135169 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192aebd-daa3-4454-b008-04a43225bc07 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:53.177077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2b057-66bc-4ab5-b229-0de4ffba0c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:53.178082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2b057-66bc-4ab5-b229-0de4ffba0c14 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:53.178637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2b057-66bc-4ab5-b229-0de4ffba0c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:53.178919 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2b057-66bc-4ab5-b229-0de4ffba0c14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:53.190004 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2b057-66bc-4ab5-b229-0de4ffba0c14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:53.198002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-79a2b057-66bc-4ab5-b229-0de4ffba0c14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:53.198002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:53.198002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:53.198002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:53.198002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:53.198002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:53.198002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:53.198002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:53.198002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:53.198002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:53.198002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:53.198002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:53.198002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:53.198002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:53.198002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:53.198002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:53.199066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:53.199066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:53.199066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:53.199066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:53.199066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:53.199066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:53.199066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:53.199066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:53.199066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:53.199066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:53.199066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:53.199066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:53.199066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:53.199066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:53.199066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:53.199066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:53.199989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:53.199989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:53.199989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:53.199989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:53.199989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:53.199989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:53.199989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:53.199989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:53.199989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:53.199989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:53.199989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:29:53.199989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:53.199989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 339/668] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:29:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:53.200975 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2b057-66bc-4ab5-b229-0de4ffba0c14 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:53.221391 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 330/669] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:29:53.222698 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684aa1f-c4ad-4af8-84b6-769ed2c31b2e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:53.231546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:53.317414 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2b057-66bc-4ab5-b229-0de4ffba0c14 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:53.337897 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684aa1f-c4ad-4af8-84b6-769ed2c31b2e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:53.341813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:53.353916 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b92cf-4205-4933-a255-3e463e7b7ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:53.354498 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b92cf-4205-4933-a255-3e463e7b7ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:53.354782 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b92cf-4205-4933-a255-3e463e7b7ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:53.355059 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7b92cf-4205-4933-a255-3e463e7b7ff3 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:53.355849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b92cf-4205-4933-a255-3e463e7b7ff3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:53.356180 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b92cf-4205-4933-a255-3e463e7b7ff3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:53.357762 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7b92cf-4205-4933-a255-3e463e7b7ff3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:53.376381 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 340/670] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:29:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:53.376381 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b92cf-4205-4933-a255-3e463e7b7ff3 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:53.385917 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1945b-dbc3-4c72-9d9b-58888e080187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:53.386723 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1945b-dbc3-4c72-9d9b-58888e080187 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:53.387007 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1945b-dbc3-4c72-9d9b-58888e080187 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:53.387277 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d1945b-dbc3-4c72-9d9b-58888e080187 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:53.395099 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1945b-dbc3-4c72-9d9b-58888e080187 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:53.396540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d1945b-dbc3-4c72-9d9b-58888e080187 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:53.410690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-d1d1945b-dbc3-4c72-9d9b-58888e080187 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:53.410690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:53.410690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:53.410690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:53.410690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:53.410690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:53.410690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:53.410690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:53.410690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:53.410690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:53.410690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:53.410690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:53.410690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:29:53.410690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:29:53.410690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:29:53.411614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:29:53.411614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:53.411614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:53.411614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:53.411614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:53.411614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:53.411614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:53.411614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:53.411614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:53.411614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:53.411614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:53.411614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:53.411614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:53.411614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:53.411614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:53.411614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:53.411614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:53.412528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:29:53.412528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:29:53.412528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:29:53.412528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:29:53.412528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:29:53.412528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:29:53.412528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:53.412528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:53.412528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 331/671] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:53.413607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1945b-dbc3-4c72-9d9b-58888e080187 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:53.464586 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:53.486201 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7b92cf-4205-4933-a255-3e463e7b7ff3 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:53.522703 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d1945b-dbc3-4c72-9d9b-58888e080187 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:53.526766 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d1a89-0baa-4b55-a541-1f059416f7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:53.527570 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d1a89-0baa-4b55-a541-1f059416f7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:53.527974 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d1a89-0baa-4b55-a541-1f059416f7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:53.528904 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d1a89-0baa-4b55-a541-1f059416f7c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:53.529796 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d1a89-0baa-4b55-a541-1f059416f7c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:53.530203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d1a89-0baa-4b55-a541-1f059416f7c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:53.531702 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d1a89-0baa-4b55-a541-1f059416f7c8 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:53.542301 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 341/672] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 16:29:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:53.547638 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d1a89-0baa-4b55-a541-1f059416f7c8 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:53.562586 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e3fcb-e13f-4b35-aff5-5bb9e3a8bba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:53.563392 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e3fcb-e13f-4b35-aff5-5bb9e3a8bba6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:53.563684 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e3fcb-e13f-4b35-aff5-5bb9e3a8bba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:53.563965 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e3fcb-e13f-4b35-aff5-5bb9e3a8bba6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:53.574806 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e3fcb-e13f-4b35-aff5-5bb9e3a8bba6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:53.576795 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e3fcb-e13f-4b35-aff5-5bb9e3a8bba6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:53.594313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-675e3fcb-e13f-4b35-aff5-5bb9e3a8bba6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:53.594313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:53.594313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:53.594313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:53.594313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:53.594313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:53.594313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:53.594313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:53.594313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:53.594313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:53.594313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:53.594313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:53.594313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:53.594313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:53.594313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:53.595293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:53.595293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:53.595293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:53.595293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:53.595293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:53.595293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:53.595293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:53.595293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:53.595293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:53.595293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:53.595293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:53.595293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:53.595293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:53.595293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:53.595293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:53.595293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:53.595293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:53.596276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:53.596276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:53.596276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:53.596276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:53.596276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 332/673] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:53.596276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e3fcb-e13f-4b35-aff5-5bb9e3a8bba6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:53.616959 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:53.663312 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d1a89-0baa-4b55-a541-1f059416f7c8 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:53.700114 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5f4ea-0dda-4ca3-bb7a-376bdaefa183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:53.700784 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5f4ea-0dda-4ca3-bb7a-376bdaefa183 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:53.701095 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5f4ea-0dda-4ca3-bb7a-376bdaefa183 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:53.701372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5f4ea-0dda-4ca3-bb7a-376bdaefa183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:53.702203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5f4ea-0dda-4ca3-bb7a-376bdaefa183 None admin] RBAC: Adding query filter params (role.id=ce6bff4fd8b6468b94dc4af858dde77b, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=a1e1900754214020931b202e98f660a0) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:53.702522 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5f4ea-0dda-4ca3-bb7a-376bdaefa183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:53.703960 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae5f4ea-0dda-4ca3-bb7a-376bdaefa183 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:53.721043 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 342/674] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:53 2022] GET /identity/v3/role_assignments?user.id=a1e1900754214020931b202e98f660a0&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=ce6bff4fd8b6468b94dc4af858dde77b => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:53.721288 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e3fcb-e13f-4b35-aff5-5bb9e3a8bba6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:53.721389 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5f4ea-0dda-4ca3-bb7a-376bdaefa183 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:53.732684 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:53.775501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d1d5c-45ae-43b1-9a45-5de0e0a21991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:53.776222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d1d5c-45ae-43b1-9a45-5de0e0a21991 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:53.777282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d1d5c-45ae-43b1-9a45-5de0e0a21991 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:53.777570 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d1d5c-45ae-43b1-9a45-5de0e0a21991 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:53.778715 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d1d5c-45ae-43b1-9a45-5de0e0a21991 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:53.778999 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d1d5c-45ae-43b1-9a45-5de0e0a21991 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:53.781190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d1d5c-45ae-43b1-9a45-5de0e0a21991 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:53.801067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 333/675] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:29:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:53.802776 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d1d5c-45ae-43b1-9a45-5de0e0a21991 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:53.852791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5f4ea-0dda-4ca3-bb7a-376bdaefa183 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:53.895792 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c4c12-937b-4bed-aa10-085d5a266db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:53.896606 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c4c12-937b-4bed-aa10-085d5a266db0 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:53.896897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c4c12-937b-4bed-aa10-085d5a266db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:53.897305 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c4c12-937b-4bed-aa10-085d5a266db0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:53.908877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c4c12-937b-4bed-aa10-085d5a266db0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:53.910392 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c4c12-937b-4bed-aa10-085d5a266db0 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:53.911115 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:53.930031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-dc5c4c12-937b-4bed-aa10-085d5a266db0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:53.930031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:53.930031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:53.930031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:53.930031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:53.930031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:53.930031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:53.930031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:53.930031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:53.930031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:53.930031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:53.930031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:53.930031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:53.930031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:53.930031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:53.931163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:53.931163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:53.931163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:53.931163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:53.931163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:53.931163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:53.931163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:53.931163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:53.931163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:53.931163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:53.931163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:53.931163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:53.931163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:53.931163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:53.931163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:53.931163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:53.931163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:53.933346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:53.933346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:53.933346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:53.933346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:53.933346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 343/676] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:53.933346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c4c12-937b-4bed-aa10-085d5a266db0 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:53.942332 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d1d5c-45ae-43b1-9a45-5de0e0a21991 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:53.982370 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a543843-48af-436a-9d52-48feededf982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:53.983074 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a543843-48af-436a-9d52-48feededf982 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:53.983355 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a543843-48af-436a-9d52-48feededf982 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:53.983627 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a543843-48af-436a-9d52-48feededf982 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:53.984420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a543843-48af-436a-9d52-48feededf982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:53.984722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a543843-48af-436a-9d52-48feededf982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:53.986248 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a543843-48af-436a-9d52-48feededf982 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:53.999093 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 334/677] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:54.000493 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe04af-db89-4f55-a36c-eb8a3791f1b7 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:54.000847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe04af-db89-4f55-a36c-eb8a3791f1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:54.001171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbe04af-db89-4f55-a36c-eb8a3791f1b7 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:54.002573 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 335/678] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:54.005842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe04af-db89-4f55-a36c-eb8a3791f1b7 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:54.009647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:54.056999 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c4c12-937b-4bed-aa10-085d5a266db0 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:54.094554 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cf340-3083-4100-a08e-057c13eea5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:54.095445 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf340-3083-4100-a08e-057c13eea5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:54.095802 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf340-3083-4100-a08e-057c13eea5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:54.096084 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358cf340-3083-4100-a08e-057c13eea5b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:54.096919 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cf340-3083-4100-a08e-057c13eea5b3 None admin] RBAC: Adding query filter params (role.id=ce6bff4fd8b6468b94dc4af858dde77b, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=55d75cd269ff4f0daf51a728b159888a) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:54.097365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cf340-3083-4100-a08e-057c13eea5b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:54.098804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358cf340-3083-4100-a08e-057c13eea5b3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:54.105765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 344/679] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:53 2022] GET /identity/v3/role_assignments?user.id=55d75cd269ff4f0daf51a728b159888a&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=ce6bff4fd8b6468b94dc4af858dde77b => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:54.114026 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cf340-3083-4100-a08e-057c13eea5b3 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:54.124538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbe04af-db89-4f55-a36c-eb8a3791f1b7 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:54.177516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26163d7-2e6c-4877-bcd8-dba95ca747b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:54.178544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26163d7-2e6c-4877-bcd8-dba95ca747b3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:54.179540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26163d7-2e6c-4877-bcd8-dba95ca747b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:54.180189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26163d7-2e6c-4877-bcd8-dba95ca747b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:54.181348 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26163d7-2e6c-4877-bcd8-dba95ca747b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:54.181855 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26163d7-2e6c-4877-bcd8-dba95ca747b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:54.185336 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26163d7-2e6c-4877-bcd8-dba95ca747b3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:54.189152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:54.216553 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 336/680] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:54.218217 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a12c9-14cc-49e7-b138-c2187225cf58 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:54.218685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a12c9-14cc-49e7-b138-c2187225cf58 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:54.219135 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a12c9-14cc-49e7-b138-c2187225cf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:54.245915 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e44a12c9-14cc-49e7-b138-c2187225cf58 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:54.245915 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e44a12c9-14cc-49e7-b138-c2187225cf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:54.283651 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358cf340-3083-4100-a08e-057c13eea5b3 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:54.313575 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:54.327141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c7c26-7639-4ea1-9d3d-efd65bf51bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:54.328098 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c7c26-7639-4ea1-9d3d-efd65bf51bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:54.328389 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c7c26-7639-4ea1-9d3d-efd65bf51bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:54.328705 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c7c26-7639-4ea1-9d3d-efd65bf51bf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:54.337889 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c7c26-7639-4ea1-9d3d-efd65bf51bf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:54.338759 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 337/681] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:54.339441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c7c26-7639-4ea1-9d3d-efd65bf51bf2 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:54.339672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a12c9-14cc-49e7-b138-c2187225cf58 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:54.358895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-047c7c26-7639-4ea1-9d3d-efd65bf51bf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:54.358895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:54.358895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:54.358895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:54.358895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:54.358895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:54.358895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:54.358895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:54.358895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:54.358895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:54.358895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:54.358895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:54.358895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:29:54.358895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:29:54.358895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:29:54.359835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:29:54.359835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:54.359835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:54.359835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:54.359835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:54.359835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:54.359835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:54.359835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:54.359835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:54.359835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:54.359835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:54.359835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:54.359835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:54.359835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:54.359835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:54.359835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:54.359835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:54.360743 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:29:54.360743 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:29:54.360743 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:29:54.360743 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:29:54.360743 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:29:54.360743 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:29:54.360743 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:54.360743 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:54.364898 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 345/682] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:54.366082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c7c26-7639-4ea1-9d3d-efd65bf51bf2 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:54.484308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c7c26-7639-4ea1-9d3d-efd65bf51bf2 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:54.504115 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a12c9-14cc-49e7-b138-c2187225cf58 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:54.524020 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbb3ae-7349-4f63-ba4f-969ffcecc77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:54.525223 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbb3ae-7349-4f63-ba4f-969ffcecc77e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:54.525718 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbb3ae-7349-4f63-ba4f-969ffcecc77e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:54.526198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebbb3ae-7349-4f63-ba4f-969ffcecc77e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:54.539066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebbb3ae-7349-4f63-ba4f-969ffcecc77e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:54.542806 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:54.548801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-2ebbb3ae-7349-4f63-ba4f-969ffcecc77e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:54.548801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:54.548801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:54.548801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:54.548801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:54.548801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:54.548801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:54.548801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:54.548801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:54.548801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:54.548801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:54.548801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:54.548801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:54.548801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:54.548801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:54.548801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:54.549808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:54.549808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:54.549808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:54.549808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:54.549808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:54.549808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:54.549808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:54.549808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:54.549808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:54.549808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:54.549808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:54.549808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:54.549808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:54.549808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:54.549808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:54.549808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:54.550679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:54.550679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:54.550679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:54.550679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:54.550679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:54.550679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:54.550679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:54.550679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:54.550679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:54.550679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:54.550679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:54.550679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:54.553028 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 346/683] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:29:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:54.555747 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbb3ae-7349-4f63-ba4f-969ffcecc77e None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:54.561280 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49851240-4dd2-44c8-9cce-45b52994aa44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:54.562195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49851240-4dd2-44c8-9cce-45b52994aa44 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:54.562551 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49851240-4dd2-44c8-9cce-45b52994aa44 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:54.562928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49851240-4dd2-44c8-9cce-45b52994aa44 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:54.578623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49851240-4dd2-44c8-9cce-45b52994aa44 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:54.580005 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49851240-4dd2-44c8-9cce-45b52994aa44 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:54.598754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-49851240-4dd2-44c8-9cce-45b52994aa44 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:29:54.598754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:54.598754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:54.598754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:54.598754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:54.598754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:54.598754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:54.598754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:54.598754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:54.598754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:54.598754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:54.598754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:54.598754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:29:54.598754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:29:54.598754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:29:54.598754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:29:54.599967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:54.599967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:54.599967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:29:54.599967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:54.599967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:29:54.599967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:54.599967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:54.599967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:54.599967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:54.599967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:54.599967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:54.599967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:54.599967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:54.599967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:54.599967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:54.599967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:54.599967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:54.599967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:54.601146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:54.601146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:54.601146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:29:54.601146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:29:54.601146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:29:54.601146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:29:54.601146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:29:54.601146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:29:54.601146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:29:54.601146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:54.611285 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:54.611641 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 338/684] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:29:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:54.613293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49851240-4dd2-44c8-9cce-45b52994aa44 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:54.674983 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebbb3ae-7349-4f63-ba4f-969ffcecc77e None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:54.712524 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bed19-f45a-4ec2-bb9a-6722278cc9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:54.713536 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bed19-f45a-4ec2-bb9a-6722278cc9bb None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:54.713954 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bed19-f45a-4ec2-bb9a-6722278cc9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:54.714459 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7bed19-f45a-4ec2-bb9a-6722278cc9bb None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:54.715404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bed19-f45a-4ec2-bb9a-6722278cc9bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:54.716516 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bed19-f45a-4ec2-bb9a-6722278cc9bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:54.718257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7bed19-f45a-4ec2-bb9a-6722278cc9bb None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:54.732605 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 347/685] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:29:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:54.733891 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bed19-f45a-4ec2-bb9a-6722278cc9bb None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:54.763877 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49851240-4dd2-44c8-9cce-45b52994aa44 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:54.809987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9c9e2-d3e2-444a-a047-9e7caf01c25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:54.809987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9c9e2-d3e2-444a-a047-9e7caf01c25c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:54.809987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9c9e2-d3e2-444a-a047-9e7caf01c25c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:54.809987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9c9e2-d3e2-444a-a047-9e7caf01c25c None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:54.810625 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9c9e2-d3e2-444a-a047-9e7caf01c25c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:54.811014 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9c9e2-d3e2-444a-a047-9e7caf01c25c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:54.812514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9c9e2-d3e2-444a-a047-9e7caf01c25c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:54.822492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 339/686] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:54.823465 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9c9e2-d3e2-444a-a047-9e7caf01c25c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:54.849948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7bed19-f45a-4ec2-bb9a-6722278cc9bb None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:54.852122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:54.886360 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:54.894125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530074f6-da58-47f1-a57a-f77af69648e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:54.897867 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530074f6-da58-47f1-a57a-f77af69648e1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:54.897867 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530074f6-da58-47f1-a57a-f77af69648e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:54.897867 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530074f6-da58-47f1-a57a-f77af69648e1 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:54.897867 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530074f6-da58-47f1-a57a-f77af69648e1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:54.897867 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530074f6-da58-47f1-a57a-f77af69648e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:54.898235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530074f6-da58-47f1-a57a-f77af69648e1 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:54.920861 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 348/687] 10.222.0.76 () {56 vars in 1135 bytes} [Mon Jul 18 16:29:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:54.921450 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530074f6-da58-47f1-a57a-f77af69648e1 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:54.949729 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9c9e2-d3e2-444a-a047-9e7caf01c25c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:55.000171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12c0e0-6965-47ed-978a-499970407338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:55.001296 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12c0e0-6965-47ed-978a-499970407338 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:55.001797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12c0e0-6965-47ed-978a-499970407338 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:55.002286 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12c0e0-6965-47ed-978a-499970407338 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:55.003500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12c0e0-6965-47ed-978a-499970407338 None admin] RBAC: Adding query filter params (role.id=ce6bff4fd8b6468b94dc4af858dde77b, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=e9dcca05df70446090cd525c0644cfc8) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:55.004048 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12c0e0-6965-47ed-978a-499970407338 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:55.005849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12c0e0-6965-47ed-978a-499970407338 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:55.014282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 340/688] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:54 2022] GET /identity/v3/role_assignments?user.id=e9dcca05df70446090cd525c0644cfc8&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=ce6bff4fd8b6468b94dc4af858dde77b => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:55.015627 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12c0e0-6965-47ed-978a-499970407338 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:55.049423 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530074f6-da58-47f1-a57a-f77af69648e1 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:55.104699 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a643951-22b3-4542-950d-ef6a6a708b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:55.107102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a643951-22b3-4542-950d-ef6a6a708b2d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:55.107102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a643951-22b3-4542-950d-ef6a6a708b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:55.107539 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a643951-22b3-4542-950d-ef6a6a708b2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:55.132164 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a643951-22b3-4542-950d-ef6a6a708b2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:55.133704 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a643951-22b3-4542-950d-ef6a6a708b2d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:55.164705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12c0e0-6965-47ed-978a-499970407338 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:55.173597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-3a643951-22b3-4542-950d-ef6a6a708b2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:55.173597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:55.173597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:55.173597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:55.173597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:55.173597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:55.173597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:55.173597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:55.173597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:55.173597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:55.173597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:55.173597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:55.173597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:55.173597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:55.173597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:55.174619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:55.174619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:55.174619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:55.174619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:55.174619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:55.174619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:55.174619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:55.174619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:55.174619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:55.174619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:55.174619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:55.174619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:55.174619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:55.174619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:55.174619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:55.174619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:55.174619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:55.176613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:55.176613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:55.176613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:55.176613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:55.176613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 349/689] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:55.181519 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a643951-22b3-4542-950d-ef6a6a708b2d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:55.188457 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:55.209189 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:55.220985 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07726784-02be-4692-9eb2-77b74095faac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:55.222199 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07726784-02be-4692-9eb2-77b74095faac None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:55.222718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07726784-02be-4692-9eb2-77b74095faac None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:55.223206 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07726784-02be-4692-9eb2-77b74095faac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:55.335747 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07726784-02be-4692-9eb2-77b74095faac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:55.338325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07726784-02be-4692-9eb2-77b74095faac None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:55.355794 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a643951-22b3-4542-950d-ef6a6a708b2d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:55.403985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c93c1-3357-41c4-bffe-9d0f150e2015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:55.404670 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c93c1-3357-41c4-bffe-9d0f150e2015 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:55.404950 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c93c1-3357-41c4-bffe-9d0f150e2015 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:55.405284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3c93c1-3357-41c4-bffe-9d0f150e2015 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:55.406019 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c93c1-3357-41c4-bffe-9d0f150e2015 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:55.406326 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c93c1-3357-41c4-bffe-9d0f150e2015 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:55.407721 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3c93c1-3357-41c4-bffe-9d0f150e2015 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:55.426925 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 350/690] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:55.432259 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c93c1-3357-41c4-bffe-9d0f150e2015 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:55.495611 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 341/691] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:29:55.501743 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07726784-02be-4692-9eb2-77b74095faac None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:55.521273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:55.523443 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:55.591905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3c93c1-3357-41c4-bffe-9d0f150e2015 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:55.627694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07726784-02be-4692-9eb2-77b74095faac None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:55.667681 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1033fd-ac62-4ebb-9d98-5d55a9b9a847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:55.669760 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1033fd-ac62-4ebb-9d98-5d55a9b9a847 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:55.670206 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1033fd-ac62-4ebb-9d98-5d55a9b9a847 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:55.670637 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1033fd-ac62-4ebb-9d98-5d55a9b9a847 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:55.673939 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aeabee-f00a-46a2-a7bf-e93d560647ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:55.674784 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeabee-f00a-46a2-a7bf-e93d560647ee None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:55.675073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeabee-f00a-46a2-a7bf-e93d560647ee None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:55.675352 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeabee-f00a-46a2-a7bf-e93d560647ee None admin] PATH_INFO: `/v3/users/nova` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:55.683869 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1033fd-ac62-4ebb-9d98-5d55a9b9a847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:55.684075 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aeabee-f00a-46a2-a7bf-e93d560647ee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:55.685909 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1033fd-ac62-4ebb-9d98-5d55a9b9a847 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:55.690059 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aeabee-f00a-46a2-a7bf-e93d560647ee None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:55.705907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-2c1033fd-ac62-4ebb-9d98-5d55a9b9a847 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:55.705907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:55.705907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:55.705907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:55.705907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:55.705907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:55.705907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:55.705907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:55.705907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:55.705907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:55.705907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:55.705907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:55.705907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:55.705907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:55.705907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:55.706908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:55.706908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:55.706908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:55.706908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:55.706908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:55.706908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:55.706908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:55.706908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:55.706908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:55.706908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:55.706908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:55.706908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:55.706908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:55.706908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:55.706908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:55.706908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:55.706908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:55.707864 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:55.707864 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:55.707864 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:55.707864 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:55.710237 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 342/692] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:55.716488 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1033fd-ac62-4ebb-9d98-5d55a9b9a847 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:55.719910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-83aeabee-f00a-46a2-a7bf-e93d560647ee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:29:55.719910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:55.719910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:55.719910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:55.719910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:55.719910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:55.719910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:55.719910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:55.719910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:55.719910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:55.719910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:55.719910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:55.719910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:29:55.719910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:29:55.719910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:29:55.719910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:29:55.720871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:55.720871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:55.720871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:29:55.720871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:55.720871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:29:55.720871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:29:55.720871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:55.720871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:55.720871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:55.720871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:55.720871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:55.720871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:55.720871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:55.720871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:55.720871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:55.720871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:55.720871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:55.720871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:55.721941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:55.721941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:55.721941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:29:55.721941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:29:55.721941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:29:55.721941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:29:55.721941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:29:55.721941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:29:55.721941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:29:55.721941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:55.721941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 351/693] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Jul 18 16:29:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:55.730143 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aeabee-f00a-46a2-a7bf-e93d560647ee None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:55.795269 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:55.833681 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1033fd-ac62-4ebb-9d98-5d55a9b9a847 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:55.873440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f81c1-060d-43a5-bfd9-f1236d79fc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:55.874601 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f81c1-060d-43a5-bfd9-f1236d79fc2c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:55.875098 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f81c1-060d-43a5-bfd9-f1236d79fc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:55.875601 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f81c1-060d-43a5-bfd9-f1236d79fc2c None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:55.876543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f81c1-060d-43a5-bfd9-f1236d79fc2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:55.877125 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f81c1-060d-43a5-bfd9-f1236d79fc2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:55.878853 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f81c1-060d-43a5-bfd9-f1236d79fc2c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:55.892223 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 343/694] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:55.897954 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f81c1-060d-43a5-bfd9-f1236d79fc2c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:55.952332 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aeabee-f00a-46a2-a7bf-e93d560647ee None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:55.999289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:56.004869 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe63a91-73c5-4da1-a5ce-785c60201a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:56.005934 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe63a91-73c5-4da1-a5ce-785c60201a36 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:56.006428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe63a91-73c5-4da1-a5ce-785c60201a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:56.013739 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe63a91-73c5-4da1-a5ce-785c60201a36 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:56.013739 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe63a91-73c5-4da1-a5ce-785c60201a36 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:56.013739 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe63a91-73c5-4da1-a5ce-785c60201a36 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:56.013739 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe63a91-73c5-4da1-a5ce-785c60201a36 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:56.029184 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f81c1-060d-43a5-bfd9-f1236d79fc2c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:56.031591 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 352/695] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Jul 18 16:29:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:29:56.033447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fa060-ce19-481a-9774-4613021edafd None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:56.033961 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fa060-ce19-481a-9774-4613021edafd None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:56.034442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14fa060-ce19-481a-9774-4613021edafd None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:56.036282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 353/696] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:56.037235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fa060-ce19-481a-9774-4613021edafd None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:56.060344 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:56.072064 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3db701-933f-4362-808c-7da02e91cf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:56.072970 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3db701-933f-4362-808c-7da02e91cf87 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:56.073317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3db701-933f-4362-808c-7da02e91cf87 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:56.073856 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3db701-933f-4362-808c-7da02e91cf87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:56.082016 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3db701-933f-4362-808c-7da02e91cf87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:56.084239 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3db701-933f-4362-808c-7da02e91cf87 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:56.103674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-1d3db701-933f-4362-808c-7da02e91cf87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:56.103674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:56.103674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:56.103674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:56.103674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:56.103674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:56.103674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:56.103674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:56.103674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:56.103674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:56.103674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:56.103674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:56.103674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:29:56.103674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:29:56.103674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:29:56.104781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:29:56.104781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:56.104781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:56.104781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:56.104781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:56.104781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:56.104781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:56.104781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:56.104781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:56.104781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:56.104781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:56.104781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:56.104781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:56.104781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:56.104781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:56.104781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:56.104781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:56.105741 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:29:56.105741 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:29:56.105741 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:29:56.105741 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:29:56.105741 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:29:56.105741 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:29:56.105741 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:56.105741 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:56.106684 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 344/697] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:56.109740 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1b84e-6afe-47cb-9b00-cb0ad808a734 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:56.109740 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1b84e-6afe-47cb-9b00-cb0ad808a734 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:56.109740 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1b84e-6afe-47cb-9b00-cb0ad808a734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:56.127561 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-24c1b84e-6afe-47cb-9b00-cb0ad808a734 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:56.128781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-24c1b84e-6afe-47cb-9b00-cb0ad808a734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:56.160463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14fa060-ce19-481a-9774-4613021edafd None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:56.199187 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13d8ae-9c23-4830-8f67-5e054aab9eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:56.200434 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13d8ae-9c23-4830-8f67-5e054aab9eef None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:56.200783 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13d8ae-9c23-4830-8f67-5e054aab9eef None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:56.201093 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13d8ae-9c23-4830-8f67-5e054aab9eef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:56.229534 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 345/698] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:56.230688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1b84e-6afe-47cb-9b00-cb0ad808a734 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:56.269690 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:56.281193 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13d8ae-9c23-4830-8f67-5e054aab9eef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:56.287543 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13d8ae-9c23-4830-8f67-5e054aab9eef None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:56.366334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1b84e-6afe-47cb-9b00-cb0ad808a734 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:56.383378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:56.402386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 354/699] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:29:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:29:56.404641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13d8ae-9c23-4830-8f67-5e054aab9eef None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:56.407456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8b65f-fb1f-4407-a62d-fdfde821e230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:56.408167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8b65f-fb1f-4407-a62d-fdfde821e230 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:56.409059 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8b65f-fb1f-4407-a62d-fdfde821e230 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:56.409059 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8b65f-fb1f-4407-a62d-fdfde821e230 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:56.409658 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8b65f-fb1f-4407-a62d-fdfde821e230 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:56.409976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8b65f-fb1f-4407-a62d-fdfde821e230 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:56.411427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e8b65f-fb1f-4407-a62d-fdfde821e230 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:56.429058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 346/700] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:29:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:56.429058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8b65f-fb1f-4407-a62d-fdfde821e230 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:56.522694 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:56.534075 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13d8ae-9c23-4830-8f67-5e054aab9eef None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:56.556014 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8b65f-fb1f-4407-a62d-fdfde821e230 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:56.576718 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef151c0d-c02e-42af-9112-a5e7664e57b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:56.577569 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef151c0d-c02e-42af-9112-a5e7664e57b7 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:56.577857 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef151c0d-c02e-42af-9112-a5e7664e57b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:56.578137 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef151c0d-c02e-42af-9112-a5e7664e57b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:56.589981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef151c0d-c02e-42af-9112-a5e7664e57b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:56.592013 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef151c0d-c02e-42af-9112-a5e7664e57b7 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:56.603647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4aee7-51e5-4495-b925-d93958b8a87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:56.604787 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4aee7-51e5-4495-b925-d93958b8a87a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:56.605117 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4aee7-51e5-4495-b925-d93958b8a87a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:56.605404 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c4aee7-51e5-4495-b925-d93958b8a87a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:56.613068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-ef151c0d-c02e-42af-9112-a5e7664e57b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:56.613068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:56.613068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:56.613068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:56.613068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:56.613068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:56.613068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:56.613068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:56.613068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:56.613068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:56.613068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:56.613068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:56.613068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:56.613068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:56.613068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:56.614290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:56.614290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:56.614290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:56.614290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:56.614290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:56.614290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:56.614290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:56.614290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:56.614290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:56.614290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:56.614290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:56.614290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:56.614290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:56.614290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:56.614290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:56.614290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:56.614290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:56.615346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:56.615346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:56.615346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:56.615346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:56.615346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 355/701] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:56.615639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef151c0d-c02e-42af-9112-a5e7664e57b7 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:56.625873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c4aee7-51e5-4495-b925-d93958b8a87a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:56.642965 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c4aee7-51e5-4495-b925-d93958b8a87a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:56.648046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-97c4aee7-51e5-4495-b925-d93958b8a87a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:56.648046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:56.648046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:56.648046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:56.648046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:56.648046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:56.648046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:56.648046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:56.648046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:56.648046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:56.648046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:56.648046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:56.648046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:29:56.648046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:29:56.648046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:29:56.649227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:29:56.649227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:56.649227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:56.649227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:56.649227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:56.649227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:56.649227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:56.649227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:56.649227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:56.649227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:56.649227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:56.649227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:56.649227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:56.649227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:56.649227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:56.649227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:56.649227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:56.651061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:29:56.651061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:29:56.651061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:29:56.651061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:56.654579 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 347/702] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:56.655536 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4aee7-51e5-4495-b925-d93958b8a87a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:56.691351 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:56.744662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef151c0d-c02e-42af-9112-a5e7664e57b7 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:56.774224 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c4aee7-51e5-4495-b925-d93958b8a87a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:56.788104 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58582c56-b3ec-4cce-beec-a7eda4f7c3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:56.788743 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58582c56-b3ec-4cce-beec-a7eda4f7c3bc None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:56.789048 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58582c56-b3ec-4cce-beec-a7eda4f7c3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:56.789332 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58582c56-b3ec-4cce-beec-a7eda4f7c3bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:56.790169 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58582c56-b3ec-4cce-beec-a7eda4f7c3bc None admin] RBAC: Adding query filter params (role.id=ce6bff4fd8b6468b94dc4af858dde77b, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=50bc0fa34b414328a342d685bc1eaca3) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:56.790479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58582c56-b3ec-4cce-beec-a7eda4f7c3bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:56.791915 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58582c56-b3ec-4cce-beec-a7eda4f7c3bc None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:56.805107 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 356/703] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:56 2022] GET /identity/v3/role_assignments?user.id=50bc0fa34b414328a342d685bc1eaca3&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=ce6bff4fd8b6468b94dc4af858dde77b => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:56.805107 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58582c56-b3ec-4cce-beec-a7eda4f7c3bc None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:56.808946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:56.825729 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99079dd8-2541-46e2-8427-dc62b22cfb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:56.830865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99079dd8-2541-46e2-8427-dc62b22cfb2b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:56.830865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99079dd8-2541-46e2-8427-dc62b22cfb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:56.830865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99079dd8-2541-46e2-8427-dc62b22cfb2b None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:56.830865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99079dd8-2541-46e2-8427-dc62b22cfb2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:56.830865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99079dd8-2541-46e2-8427-dc62b22cfb2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:56.832083 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99079dd8-2541-46e2-8427-dc62b22cfb2b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:56.850695 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 348/704] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:56.852323 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90cf49-6d6e-4bd1-8163-2aca28deb8b6 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:56.853167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90cf49-6d6e-4bd1-8163-2aca28deb8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:56.853606 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a90cf49-6d6e-4bd1-8163-2aca28deb8b6 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:56.855920 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 349/705] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:56.856835 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90cf49-6d6e-4bd1-8163-2aca28deb8b6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:56.925773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58582c56-b3ec-4cce-beec-a7eda4f7c3bc None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:56.978967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93917fd5-e120-4482-884c-6f7ed1b7e579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:56.979889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:56.980077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93917fd5-e120-4482-884c-6f7ed1b7e579 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:56.981059 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93917fd5-e120-4482-884c-6f7ed1b7e579 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:56.981188 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93917fd5-e120-4482-884c-6f7ed1b7e579 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:56.982088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93917fd5-e120-4482-884c-6f7ed1b7e579 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:56.982397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93917fd5-e120-4482-884c-6f7ed1b7e579 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:56.983777 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93917fd5-e120-4482-884c-6f7ed1b7e579 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:56.999160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 357/706] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:29:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:57.000616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8708000-6afc-429d-b48a-f4b36a482163 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:57.000905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8708000-6afc-429d-b48a-f4b36a482163 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:57.001204 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8708000-6afc-429d-b48a-f4b36a482163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:57.005326 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a90cf49-6d6e-4bd1-8163-2aca28deb8b6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:57.023287 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e8708000-6afc-429d-b48a-f4b36a482163 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:57.025579 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e8708000-6afc-429d-b48a-f4b36a482163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:57.051089 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d0bed-156e-4601-bfed-72c8b1a5f21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:57.051417 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d0bed-156e-4601-bfed-72c8b1a5f21c None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:57.051661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d0bed-156e-4601-bfed-72c8b1a5f21c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:57.051932 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d0bed-156e-4601-bfed-72c8b1a5f21c None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:57.052644 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d0bed-156e-4601-bfed-72c8b1a5f21c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:57.054135 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d0bed-156e-4601-bfed-72c8b1a5f21c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:57.102732 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:57.111659 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 358/707] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:57.112478 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8708000-6afc-429d-b48a-f4b36a482163 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:57.136708 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 350/708] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 16:29:56 2022] POST /identity/v3/users => generated 254 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:29:57.142307 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d0bed-156e-4601-bfed-72c8b1a5f21c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:57.257834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8708000-6afc-429d-b48a-f4b36a482163 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:57.274119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d0bed-156e-4601-bfed-72c8b1a5f21c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:57.300885 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec987f-b1f0-4637-b8d2-d744ecdde421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:57.302143 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec987f-b1f0-4637-b8d2-d744ecdde421 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:57.302653 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec987f-b1f0-4637-b8d2-d744ecdde421 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:57.303144 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec987f-b1f0-4637-b8d2-d744ecdde421 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:57.311396 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec987f-b1f0-4637-b8d2-d744ecdde421 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:57.313306 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dec987f-b1f0-4637-b8d2-d744ecdde421 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:57.322708 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9904be-aa81-4e39-b791-7f8f35634121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:57.323553 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9904be-aa81-4e39-b791-7f8f35634121 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:57.323839 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9904be-aa81-4e39-b791-7f8f35634121 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:57.324121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9904be-aa81-4e39-b791-7f8f35634121 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:57.325366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9904be-aa81-4e39-b791-7f8f35634121 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:57.326856 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9904be-aa81-4e39-b791-7f8f35634121 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:57.333289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-5dec987f-b1f0-4637-b8d2-d744ecdde421 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:57.333289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:57.333289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:57.333289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:57.333289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:57.333289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:57.333289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:57.333289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:57.333289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:57.333289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:57.333289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:57.333289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:57.333289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:29:57.333289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:29:57.333289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:29:57.334310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:29:57.334310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:57.334310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:57.334310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:57.334310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:57.334310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:57.334310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:57.334310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:57.334310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:57.334310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:57.334310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:57.334310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:57.334310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:57.334310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:57.334310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:57.334310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:57.334310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:57.335196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:29:57.335196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:29:57.335196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:29:57.335196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:29:57.335196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:29:57.335196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:29:57.335196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:29:57.335196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:57.337720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 359/709] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:57.344180 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec987f-b1f0-4637-b8d2-d744ecdde421 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:57.347796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-5a9904be-aa81-4e39-b791-7f8f35634121 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 16:29:57.347796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:57.347796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:29:57.347796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:29:57.347796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:29:57.347796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:29:57.347796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:29:57.347796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:29:57.347796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 16:29:57.347796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:57.347796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:29:57.347796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:57.347796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:57.347796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:57.347796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:57.347796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:57.348756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:57.348756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:57.348756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:57.348756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:57.348756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:57.348756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:57.348756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:57.348756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:29:57.348756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:29:57.348756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:29:57.348756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:29:57.348756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:57.348756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:57.348756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:57.348756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:57.348756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:57.349683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:57.349683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:57.349683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:57.349683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:57.349683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:57.349683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:57.349683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:57.349683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:57.349683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:57.349683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:57.349683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:57.349683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:29:57.349683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:29:57.349683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 16:29:57.349683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:57.349683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 351/710] 10.222.0.76 () {56 vars in 1129 bytes} [Mon Jul 18 16:29:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:29:57.360281 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9904be-aa81-4e39-b791-7f8f35634121 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:57.382109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:57.452470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:57.505153 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dec987f-b1f0-4637-b8d2-d744ecdde421 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:57.518004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9904be-aa81-4e39-b791-7f8f35634121 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:57.553046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d082a5-3f2a-44af-89ed-3c8636d600ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:57.555133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d082a5-3f2a-44af-89ed-3c8636d600ac None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:57.555565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d082a5-3f2a-44af-89ed-3c8636d600ac None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:57.555984 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d082a5-3f2a-44af-89ed-3c8636d600ac None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:57.557736 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d082a5-3f2a-44af-89ed-3c8636d600ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:57.558321 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d082a5-3f2a-44af-89ed-3c8636d600ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:57.560721 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d082a5-3f2a-44af-89ed-3c8636d600ac None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:57.562770 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b4470-e715-4f53-8ddf-36bbd757cee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:57.563556 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b4470-e715-4f53-8ddf-36bbd757cee4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:57.563944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b4470-e715-4f53-8ddf-36bbd757cee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:57.564325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b4470-e715-4f53-8ddf-36bbd757cee4 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:57.565184 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b4470-e715-4f53-8ddf-36bbd757cee4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:57.565600 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b4470-e715-4f53-8ddf-36bbd757cee4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:57.567116 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b4470-e715-4f53-8ddf-36bbd757cee4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:57.576093 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 352/711] 10.222.0.76 () {56 vars in 1124 bytes} [Mon Jul 18 16:29:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:57.579271 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8471f2-569b-4c7f-ba88-be352df4f149 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:57.579697 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8471f2-569b-4c7f-ba88-be352df4f149 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:57.580083 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8471f2-569b-4c7f-ba88-be352df4f149 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:57.581912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 353/712] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:57.582386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 360/713] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:29:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:57.585069 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8471f2-569b-4c7f-ba88-be352df4f149 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:57.587280 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b4d21-79dd-4e54-a207-f59ee33b3c4e None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:57.587577 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b4d21-79dd-4e54-a207-f59ee33b3c4e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:57.587858 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b4d21-79dd-4e54-a207-f59ee33b3c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:57.606304 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-414b4d21-79dd-4e54-a207-f59ee33b3c4e None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:57.607497 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-414b4d21-79dd-4e54-a207-f59ee33b3c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:57.681553 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:57.702872 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 361/714] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:29:57.704599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b4d21-79dd-4e54-a207-f59ee33b3c4e None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:57.732375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8471f2-569b-4c7f-ba88-be352df4f149 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:57.772067 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:57.784194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964a1a2-ce22-49cd-be31-4f4f39a0abfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:57.785998 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964a1a2-ce22-49cd-be31-4f4f39a0abfa None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:57.786698 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964a1a2-ce22-49cd-be31-4f4f39a0abfa None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:57.787138 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964a1a2-ce22-49cd-be31-4f4f39a0abfa None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:57.788325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964a1a2-ce22-49cd-be31-4f4f39a0abfa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:57.789061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964a1a2-ce22-49cd-be31-4f4f39a0abfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:57.791198 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1964a1a2-ce22-49cd-be31-4f4f39a0abfa None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:57.805123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 354/715] 10.222.0.76 () {56 vars in 1124 bytes} [Mon Jul 18 16:29:57 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:57.805123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964a1a2-ce22-49cd-be31-4f4f39a0abfa None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:57.871218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b4d21-79dd-4e54-a207-f59ee33b3c4e None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:57.936609 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964a1a2-ce22-49cd-be31-4f4f39a0abfa None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:57.950543 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36a87e-86ae-4759-8cde-2f8d300074b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:57.952007 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36a87e-86ae-4759-8cde-2f8d300074b5 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:57.952524 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36a87e-86ae-4759-8cde-2f8d300074b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:57.953050 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36a87e-86ae-4759-8cde-2f8d300074b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:57.954128 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36a87e-86ae-4759-8cde-2f8d300074b5 None admin] RBAC: Adding query filter params (role.id=c2d5d80485df4730903a874937d68aa3, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=381cf4381ce64379b285d75e2909813d) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:57.954654 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36a87e-86ae-4759-8cde-2f8d300074b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:57.956373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed36a87e-86ae-4759-8cde-2f8d300074b5 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:57.969151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 362/716] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:29:57 2022] GET /identity/v3/role_assignments?user.id=381cf4381ce64379b285d75e2909813d&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=c2d5d80485df4730903a874937d68aa3 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:58.000894 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d7b15-fc2f-4c6f-80a3-195c034aa368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:58.001764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d7b15-fc2f-4c6f-80a3-195c034aa368 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:58.002053 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d7b15-fc2f-4c6f-80a3-195c034aa368 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:58.002374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d7b15-fc2f-4c6f-80a3-195c034aa368 None admin] PATH_INFO: `/v3/services/network` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:58.003074 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d7b15-fc2f-4c6f-80a3-195c034aa368 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:58.004557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d7b15-fc2f-4c6f-80a3-195c034aa368 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:58.006809 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:58.018190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-b14d7b15-fc2f-4c6f-80a3-195c034aa368 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 16:29:58.018190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:58.018190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:29:58.018190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:29:58.018190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:29:58.018190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:29:58.018190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:29:58.018190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:29:58.018190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 16:29:58.018190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:58.018190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:29:58.018190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:58.018190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:58.018190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:58.018190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:58.018190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:58.018190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:58.020947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:58.020947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:58.020947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:58.020947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:58.020947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:58.020947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:58.020947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:29:58.020947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:29:58.020947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:29:58.020947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:29:58.020947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:58.020947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:58.020947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:58.020947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:58.020947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:58.020947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:58.021950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:58.021950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:58.021950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:58.021950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:58.021950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:58.021950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:58.021950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:58.021950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:58.021950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:58.021950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:58.021950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:29:58.021950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:29:58.021950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 16:29:58.021950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:29:58.021950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 355/717] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:29:57 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:58.029479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36a87e-86ae-4759-8cde-2f8d300074b5 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:58.170651 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36a87e-86ae-4759-8cde-2f8d300074b5 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:58.181993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:58.207490 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e27eb-2f79-4716-9690-a6e3518bdcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:58.208542 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e27eb-2f79-4716-9690-a6e3518bdcb4 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:58.209062 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e27eb-2f79-4716-9690-a6e3518bdcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:58.209567 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e27eb-2f79-4716-9690-a6e3518bdcb4 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:58.210494 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e27eb-2f79-4716-9690-a6e3518bdcb4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:58.211001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e27eb-2f79-4716-9690-a6e3518bdcb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:58.212677 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e27eb-2f79-4716-9690-a6e3518bdcb4 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:58.223442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 363/718] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 16:29:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:58.225257 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d7b15-fc2f-4c6f-80a3-195c034aa368 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:58.424607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d7b15-fc2f-4c6f-80a3-195c034aa368 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:58.474634 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a0b1e-6b26-4951-8628-fcc8353e5719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:58.475316 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a0b1e-6b26-4951-8628-fcc8353e5719 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:58.475608 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a0b1e-6b26-4951-8628-fcc8353e5719 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:58.475891 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a0b1e-6b26-4951-8628-fcc8353e5719 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:58.476618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a0b1e-6b26-4951-8628-fcc8353e5719 None admin] RBAC: Adding query filter params (type=network) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:58.476931 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a0b1e-6b26-4951-8628-fcc8353e5719 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:58.478431 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a0b1e-6b26-4951-8628-fcc8353e5719 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:58.484940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 356/719] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 16:29:58 2022] GET /identity/v3/services?type=network => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:59.430561 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79eb19-cda3-4bcb-8c8e-d4b9aefae04f None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:59.431054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79eb19-cda3-4bcb-8c8e-d4b9aefae04f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:59.431054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c79eb19-cda3-4bcb-8c8e-d4b9aefae04f None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:59.432687 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 364/720] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:29:59.438748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23c0c6-1f7b-4eba-80a8-27900adb8ee3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:59.439178 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23c0c6-1f7b-4eba-80a8-27900adb8ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:59.439458 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23c0c6-1f7b-4eba-80a8-27900adb8ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:59.456883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1b23c0c6-1f7b-4eba-80a8-27900adb8ee3 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:29:59.458149 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1b23c0c6-1f7b-4eba-80a8-27900adb8ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:29:59.519642 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:29:59.531817 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 357/721] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:29:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:29:59.556375 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79eb19-cda3-4bcb-8c8e-d4b9aefae04f None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:59.666609 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c79eb19-cda3-4bcb-8c8e-d4b9aefae04f None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:59.703759 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6bf81-211a-40e8-afb7-d443d2d2088b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:59.704492 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6bf81-211a-40e8-afb7-d443d2d2088b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:59.704781 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6bf81-211a-40e8-afb7-d443d2d2088b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:59.705089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6bf81-211a-40e8-afb7-d443d2d2088b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:59.716847 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e6bf81-211a-40e8-afb7-d443d2d2088b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:29:59.726537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-20e6bf81-211a-40e8-afb7-d443d2d2088b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:59.726537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:29:59.726537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:29:59.726537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:29:59.726537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:29:59.726537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:29:59.726537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:29:59.726537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:29:59.726537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:29:59.726537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:29:59.726537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:29:59.726537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:29:59.726537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:29:59.726537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:29:59.726537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:29:59.726537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:29:59.727553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:29:59.727553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:29:59.727553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:29:59.727553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:29:59.727553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:29:59.727553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:29:59.727553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:29:59.727553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:29:59.727553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:29:59.727553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:29:59.727553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:29:59.727553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:29:59.727553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:29:59.727553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:29:59.727553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:29:59.727553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:29:59.728837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:29:59.728837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:29:59.728837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:29:59.728837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:29:59.728837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:29:59.728837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:29:59.728837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:29:59.728837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:29:59.728837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:29:59.728837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:29:59.728837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:29:59.728837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:29:59.728837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 365/722] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:29:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:29:59.735487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23c0c6-1f7b-4eba-80a8-27900adb8ee3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:59.845795 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23c0c6-1f7b-4eba-80a8-27900adb8ee3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:29:59.882228 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cace2-bbdd-4bdd-94ee-9bf8415f51a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:29:59.882910 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cace2-bbdd-4bdd-94ee-9bf8415f51a8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:29:59.883200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cace2-bbdd-4bdd-94ee-9bf8415f51a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:29:59.883483 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178cace2-bbdd-4bdd-94ee-9bf8415f51a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:29:59.884249 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178cace2-bbdd-4bdd-94ee-9bf8415f51a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:29:59.884563 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178cace2-bbdd-4bdd-94ee-9bf8415f51a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:29:59.885990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178cace2-bbdd-4bdd-94ee-9bf8415f51a8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:29:59.895416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 358/723] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:29:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:29:59.901104 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6bf81-211a-40e8-afb7-d443d2d2088b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:29:59.938899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:00.008475 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6bf81-211a-40e8-afb7-d443d2d2088b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:00.046361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3b43d-31ff-4844-ad01-c13a822657c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:00.047182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3b43d-31ff-4844-ad01-c13a822657c2 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:00.047470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3b43d-31ff-4844-ad01-c13a822657c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:00.047752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3b43d-31ff-4844-ad01-c13a822657c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:00.059213 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3b43d-31ff-4844-ad01-c13a822657c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:00.060683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea3b43d-31ff-4844-ad01-c13a822657c2 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:00.078481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-6ea3b43d-31ff-4844-ad01-c13a822657c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:00.078481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:00.078481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:00.078481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:00.078481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:00.078481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:00.078481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:00.078481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:00.078481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:00.078481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:00.078481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:00.078481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:00.078481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:00.078481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:00.078481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:00.079446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:00.079446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:00.079446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:00.079446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:00.079446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:00.079446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:00.079446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:00.079446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:00.079446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:00.079446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:00.079446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:00.079446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:00.079446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:00.079446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:00.079446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:00.079446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:00.079446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:00.080874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:00.080874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:00.080874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:00.080874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:00.080874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 366/724] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:29:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:00.085593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cace2-bbdd-4bdd-94ee-9bf8415f51a8 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:00.144330 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6473f-072f-4730-b257-8e5bfe31dbb4 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:00.144760 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6473f-072f-4730-b257-8e5bfe31dbb4 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:00.145070 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6473f-072f-4730-b257-8e5bfe31dbb4 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:00.148562 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 367/725] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:30:00.158638 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f897f-71de-4b2a-ad7a-59e3d3f8cb10 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:00.158945 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f897f-71de-4b2a-ad7a-59e3d3f8cb10 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:00.159261 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f897f-71de-4b2a-ad7a-59e3d3f8cb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:00.165470 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:00.185996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-747f897f-71de-4b2a-ad7a-59e3d3f8cb10 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:00.185996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-747f897f-71de-4b2a-ad7a-59e3d3f8cb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:00.265295 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 368/726] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 18 16:30:00.286614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178cace2-bbdd-4bdd-94ee-9bf8415f51a8 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:00.291699 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f897f-71de-4b2a-ad7a-59e3d3f8cb10 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:00.311414 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:00.378847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86872770-2ab8-4e73-b27c-3cc4e8ce2f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:00.380077 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86872770-2ab8-4e73-b27c-3cc4e8ce2f1f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:00.380189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86872770-2ab8-4e73-b27c-3cc4e8ce2f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:00.382313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86872770-2ab8-4e73-b27c-3cc4e8ce2f1f None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:00.384026 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86872770-2ab8-4e73-b27c-3cc4e8ce2f1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:00.384026 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86872770-2ab8-4e73-b27c-3cc4e8ce2f1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:00.385919 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86872770-2ab8-4e73-b27c-3cc4e8ce2f1f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:00.402389 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 359/727] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:00.404701 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b66dd-8b31-48a2-8853-5bf4e52db66a None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:00.405129 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b66dd-8b31-48a2-8853-5bf4e52db66a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:00.405514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b66dd-8b31-48a2-8853-5bf4e52db66a None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:00.407131 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 360/728] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:00.411363 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b66dd-8b31-48a2-8853-5bf4e52db66a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:00.421750 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f897f-71de-4b2a-ad7a-59e3d3f8cb10 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:00.468005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73433e7b-3ac3-46cb-8167-b30bbffa57bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:00.468978 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73433e7b-3ac3-46cb-8167-b30bbffa57bc None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:00.469903 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73433e7b-3ac3-46cb-8167-b30bbffa57bc None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:00.470335 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73433e7b-3ac3-46cb-8167-b30bbffa57bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:00.486900 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73433e7b-3ac3-46cb-8167-b30bbffa57bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:30:00.495393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-73433e7b-3ac3-46cb-8167-b30bbffa57bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:30:00.495393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:00.495393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:00.495393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:00.495393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:00.495393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:00.495393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:00.495393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:00.495393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:00.495393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:00.495393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:00.495393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:00.495393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:30:00.495393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:30:00.495393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:30:00.495393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:30:00.496637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:30:00.496637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:30:00.496637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:30:00.496637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:30:00.496637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:00.496637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:00.496637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:00.496637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:00.496637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:00.496637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:00.496637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:00.496637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:00.496637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:00.496637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:00.496637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:00.496637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:00.497599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:00.497599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:00.497599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:00.497599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:00.497599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:30:00.497599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:30:00.497599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:30:00.497599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:30:00.497599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:30:00.497599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:30:00.497599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:30:00.497599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:00.507725 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 369/729] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:30:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:00.509424 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18f6d8-bb66-4991-a6f5-f5f8ea40e911 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:00.509964 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18f6d8-bb66-4991-a6f5-f5f8ea40e911 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:00.510469 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18f6d8-bb66-4991-a6f5-f5f8ea40e911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:00.530353 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-bc18f6d8-bb66-4991-a6f5-f5f8ea40e911 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:00.531929 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-bc18f6d8-bb66-4991-a6f5-f5f8ea40e911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:00.539070 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b66dd-8b31-48a2-8853-5bf4e52db66a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:00.560528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:00.584222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817b62c-a487-4167-b6c8-aa3a5e2f20a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:00.585118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817b62c-a487-4167-b6c8-aa3a5e2f20a9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:00.585458 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817b62c-a487-4167-b6c8-aa3a5e2f20a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:00.585650 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817b62c-a487-4167-b6c8-aa3a5e2f20a9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:00.594456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817b62c-a487-4167-b6c8-aa3a5e2f20a9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:00.596809 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7817b62c-a487-4167-b6c8-aa3a5e2f20a9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:00.617327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 370/730] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:30:00.617523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-7817b62c-a487-4167-b6c8-aa3a5e2f20a9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:30:00.617523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:00.617523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:00.617523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:00.617523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:00.617523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:00.617523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:00.617523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:00.617523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:00.617523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:00.617523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:00.617523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:00.617523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:30:00.617523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:30:00.617523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:30:00.617523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:30:00.619240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:00.619240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:00.619240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:30:00.619240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:00.619240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:30:00.619240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:00.619240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:00.619240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:00.619240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:00.619240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:00.619240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:00.619240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:00.619240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:00.619240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:00.619240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:00.619240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:00.619240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:00.619240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:00.620492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:00.620492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:00.620492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:30:00.620492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:30:00.620492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:30:00.620492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:30:00.620492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:30:00.620492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:30:00.620492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:30:00.620492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:00.625489 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18f6d8-bb66-4991-a6f5-f5f8ea40e911 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:00.631037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 361/731] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:30:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:00.631037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1a287-9ebd-4984-9909-4f9d8264e5ac None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:00.631037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1a287-9ebd-4984-9909-4f9d8264e5ac None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:00.631037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1a287-9ebd-4984-9909-4f9d8264e5ac None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:00.631037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 362/732] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:00.631037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1a287-9ebd-4984-9909-4f9d8264e5ac None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:00.632467 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:00.736604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18f6d8-bb66-4991-a6f5-f5f8ea40e911 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:00.753263 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1a287-9ebd-4984-9909-4f9d8264e5ac None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:00.775321 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e63f7e-4648-44cd-baa5-5fefee3be734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:00.776012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e63f7e-4648-44cd-baa5-5fefee3be734 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:00.776297 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e63f7e-4648-44cd-baa5-5fefee3be734 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:00.776576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e63f7e-4648-44cd-baa5-5fefee3be734 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:00.777376 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e63f7e-4648-44cd-baa5-5fefee3be734 None admin] RBAC: Adding query filter params (name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:00.777718 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e63f7e-4648-44cd-baa5-5fefee3be734 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:00.779130 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e63f7e-4648-44cd-baa5-5fefee3be734 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:00.787984 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 371/733] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 16:30:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:00.789349 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d6160-f130-481f-a76b-67d635887def None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:00.789643 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d6160-f130-481f-a76b-67d635887def None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:00.789923 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d6160-f130-481f-a76b-67d635887def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:00.798108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27080f71-3fd3-44d4-a50b-07ab9263aa11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:00.799063 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27080f71-3fd3-44d4-a50b-07ab9263aa11 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:00.799565 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27080f71-3fd3-44d4-a50b-07ab9263aa11 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:00.800095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27080f71-3fd3-44d4-a50b-07ab9263aa11 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:00.801356 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27080f71-3fd3-44d4-a50b-07ab9263aa11 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:00.801673 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27080f71-3fd3-44d4-a50b-07ab9263aa11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:00.803178 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27080f71-3fd3-44d4-a50b-07ab9263aa11 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:00.806515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-f92d6160-f130-481f-a76b-67d635887def None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:00.807695 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f92d6160-f130-481f-a76b-67d635887def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:00.828612 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 363/734] 10.222.0.76 () {56 vars in 1135 bytes} [Mon Jul 18 16:30:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:00.828612 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27080f71-3fd3-44d4-a50b-07ab9263aa11 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:00.861518 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:00.878102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:00.893037 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 372/735] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:30:00.893037 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d6160-f130-481f-a76b-67d635887def None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:00.951518 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27080f71-3fd3-44d4-a50b-07ab9263aa11 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:00.990509 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b02b9-3901-42d1-bba0-f36bd450652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:00.991552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b02b9-3901-42d1-bba0-f36bd450652c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:00.992005 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b02b9-3901-42d1-bba0-f36bd450652c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:00.992423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b02b9-3901-42d1-bba0-f36bd450652c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:00.998479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d6160-f130-481f-a76b-67d635887def None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:01.005097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b02b9-3901-42d1-bba0-f36bd450652c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:30:01.013273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-d29b02b9-3901-42d1-bba0-f36bd450652c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:30:01.013273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:01.013273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:01.013273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:01.013273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:01.013273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:01.013273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:01.013273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:01.013273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:01.013273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:01.013273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:01.013273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:01.013273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:30:01.013273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:30:01.013273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:30:01.013273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:30:01.014245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:30:01.014245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:30:01.014245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:30:01.014245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:30:01.014245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:01.014245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:01.014245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:01.014245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:01.014245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:01.014245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:01.014245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:01.014245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:01.014245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:01.014245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:01.014245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:01.014245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:01.015519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:01.015519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:01.015519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:01.015519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:01.015519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:30:01.015519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:30:01.015519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:30:01.015519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:30:01.015519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:30:01.015519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:30:01.015519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:30:01.015519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:01.015519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 364/736] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:30:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:01.016323 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b02b9-3901-42d1-bba0-f36bd450652c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:01.041286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072bea6-b3ac-4a53-acba-03200c4af357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:01.042006 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072bea6-b3ac-4a53-acba-03200c4af357 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:01.042287 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072bea6-b3ac-4a53-acba-03200c4af357 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:01.042848 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7072bea6-b3ac-4a53-acba-03200c4af357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:01.053888 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072bea6-b3ac-4a53-acba-03200c4af357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:01.055395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7072bea6-b3ac-4a53-acba-03200c4af357 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:01.075751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-7072bea6-b3ac-4a53-acba-03200c4af357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:01.075751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:01.075751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:01.075751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:01.075751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:01.075751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:01.075751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:01.075751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:01.075751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:01.075751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:01.075751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:01.075751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:01.075751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:01.075751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:01.075751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:01.076905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:01.076905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:01.076905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:01.076905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:01.076905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:01.076905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:01.076905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:01.076905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:01.076905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:01.076905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:01.076905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:01.076905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:01.076905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:01.076905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:01.076905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:01.076905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:01.076905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:01.077945 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:01.077945 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:01.077945 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:01.077945 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:01.081734 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 373/737] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:01.082623 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072bea6-b3ac-4a53-acba-03200c4af357 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:01.120574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:01.130933 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b02b9-3901-42d1-bba0-f36bd450652c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:01.140294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:01.178414 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3f9a7-1b21-41e1-b293-2370450f2466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:01.179073 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3f9a7-1b21-41e1-b293-2370450f2466 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:01.179406 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3f9a7-1b21-41e1-b293-2370450f2466 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:01.179683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd3f9a7-1b21-41e1-b293-2370450f2466 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:01.197728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7072bea6-b3ac-4a53-acba-03200c4af357 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:01.233714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a793b02-92bf-42f6-9065-c1e3f6d0152c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:01.234397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a793b02-92bf-42f6-9065-c1e3f6d0152c None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:01.234683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a793b02-92bf-42f6-9065-c1e3f6d0152c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:01.234959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a793b02-92bf-42f6-9065-c1e3f6d0152c None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:01.235793 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a793b02-92bf-42f6-9065-c1e3f6d0152c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:01.237210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a793b02-92bf-42f6-9065-c1e3f6d0152c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:01.256492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3f9a7-1b21-41e1-b293-2370450f2466 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:01.257976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd3f9a7-1b21-41e1-b293-2370450f2466 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:01.345291 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:01.354658 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 365/738] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:30:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 18 16:30:01.355472 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3f9a7-1b21-41e1-b293-2370450f2466 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:01.363829 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 374/739] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 16:30:01 2022] POST /identity/v3/services => generated 251 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:30:01.365570 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a793b02-92bf-42f6-9065-c1e3f6d0152c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:01.472244 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd3f9a7-1b21-41e1-b293-2370450f2466 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:01.513633 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a793b02-92bf-42f6-9065-c1e3f6d0152c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:01.514264 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fcf373-a049-4a29-ba67-77686162a530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:01.516886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcf373-a049-4a29-ba67-77686162a530 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:01.516886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcf373-a049-4a29-ba67-77686162a530 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:01.516886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fcf373-a049-4a29-ba67-77686162a530 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:01.516886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fcf373-a049-4a29-ba67-77686162a530 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:01.516886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fcf373-a049-4a29-ba67-77686162a530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:01.518025 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fcf373-a049-4a29-ba67-77686162a530 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:01.522718 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:01.527210 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 366/740] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:30:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:01.529169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637ad20-00ff-4199-9176-271508d3ad86 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:01.531612 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637ad20-00ff-4199-9176-271508d3ad86 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:01.531612 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6637ad20-00ff-4199-9176-271508d3ad86 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:01.531612 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 367/741] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:01.532216 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637ad20-00ff-4199-9176-271508d3ad86 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:01.562880 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3dddab-61eb-4b94-8d8c-17928548ae58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:01.563561 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3dddab-61eb-4b94-8d8c-17928548ae58 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:01.563848 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3dddab-61eb-4b94-8d8c-17928548ae58 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:01.564481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3dddab-61eb-4b94-8d8c-17928548ae58 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:01.564852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3dddab-61eb-4b94-8d8c-17928548ae58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:01.565215 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3dddab-61eb-4b94-8d8c-17928548ae58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:01.566620 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3dddab-61eb-4b94-8d8c-17928548ae58 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:01.579056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 375/742] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:01.581160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3dddab-61eb-4b94-8d8c-17928548ae58 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:01.592778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:01.650333 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6637ad20-00ff-4199-9176-271508d3ad86 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:01.688612 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350fdea6-5c51-4d6f-a5bf-db12fccae1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:01.689449 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fdea6-5c51-4d6f-a5bf-db12fccae1ef None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:01.689745 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fdea6-5c51-4d6f-a5bf-db12fccae1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:01.691984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350fdea6-5c51-4d6f-a5bf-db12fccae1ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:01.692096 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3dddab-61eb-4b94-8d8c-17928548ae58 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:01.701429 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fdea6-5c51-4d6f-a5bf-db12fccae1ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:01.702911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350fdea6-5c51-4d6f-a5bf-db12fccae1ef None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:01.720990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-350fdea6-5c51-4d6f-a5bf-db12fccae1ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:01.720990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:01.720990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:01.720990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:01.720990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:01.720990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:01.720990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:01.720990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:01.720990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:01.720990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:01.720990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:01.720990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:01.720990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:01.720990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:01.720990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:01.722167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:01.722167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:01.722167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:01.722167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:01.722167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:01.722167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:01.722167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:01.722167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:01.722167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:01.722167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:01.722167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:01.722167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:01.722167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:01.722167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:01.722167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:01.722167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:01.722167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:01.723297 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:01.723297 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:01.723297 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:01.723297 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:01.726853 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 368/743] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:01.728026 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b47928-6abb-49b1-ada0-8cec4f4cfc25 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:01.728323 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b47928-6abb-49b1-ada0-8cec4f4cfc25 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:01.728604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b47928-6abb-49b1-ada0-8cec4f4cfc25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:01.734415 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8519ac-4e6f-4cbe-b0df-e3e246af2738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:01.735467 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8519ac-4e6f-4cbe-b0df-e3e246af2738 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:01.735756 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8519ac-4e6f-4cbe-b0df-e3e246af2738 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:01.736039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8519ac-4e6f-4cbe-b0df-e3e246af2738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:01.746763 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a0b47928-6abb-49b1-ada0-8cec4f4cfc25 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:01.748065 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a0b47928-6abb-49b1-ada0-8cec4f4cfc25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:01.748178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8519ac-4e6f-4cbe-b0df-e3e246af2738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:01.749586 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8519ac-4e6f-4cbe-b0df-e3e246af2738 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:01.768205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-8f8519ac-4e6f-4cbe-b0df-e3e246af2738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:01.768205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:01.768205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:01.768205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:01.768205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:01.768205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:01.768205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:01.768205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:01.768205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:01.768205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:01.768205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:01.768205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:01.768205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:01.768205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:01.768205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:01.769238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:01.769238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:01.769238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:01.769238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:01.769238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:01.769238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:01.769238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:01.769238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:01.769238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:01.769238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:01.769238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:01.769238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:01.769238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:01.769238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:01.769238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:01.769238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:01.769238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:01.775228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:01.775228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:01.775228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:01.775228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:01.775228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 376/744] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:01.775228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8519ac-4e6f-4cbe-b0df-e3e246af2738 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:01.798039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:01.829594 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 369/745] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:01 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 18 16:30:01.830444 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b47928-6abb-49b1-ada0-8cec4f4cfc25 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:01.881696 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:01.899332 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8519ac-4e6f-4cbe-b0df-e3e246af2738 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:01.944787 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b102d-b420-4b5d-9492-2a474ea99266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:01.945900 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b102d-b420-4b5d-9492-2a474ea99266 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:01.946189 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b102d-b420-4b5d-9492-2a474ea99266 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:01.946568 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b102d-b420-4b5d-9492-2a474ea99266 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:01.954802 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b102d-b420-4b5d-9492-2a474ea99266 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:01.956323 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757b102d-b420-4b5d-9492-2a474ea99266 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:01.957807 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b47928-6abb-49b1-ada0-8cec4f4cfc25 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:01.971662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-757b102d-b420-4b5d-9492-2a474ea99266 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:30:01.971662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:01.971662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:01.971662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:01.971662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:01.971662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:01.971662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:01.971662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:01.971662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:01.971662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:01.971662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:01.971662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:01.971662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:30:01.971662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:30:01.971662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:30:01.971662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:30:01.972697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:01.972697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:01.972697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:30:01.972697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:01.972697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:30:01.972697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:01.972697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:01.972697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:01.972697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:01.972697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:01.972697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:01.972697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:01.972697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:01.972697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:01.972697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:01.972697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:01.972697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:01.972697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:01.973791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:01.973791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:01.973791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:30:01.973791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:30:01.973791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:30:01.973791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:30:01.973791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:30:01.973791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:30:01.973791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:30:01.973791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:01.977451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 377/746] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Jul 18 16:30:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:01.978266 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b102d-b420-4b5d-9492-2a474ea99266 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:01.998196 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e51b3-4078-4d39-901a-5ef85437cd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:01.998979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e51b3-4078-4d39-901a-5ef85437cd91 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:01.999361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e51b3-4078-4d39-901a-5ef85437cd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:01.999656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e51b3-4078-4d39-901a-5ef85437cd91 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:02.000384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e51b3-4078-4d39-901a-5ef85437cd91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:02.000699 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e51b3-4078-4d39-901a-5ef85437cd91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:02.002113 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e51b3-4078-4d39-901a-5ef85437cd91 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:02.019109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 370/747] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:02.019109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e51b3-4078-4d39-901a-5ef85437cd91 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:02.067611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:02.090426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b102d-b420-4b5d-9492-2a474ea99266 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:02.119158 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:02.128553 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e51b3-4078-4d39-901a-5ef85437cd91 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:02.130087 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5642c-fd0a-4944-87dd-be1e38497e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:02.130764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5642c-fd0a-4944-87dd-be1e38497e87 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:02.131053 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5642c-fd0a-4944-87dd-be1e38497e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:02.131330 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5642c-fd0a-4944-87dd-be1e38497e87 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:02.132063 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5642c-fd0a-4944-87dd-be1e38497e87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:02.132372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5642c-fd0a-4944-87dd-be1e38497e87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:02.133785 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5642c-fd0a-4944-87dd-be1e38497e87 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:02.152951 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 378/748] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:02.154314 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5642c-fd0a-4944-87dd-be1e38497e87 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:02.174507 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62b303-bd78-409c-b676-2b283bf5d757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:02.175196 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62b303-bd78-409c-b676-2b283bf5d757 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:02.175487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62b303-bd78-409c-b676-2b283bf5d757 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:02.175766 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a62b303-bd78-409c-b676-2b283bf5d757 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:02.176506 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62b303-bd78-409c-b676-2b283bf5d757 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:02.178014 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a62b303-bd78-409c-b676-2b283bf5d757 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:02.238926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 371/749] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 16:30:02 2022] POST /identity/v3/services => generated 240 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:30:02.239578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62b303-bd78-409c-b676-2b283bf5d757 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:02.276673 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5642c-fd0a-4944-87dd-be1e38497e87 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:02.339107 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e58e5b-d986-407f-9eba-0ffb1ca0523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:02.339842 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e58e5b-d986-407f-9eba-0ffb1ca0523a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:02.340271 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e58e5b-d986-407f-9eba-0ffb1ca0523a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:02.340544 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e58e5b-d986-407f-9eba-0ffb1ca0523a None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:02.341561 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e58e5b-d986-407f-9eba-0ffb1ca0523a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:02.341871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e58e5b-d986-407f-9eba-0ffb1ca0523a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:02.343344 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e58e5b-d986-407f-9eba-0ffb1ca0523a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:02.346137 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:02.366976 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 379/750] 10.222.0.76 () {56 vars in 1149 bytes} [Mon Jul 18 16:30:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:02.368248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e58e5b-d986-407f-9eba-0ffb1ca0523a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:02.374237 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a62b303-bd78-409c-b676-2b283bf5d757 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:02.413002 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1a8f3-8ac2-450b-873a-b3d48ebb8d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:02.413854 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1a8f3-8ac2-450b-873a-b3d48ebb8d88 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:02.414134 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1a8f3-8ac2-450b-873a-b3d48ebb8d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:02.414410 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1a8f3-8ac2-450b-873a-b3d48ebb8d88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:02.422796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1a8f3-8ac2-450b-873a-b3d48ebb8d88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:02.424272 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1a8f3-8ac2-450b-873a-b3d48ebb8d88 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:02.442878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-36f1a8f3-8ac2-450b-873a-b3d48ebb8d88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:02.442878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:02.442878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:02.442878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:02.442878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:02.442878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:02.442878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:02.442878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:02.442878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:02.442878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:02.442878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:02.442878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:02.442878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:30:02.442878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:30:02.442878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:30:02.444748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:30:02.444748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:02.444748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:02.444748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:02.444748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:02.444748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:02.444748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:02.444748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:02.444748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:02.444748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:02.444748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:02.444748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:02.444748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:02.444748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:02.444748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:02.444748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:02.444748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:02.446049 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:30:02.446049 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:30:02.446049 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:30:02.446049 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:30:02.446049 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:30:02.446049 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:30:02.446049 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:02.446049 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:02.446049 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 372/751] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:30:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:02.446049 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1a8f3-8ac2-450b-873a-b3d48ebb8d88 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:02.471273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:02.501896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e58e5b-d986-407f-9eba-0ffb1ca0523a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:02.549114 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cba7c-3cb8-4110-9222-bba64daa482e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:02.551823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cba7c-3cb8-4110-9222-bba64daa482e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:02.552278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cba7c-3cb8-4110-9222-bba64daa482e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:02.552725 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946cba7c-3cb8-4110-9222-bba64daa482e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:02.564768 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cba7c-3cb8-4110-9222-bba64daa482e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:02.566885 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946cba7c-3cb8-4110-9222-bba64daa482e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:02.576241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1a8f3-8ac2-450b-873a-b3d48ebb8d88 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:02.587778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-946cba7c-3cb8-4110-9222-bba64daa482e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:30:02.587778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:02.587778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:02.587778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:02.587778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:02.587778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:02.587778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:02.587778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:02.587778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:02.587778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:02.587778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:02.587778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:02.587778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:30:02.587778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:30:02.587778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:30:02.587778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:30:02.588972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:02.588972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:02.588972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:30:02.588972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:02.588972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:30:02.588972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:02.588972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:02.588972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:02.588972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:02.588972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:02.588972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:02.588972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:02.588972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:02.588972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:02.588972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:02.588972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:02.588972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:02.588972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:02.590835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:02.590835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:02.590835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:30:02.590835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:30:02.590835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:30:02.590835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:30:02.590835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:30:02.590835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:30:02.590835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:30:02.590835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:02.598440 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 380/752] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Jul 18 16:30:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:02.599448 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cba7c-3cb8-4110-9222-bba64daa482e None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:02.625615 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cab409-dfc5-44b0-a661-4f763981050d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:02.627040 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cab409-dfc5-44b0-a661-4f763981050d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:02.627790 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cab409-dfc5-44b0-a661-4f763981050d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:02.628519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cab409-dfc5-44b0-a661-4f763981050d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:02.660868 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:02.711802 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946cba7c-3cb8-4110-9222-bba64daa482e None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:02.719899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cab409-dfc5-44b0-a661-4f763981050d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:02.721846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cab409-dfc5-44b0-a661-4f763981050d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:02.740672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:02.758928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e23dc4-3458-40ce-9ed7-9172913db9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:02.760256 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e23dc4-3458-40ce-9ed7-9172913db9fe None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:02.760817 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e23dc4-3458-40ce-9ed7-9172913db9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:02.761278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e23dc4-3458-40ce-9ed7-9172913db9fe None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:02.762477 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e23dc4-3458-40ce-9ed7-9172913db9fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:02.763278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e23dc4-3458-40ce-9ed7-9172913db9fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:02.765185 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e23dc4-3458-40ce-9ed7-9172913db9fe None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:02.780626 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 381/753] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:30:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:02.781794 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e23dc4-3458-40ce-9ed7-9172913db9fe None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:02.847699 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 373/754] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:30:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:30:02.848755 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cab409-dfc5-44b0-a661-4f763981050d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:02.888017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e23dc4-3458-40ce-9ed7-9172913db9fe None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:02.901715 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:02.924808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1828fb1-7db3-42d1-85c6-f300cdb1b3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:02.925940 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1828fb1-7db3-42d1-85c6-f300cdb1b3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:02.926527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1828fb1-7db3-42d1-85c6-f300cdb1b3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:02.927030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1828fb1-7db3-42d1-85c6-f300cdb1b3d9 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:02.928064 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1828fb1-7db3-42d1-85c6-f300cdb1b3d9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:02.928602 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1828fb1-7db3-42d1-85c6-f300cdb1b3d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:02.930484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1828fb1-7db3-42d1-85c6-f300cdb1b3d9 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:02.950692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 382/755] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Jul 18 16:30:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:02.951964 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1828fb1-7db3-42d1-85c6-f300cdb1b3d9 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:02.969344 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cab409-dfc5-44b0-a661-4f763981050d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:02.984666 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:03.008189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e1514-e44f-45eb-be10-0d0d8251d678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:03.008893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e1514-e44f-45eb-be10-0d0d8251d678 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:03.009287 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e1514-e44f-45eb-be10-0d0d8251d678 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:03.009515 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e1514-e44f-45eb-be10-0d0d8251d678 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:03.010368 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e1514-e44f-45eb-be10-0d0d8251d678 None admin] RBAC: Adding query filter params (role.id=c2d5d80485df4730903a874937d68aa3, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=50bc0fa34b414328a342d685bc1eaca3) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:03.010685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e1514-e44f-45eb-be10-0d0d8251d678 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:03.012394 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e1514-e44f-45eb-be10-0d0d8251d678 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:03.020110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 374/756] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:30:02 2022] GET /identity/v3/role_assignments?user.id=50bc0fa34b414328a342d685bc1eaca3&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=c2d5d80485df4730903a874937d68aa3 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:03.021151 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e1514-e44f-45eb-be10-0d0d8251d678 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:03.067785 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1828fb1-7db3-42d1-85c6-f300cdb1b3d9 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:03.107558 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124efa5-66bc-4b88-8449-bca61226925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:03.108777 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124efa5-66bc-4b88-8449-bca61226925b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:03.109339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124efa5-66bc-4b88-8449-bca61226925b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:03.109822 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124efa5-66bc-4b88-8449-bca61226925b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:03.122288 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124efa5-66bc-4b88-8449-bca61226925b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:03.124233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124efa5-66bc-4b88-8449-bca61226925b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:03.170211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-8124efa5-66bc-4b88-8449-bca61226925b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:03.170211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:03.170211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:03.170211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:03.170211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:03.170211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:03.170211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:03.170211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:03.170211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:03.170211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:03.170211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:03.170211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:03.170211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:03.170211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:03.170211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:03.171255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:03.171255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:03.171255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:03.171255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:03.171255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:03.171255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:03.171255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:03.171255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:03.171255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:03.171255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:03.171255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:03.171255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:03.171255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:03.171255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:03.171255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:03.171255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:03.171255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:03.172168 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:03.172168 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:03.172168 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:03.172168 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:03.172390 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e1514-e44f-45eb-be10-0d0d8251d678 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:03.174866 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 383/757] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:03.180249 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124efa5-66bc-4b88-8449-bca61226925b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:03.211162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf280a5-b3f3-4d11-b4ca-62d2ec617a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:03.212036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf280a5-b3f3-4d11-b4ca-62d2ec617a3e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:03.212322 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf280a5-b3f3-4d11-b4ca-62d2ec617a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:03.212685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf280a5-b3f3-4d11-b4ca-62d2ec617a3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:03.224769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf280a5-b3f3-4d11-b4ca-62d2ec617a3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:03.226444 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf280a5-b3f3-4d11-b4ca-62d2ec617a3e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:03.231107 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:03.248558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-6bf280a5-b3f3-4d11-b4ca-62d2ec617a3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:03.248558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:03.248558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:03.248558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:03.248558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:03.248558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:03.248558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:03.248558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:03.248558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:03.248558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:03.248558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:03.248558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:03.248558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:03.248558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:03.248558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:03.253981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:03.253981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:03.253981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:03.253981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:03.253981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:03.253981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:03.253981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:03.253981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:03.253981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:03.253981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:03.253981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:03.253981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:03.253981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:03.253981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:03.253981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:03.253981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:03.253981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:03.254873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:03.254873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:03.254873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:03.254873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:03.254873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 375/758] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:03.256597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf280a5-b3f3-4d11-b4ca-62d2ec617a3e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:03.301393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:03.378254 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf280a5-b3f3-4d11-b4ca-62d2ec617a3e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:03.394447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124efa5-66bc-4b88-8449-bca61226925b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:03.435398 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7870c5-e0a5-4764-bab3-64c4c53471b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:03.436085 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7870c5-e0a5-4764-bab3-64c4c53471b3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:03.436375 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7870c5-e0a5-4764-bab3-64c4c53471b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:03.436660 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7870c5-e0a5-4764-bab3-64c4c53471b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:03.437436 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7870c5-e0a5-4764-bab3-64c4c53471b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:03.438040 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7870c5-e0a5-4764-bab3-64c4c53471b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:03.439435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7870c5-e0a5-4764-bab3-64c4c53471b3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:03.447666 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d7c08-7fc1-4d4c-aa1d-086457ab48cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:03.448484 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d7c08-7fc1-4d4c-aa1d-086457ab48cf None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:03.448771 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d7c08-7fc1-4d4c-aa1d-086457ab48cf None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:03.449069 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d7c08-7fc1-4d4c-aa1d-086457ab48cf None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:03.449832 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d7c08-7fc1-4d4c-aa1d-086457ab48cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:03.450138 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d7c08-7fc1-4d4c-aa1d-086457ab48cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:03.451528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d7c08-7fc1-4d4c-aa1d-086457ab48cf None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:03.452121 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 384/759] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:03.462032 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7870c5-e0a5-4764-bab3-64c4c53471b3 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:03.467311 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 376/760] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:03.484592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d7c08-7fc1-4d4c-aa1d-086457ab48cf None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:03.572804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:03.603865 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7870c5-e0a5-4764-bab3-64c4c53471b3 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:03.626091 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:03.639287 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d7c08-7fc1-4d4c-aa1d-086457ab48cf None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:03.645520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042d64a-9e01-4df3-b1fc-3c4fa8b72d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:03.646335 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042d64a-9e01-4df3-b1fc-3c4fa8b72d23 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:03.646625 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042d64a-9e01-4df3-b1fc-3c4fa8b72d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:03.646904 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042d64a-9e01-4df3-b1fc-3c4fa8b72d23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:03.654949 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042d64a-9e01-4df3-b1fc-3c4fa8b72d23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:03.656409 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042d64a-9e01-4df3-b1fc-3c4fa8b72d23 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:03.672509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-0042d64a-9e01-4df3-b1fc-3c4fa8b72d23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:03.672509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:03.672509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:03.672509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:03.672509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:03.672509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:03.672509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:03.672509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:03.672509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:03.672509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:03.672509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:03.672509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:03.672509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:30:03.672509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:30:03.672509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:30:03.673521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:30:03.673521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:03.673521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:03.673521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:03.673521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:03.673521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:03.673521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:03.673521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:03.673521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:03.673521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:03.673521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:03.673521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:03.673521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:03.673521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:03.673521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:03.673521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:03.673521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:03.674435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:30:03.674435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:30:03.674435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:30:03.674435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:30:03.674435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:30:03.674435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:30:03.674435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:03.674435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:03.679269 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 385/761] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:30:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:03.680699 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1dc19-b943-4440-a793-94150553f315 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:03.680993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1dc19-b943-4440-a793-94150553f315 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:03.681306 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1dc19-b943-4440-a793-94150553f315 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:03.681458 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333399da-f351-4749-9089-004933a64006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:03.682317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333399da-f351-4749-9089-004933a64006 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:03.682668 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333399da-f351-4749-9089-004933a64006 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:03.683017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333399da-f351-4749-9089-004933a64006 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:03.684205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 386/762] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:03.684921 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1dc19-b943-4440-a793-94150553f315 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:03.691051 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333399da-f351-4749-9089-004933a64006 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:03.692735 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333399da-f351-4749-9089-004933a64006 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:03.708366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-333399da-f351-4749-9089-004933a64006 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:03.708366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:03.708366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:03.708366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:03.708366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:03.708366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:03.708366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:03.708366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:03.708366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:03.708366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:03.708366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:03.708366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:03.708366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:30:03.708366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:30:03.708366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:30:03.710502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:30:03.710502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:03.710502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:03.710502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:03.710502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:03.710502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:03.710502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:03.710502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:03.710502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:03.710502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:03.710502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:03.710502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:03.710502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:03.710502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:03.710502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:03.710502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:03.710502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:03.712719 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:30:03.712719 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:30:03.712719 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:30:03.712719 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:30:03.712719 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:30:03.712719 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:30:03.712719 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:03.712719 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:03.721032 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 377/763] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:30:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:03.721032 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67194f4a-fdd0-412b-adb1-d9a7d7b15656 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:03.721032 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67194f4a-fdd0-412b-adb1-d9a7d7b15656 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:03.721032 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67194f4a-fdd0-412b-adb1-d9a7d7b15656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:03.737229 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-67194f4a-fdd0-412b-adb1-d9a7d7b15656 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:03.738473 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-67194f4a-fdd0-412b-adb1-d9a7d7b15656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:03.812782 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1dc19-b943-4440-a793-94150553f315 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:03.818214 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 378/764] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:03.818214 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67194f4a-fdd0-412b-adb1-d9a7d7b15656 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:03.875181 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36086dad-ae70-41c9-be75-a7221f7e2b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:03.876511 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36086dad-ae70-41c9-be75-a7221f7e2b89 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:03.877393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36086dad-ae70-41c9-be75-a7221f7e2b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:03.877681 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36086dad-ae70-41c9-be75-a7221f7e2b89 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:03.878489 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36086dad-ae70-41c9-be75-a7221f7e2b89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:03.878806 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36086dad-ae70-41c9-be75-a7221f7e2b89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:03.880274 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36086dad-ae70-41c9-be75-a7221f7e2b89 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:03.897851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 387/765] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:30:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:03.897851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36086dad-ae70-41c9-be75-a7221f7e2b89 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:03.901901 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:03.932697 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:03.965431 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67194f4a-fdd0-412b-adb1-d9a7d7b15656 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:04.013603 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36086dad-ae70-41c9-be75-a7221f7e2b89 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:04.020344 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae562db-b98a-4059-90b8-2e18e80b95c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:04.021833 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae562db-b98a-4059-90b8-2e18e80b95c9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:04.022278 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae562db-b98a-4059-90b8-2e18e80b95c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:04.022700 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae562db-b98a-4059-90b8-2e18e80b95c9 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:04.024080 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae562db-b98a-4059-90b8-2e18e80b95c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:04.024570 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae562db-b98a-4059-90b8-2e18e80b95c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:04.026980 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae562db-b98a-4059-90b8-2e18e80b95c9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:04.045187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 379/766] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:30:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:04.046341 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae562db-b98a-4059-90b8-2e18e80b95c9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:04.056912 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44eb65d-59d8-4ff3-9c74-24d37967dab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:04.057875 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44eb65d-59d8-4ff3-9c74-24d37967dab2 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:04.058260 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44eb65d-59d8-4ff3-9c74-24d37967dab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:04.058669 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44eb65d-59d8-4ff3-9c74-24d37967dab2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:04.059729 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44eb65d-59d8-4ff3-9c74-24d37967dab2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:04.061106 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44eb65d-59d8-4ff3-9c74-24d37967dab2 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:04.076882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-e44eb65d-59d8-4ff3-9c74-24d37967dab2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 16:30:04.076882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:04.076882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:30:04.076882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:30:04.076882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:30:04.076882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:30:04.076882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:30:04.076882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:04.076882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 16:30:04.076882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:04.076882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:04.076882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:04.076882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:04.076882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:04.076882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:04.076882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:04.078030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:04.078030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:04.078030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:04.078030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:04.078030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:04.078030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:04.078030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:04.078030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:30:04.078030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:30:04.078030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:30:04.078030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:30:04.078030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:04.078030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:04.078030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:04.078030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:04.078030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:04.079102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:04.079102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:04.079102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:04.079102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:04.079102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:04.079102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:04.079102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:04.079102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:04.079102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:04.079102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:04.079102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:04.079102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:30:04.079102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:04.079102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 16:30:04.079102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:04.085925 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 388/767] 10.222.0.76 () {56 vars in 1129 bytes} [Mon Jul 18 16:30:03 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:04.085925 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44eb65d-59d8-4ff3-9c74-24d37967dab2 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:04.159579 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:04.191818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae562db-b98a-4059-90b8-2e18e80b95c9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:04.207686 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44eb65d-59d8-4ff3-9c74-24d37967dab2 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:04.232129 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560864b-9885-4019-8073-ccf21f8f959c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:04.233315 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560864b-9885-4019-8073-ccf21f8f959c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:04.233875 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560864b-9885-4019-8073-ccf21f8f959c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:04.234387 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f560864b-9885-4019-8073-ccf21f8f959c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:04.235549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560864b-9885-4019-8073-ccf21f8f959c None admin] RBAC: Adding query filter params (role.id=ce6bff4fd8b6468b94dc4af858dde77b, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=ff65e481807b4344897b1499cd450f9d) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:04.236091 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560864b-9885-4019-8073-ccf21f8f959c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:04.237834 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f560864b-9885-4019-8073-ccf21f8f959c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:04.244293 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912a63d-9716-4163-806d-7258ffbf501f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:04.253055 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912a63d-9716-4163-806d-7258ffbf501f None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:04.253055 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912a63d-9716-4163-806d-7258ffbf501f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:04.253055 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912a63d-9716-4163-806d-7258ffbf501f None admin] PATH_INFO: `/v3/projects/30a4824228ec47519a01574d82879b25/users/381cf4381ce64379b285d75e2909813d/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:04.253055 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912a63d-9716-4163-806d-7258ffbf501f None admin] RBAC: Authorizing `identity:create_grant(project_id=30a4824228ec47519a01574d82879b25, user_id=381cf4381ce64379b285d75e2909813d, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:04.253055 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6912a63d-9716-4163-806d-7258ffbf501f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:04.254314 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 380/768] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:30:04 2022] GET /identity/v3/role_assignments?user.id=ff65e481807b4344897b1499cd450f9d&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=ce6bff4fd8b6468b94dc4af858dde77b => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:04.255603 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560864b-9885-4019-8073-ccf21f8f959c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:04.259484 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:04.382880 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f560864b-9885-4019-8073-ccf21f8f959c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:04.423170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc79cbb-3c02-463d-b924-cceba85d29ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:04.424271 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc79cbb-3c02-463d-b924-cceba85d29ed None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:04.424771 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc79cbb-3c02-463d-b924-cceba85d29ed None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:04.425438 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc79cbb-3c02-463d-b924-cceba85d29ed None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:04.426481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc79cbb-3c02-463d-b924-cceba85d29ed None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:04.427041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc79cbb-3c02-463d-b924-cceba85d29ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:04.428741 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc79cbb-3c02-463d-b924-cceba85d29ed None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:04.435579 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 381/769] 10.222.0.76 () {56 vars in 1124 bytes} [Mon Jul 18 16:30:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:04.442034 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc79cbb-3c02-463d-b924-cceba85d29ed None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:04.547974 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc79cbb-3c02-463d-b924-cceba85d29ed None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:04.582291 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29fb212-40ca-4d31-9365-b271643df1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:04.582964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fb212-40ca-4d31-9365-b271643df1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:04.583255 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fb212-40ca-4d31-9365-b271643df1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:04.583535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29fb212-40ca-4d31-9365-b271643df1d3 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:04.584250 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fb212-40ca-4d31-9365-b271643df1d3 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:04.584561 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fb212-40ca-4d31-9365-b271643df1d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:04.585972 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29fb212-40ca-4d31-9365-b271643df1d3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:04.591423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 382/770] 10.222.0.76 () {56 vars in 1124 bytes} [Mon Jul 18 16:30:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:04.592755 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df294411-6ad3-492f-a439-bf4725dc8108 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:04.593067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df294411-6ad3-492f-a439-bf4725dc8108 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:04.593353 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df294411-6ad3-492f-a439-bf4725dc8108 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:04.597626 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 383/771] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:04.598674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df294411-6ad3-492f-a439-bf4725dc8108 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:04.644601 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 389/772] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:30:04 2022] PUT /identity/v3/projects/30a4824228ec47519a01574d82879b25/users/381cf4381ce64379b285d75e2909813d/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:30:04.646107 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9b3c0-2ba4-4aee-bddc-57249d473c95 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:04.646404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9b3c0-2ba4-4aee-bddc-57249d473c95 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:04.646689 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9b3c0-2ba4-4aee-bddc-57249d473c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:04.667016 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:04.677717 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-0cb9b3c0-2ba4-4aee-bddc-57249d473c95 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:04.680640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0cb9b3c0-2ba4-4aee-bddc-57249d473c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:04.777039 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df294411-6ad3-492f-a439-bf4725dc8108 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:04.833292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:04.838318 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 390/773] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:04.843116 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19ae1a-46b4-413f-af1c-065aa38cf4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:04.843797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19ae1a-46b4-413f-af1c-065aa38cf4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:04.844087 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19ae1a-46b4-413f-af1c-065aa38cf4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:04.844374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19ae1a-46b4-413f-af1c-065aa38cf4f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:04.845214 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19ae1a-46b4-413f-af1c-065aa38cf4f3 None admin] RBAC: Adding query filter params (interface=public, service_id=9e4d7a89a14542fcb10a407492bf3993, region_id=RegionOne) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:04.845538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19ae1a-46b4-413f-af1c-065aa38cf4f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:04.847095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19ae1a-46b4-413f-af1c-065aa38cf4f3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:04.861245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 384/774] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Jul 18 16:30:04 2022] GET /identity/v3/endpoints?service_id=9e4d7a89a14542fcb10a407492bf3993&interface=public®ion_id=RegionOne => generated 194 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:04.862650 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9b3c0-2ba4-4aee-bddc-57249d473c95 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:04.870357 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19ae1a-46b4-413f-af1c-065aa38cf4f3 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:04.929450 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:04.978477 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9b3c0-2ba4-4aee-bddc-57249d473c95 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:05.016936 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19ae1a-46b4-413f-af1c-065aa38cf4f3 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:05.017184 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8e0e6-5b94-4fca-8304-8c12129799d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:05.017673 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8e0e6-5b94-4fca-8304-8c12129799d6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:05.017961 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8e0e6-5b94-4fca-8304-8c12129799d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:05.018405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8e0e6-5b94-4fca-8304-8c12129799d6 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:05.019101 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8e0e6-5b94-4fca-8304-8c12129799d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:05.020488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8e0e6-5b94-4fca-8304-8c12129799d6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:05.026380 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 391/775] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Jul 18 16:30:04 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:05.057765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa24f8-0695-48e2-99d4-f002549f5c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:05.060009 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa24f8-0695-48e2-99d4-f002549f5c3a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:05.060547 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa24f8-0695-48e2-99d4-f002549f5c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:05.060977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa24f8-0695-48e2-99d4-f002549f5c3a None admin] PATH_INFO: `/v3/services/network` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:05.061866 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa24f8-0695-48e2-99d4-f002549f5c3a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:05.063458 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa24f8-0695-48e2-99d4-f002549f5c3a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:05.078849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-68fa24f8-0695-48e2-99d4-f002549f5c3a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 16:30:05.078849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:05.078849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:30:05.078849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:30:05.078849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:30:05.078849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:30:05.078849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:30:05.078849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:05.078849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 16:30:05.078849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:05.078849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:05.078849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:05.078849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:05.078849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:05.078849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:05.078849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:05.078849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:05.081127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:05.081127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:05.081127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:05.081127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:05.081127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:05.081127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:05.081127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:30:05.081127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:30:05.081127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:30:05.081127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:30:05.081127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:05.081127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:05.081127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:05.081127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:05.081127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:05.081127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:05.082686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:05.082686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:05.082686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:05.082686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:05.082686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:05.082686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:05.082686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:05.082686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:05.082686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:05.082686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:05.082686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:30:05.082686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:05.082686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 16:30:05.082686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:05.086039 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 385/776] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:30:04 2022] GET /identity/v3/services/network => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:05.092527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8e0e6-5b94-4fca-8304-8c12129799d6 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:05.268326 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8e0e6-5b94-4fca-8304-8c12129799d6 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:05.304747 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:05.326785 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc57fc-b205-4f6c-b9fe-fcf17e888bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:05.327751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc57fc-b205-4f6c-b9fe-fcf17e888bfd None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:05.328070 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc57fc-b205-4f6c-b9fe-fcf17e888bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:05.328354 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc57fc-b205-4f6c-b9fe-fcf17e888bfd None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:05.329172 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc57fc-b205-4f6c-b9fe-fcf17e888bfd None admin] RBAC: Adding query filter params (name=network) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:05.329488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc57fc-b205-4f6c-b9fe-fcf17e888bfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:05.330893 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc57fc-b205-4f6c-b9fe-fcf17e888bfd None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:05.337812 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 392/777] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 16:30:05 2022] GET /identity/v3/services?name=network => generated 124 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:05.344037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa24f8-0695-48e2-99d4-f002549f5c3a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:05.389980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfdcc0-d12d-4dfb-8057-e64018494451 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:05.390365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfdcc0-d12d-4dfb-8057-e64018494451 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:05.390617 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfdcc0-d12d-4dfb-8057-e64018494451 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:05.392214 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 393/778] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:30:05.397722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbab01-f4e1-4329-ae70-c93f150c1cda None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:05.398021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbab01-f4e1-4329-ae70-c93f150c1cda None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:05.398297 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbbab01-f4e1-4329-ae70-c93f150c1cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:05.419091 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-7cbbab01-f4e1-4329-ae70-c93f150c1cda None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:05.420849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7cbbab01-f4e1-4329-ae70-c93f150c1cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:05.422583 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:05.484452 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa24f8-0695-48e2-99d4-f002549f5c3a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:05.535915 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 394/779] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:05.545361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62c1a0-4461-4302-8a6e-b30b7d9a8ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:05.546050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62c1a0-4461-4302-8a6e-b30b7d9a8ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:05.546338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62c1a0-4461-4302-8a6e-b30b7d9a8ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:05.546616 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62c1a0-4461-4302-8a6e-b30b7d9a8ff6 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:05.547352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62c1a0-4461-4302-8a6e-b30b7d9a8ff6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:05.547660 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62c1a0-4461-4302-8a6e-b30b7d9a8ff6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:05.549072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62c1a0-4461-4302-8a6e-b30b7d9a8ff6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:05.557525 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 386/780] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 16:30:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:05.563028 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbab01-f4e1-4329-ae70-c93f150c1cda None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:05.583182 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62c1a0-4461-4302-8a6e-b30b7d9a8ff6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:05.756899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62c1a0-4461-4302-8a6e-b30b7d9a8ff6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:05.767886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbbab01-f4e1-4329-ae70-c93f150c1cda None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:05.783412 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:05.799956 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d231b7-ae9a-4f2a-8420-d11d2287ec32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:05.800689 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d231b7-ae9a-4f2a-8420-d11d2287ec32 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:05.800976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d231b7-ae9a-4f2a-8420-d11d2287ec32 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:05.801333 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d231b7-ae9a-4f2a-8420-d11d2287ec32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:05.802043 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:05.818940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d231b7-ae9a-4f2a-8420-d11d2287ec32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:30:05.824560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-a2d231b7-ae9a-4f2a-8420-d11d2287ec32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:30:05.824560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:05.824560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:05.824560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:05.824560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:05.824560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:05.824560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:05.824560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:05.824560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:05.824560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:05.824560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:05.824560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:05.824560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:30:05.824560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:30:05.824560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:30:05.824560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:30:05.825737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:30:05.825737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:30:05.825737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:30:05.825737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:30:05.825737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:05.825737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:05.825737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:05.825737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:05.825737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:05.825737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:05.825737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:05.825737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:05.825737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:05.825737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:05.825737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:05.825737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:05.830826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:05.830826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:05.830826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:05.830826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:05.830826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:30:05.830826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:30:05.830826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:30:05.830826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:30:05.830826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:30:05.830826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:30:05.830826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:30:05.830826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:05.830826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 387/781] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:30:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:05.831756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d231b7-ae9a-4f2a-8420-d11d2287ec32 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:05.847164 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edceba-f4ac-4aea-b247-3f32c200b262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:05.847875 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edceba-f4ac-4aea-b247-3f32c200b262 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:05.848157 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edceba-f4ac-4aea-b247-3f32c200b262 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:05.848484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edceba-f4ac-4aea-b247-3f32c200b262 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:05.849323 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edceba-f4ac-4aea-b247-3f32c200b262 None admin] RBAC: Adding query filter params (interface=public, service_id=74b7c9af7b7c48ca94ad3aa199c42a30, region_id=RegionOne) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:05.849631 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edceba-f4ac-4aea-b247-3f32c200b262 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:05.851019 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edceba-f4ac-4aea-b247-3f32c200b262 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:05.861455 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 395/782] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Jul 18 16:30:05 2022] GET /identity/v3/endpoints?service_id=74b7c9af7b7c48ca94ad3aa199c42a30&interface=public®ion_id=RegionOne => generated 194 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:05.866801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edceba-f4ac-4aea-b247-3f32c200b262 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:06.002634 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d231b7-ae9a-4f2a-8420-d11d2287ec32 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:06.031325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edceba-f4ac-4aea-b247-3f32c200b262 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:06.040548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a214b8f-3e87-49f1-ab33-0c2881633abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:06.041609 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a214b8f-3e87-49f1-ab33-0c2881633abd None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:06.042114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a214b8f-3e87-49f1-ab33-0c2881633abd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:06.042647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a214b8f-3e87-49f1-ab33-0c2881633abd None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:06.043740 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a214b8f-3e87-49f1-ab33-0c2881633abd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:06.044340 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a214b8f-3e87-49f1-ab33-0c2881633abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:06.046077 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a214b8f-3e87-49f1-ab33-0c2881633abd None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:06.060426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 388/783] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:30:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:06.067006 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a214b8f-3e87-49f1-ab33-0c2881633abd None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:06.114040 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7de8a-5401-4e56-9b8c-288fc8973f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:06.114730 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7de8a-5401-4e56-9b8c-288fc8973f65 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:06.115016 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7de8a-5401-4e56-9b8c-288fc8973f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:06.115297 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7de8a-5401-4e56-9b8c-288fc8973f65 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:06.116071 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7de8a-5401-4e56-9b8c-288fc8973f65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:06.117395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7de8a-5401-4e56-9b8c-288fc8973f65 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:06.133243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 396/784] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Jul 18 16:30:05 2022] GET /identity/v3/services => generated 772 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:06.142428 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:06.211442 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a214b8f-3e87-49f1-ab33-0c2881633abd None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:06.275278 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38871644-41b7-449f-babe-1260d4ec463d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:06.276600 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38871644-41b7-449f-babe-1260d4ec463d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:06.277205 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38871644-41b7-449f-babe-1260d4ec463d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:06.277707 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38871644-41b7-449f-babe-1260d4ec463d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:06.298453 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38871644-41b7-449f-babe-1260d4ec463d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:06.300298 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38871644-41b7-449f-babe-1260d4ec463d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:06.332479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-38871644-41b7-449f-babe-1260d4ec463d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:06.332479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:06.332479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:06.332479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:06.332479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:06.332479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:06.332479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:06.332479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:06.332479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:06.332479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:06.332479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:06.332479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:06.332479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:06.332479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:06.332479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:06.333487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:06.333487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:06.333487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:06.333487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:06.333487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:06.333487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:06.333487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:06.333487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:06.333487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:06.333487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:06.333487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:06.333487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:06.333487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:06.333487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:06.333487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:06.333487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:06.333487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:06.334387 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:06.334387 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:06.334387 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:06.334387 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:06.336757 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 389/785] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:06.342868 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7de8a-5401-4e56-9b8c-288fc8973f65 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:06.399965 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:06.466670 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7de8a-5401-4e56-9b8c-288fc8973f65 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:06.506078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f8b65-fb88-4dcd-beb8-a5fc5dad9be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:06.506760 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f8b65-fb88-4dcd-beb8-a5fc5dad9be9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:06.507049 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f8b65-fb88-4dcd-beb8-a5fc5dad9be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:06.507334 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f8b65-fb88-4dcd-beb8-a5fc5dad9be9 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:06.508066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f8b65-fb88-4dcd-beb8-a5fc5dad9be9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:06.508375 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f8b65-fb88-4dcd-beb8-a5fc5dad9be9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:06.518028 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f8b65-fb88-4dcd-beb8-a5fc5dad9be9 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:06.532214 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 397/786] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:06.538446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38871644-41b7-449f-babe-1260d4ec463d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:06.701048 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:06.712851 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38871644-41b7-449f-babe-1260d4ec463d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:06.767604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf20765-0788-4deb-b13c-e1a67d1f45fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:06.768410 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf20765-0788-4deb-b13c-e1a67d1f45fe None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:06.768696 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf20765-0788-4deb-b13c-e1a67d1f45fe None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:06.768973 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf20765-0788-4deb-b13c-e1a67d1f45fe None admin] PATH_INFO: `/v3/users/swift` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:06.781925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf20765-0788-4deb-b13c-e1a67d1f45fe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:06.783411 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf20765-0788-4deb-b13c-e1a67d1f45fe None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:06.801416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-bbf20765-0788-4deb-b13c-e1a67d1f45fe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:30:06.801416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:06.801416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:06.801416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:06.801416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:06.801416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:06.801416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:06.801416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:06.801416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:06.801416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:06.801416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:06.801416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:06.801416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:30:06.801416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:30:06.801416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:30:06.801416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:30:06.802478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:06.802478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:06.802478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:30:06.802478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:06.802478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:30:06.802478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:06.802478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:06.802478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:06.802478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:06.802478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:06.802478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:06.802478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:06.802478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:06.802478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:06.802478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:06.802478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:06.802478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:06.802478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:06.803462 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:06.803462 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:06.803462 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:30:06.803462 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:30:06.803462 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:30:06.803462 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:30:06.803462 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:30:06.803462 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:30:06.803462 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:30:06.803462 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:06.803462 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 390/787] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:30:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:06.811293 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f8b65-fb88-4dcd-beb8-a5fc5dad9be9 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:06.955252 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f8b65-fb88-4dcd-beb8-a5fc5dad9be9 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:06.957405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:06.965391 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cf7ff-6b3b-484f-b6e7-ee0be29c59be None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:06.965781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cf7ff-6b3b-484f-b6e7-ee0be29c59be None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:06.966097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1cf7ff-6b3b-484f-b6e7-ee0be29c59be None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:06.967647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 391/788] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:06.973440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b74547-af09-465e-b9b1-a1f92c9a069b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:06.973733 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b74547-af09-465e-b9b1-a1f92c9a069b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:06.974039 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b74547-af09-465e-b9b1-a1f92c9a069b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:06.994002 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e0b74547-af09-465e-b9b1-a1f92c9a069b None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:06.995548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e0b74547-af09-465e-b9b1-a1f92c9a069b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:07.016340 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0e833-5825-4140-aee8-f0c459036bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:07.017082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0e833-5825-4140-aee8-f0c459036bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:07.017380 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0e833-5825-4140-aee8-f0c459036bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:07.017659 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba0e833-5825-4140-aee8-f0c459036bb7 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:07.018639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0e833-5825-4140-aee8-f0c459036bb7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:07.019015 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0e833-5825-4140-aee8-f0c459036bb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:07.020520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba0e833-5825-4140-aee8-f0c459036bb7 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:07.056380 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 398/789] 10.222.0.76 () {56 vars in 1135 bytes} [Mon Jul 18 16:30:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:07.062907 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0e833-5825-4140-aee8-f0c459036bb7 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:07.072551 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 392/790] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:30:07.103555 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b74547-af09-465e-b9b1-a1f92c9a069b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:07.204567 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba0e833-5825-4140-aee8-f0c459036bb7 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:07.237710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:07.241753 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed42141-1abc-4cee-85fd-863316b20ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:07.242776 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed42141-1abc-4cee-85fd-863316b20ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:07.243261 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed42141-1abc-4cee-85fd-863316b20ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:07.243730 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed42141-1abc-4cee-85fd-863316b20ec0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:07.255946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b74547-af09-465e-b9b1-a1f92c9a069b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:07.256314 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed42141-1abc-4cee-85fd-863316b20ec0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:07.258126 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed42141-1abc-4cee-85fd-863316b20ec0 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:07.283877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-2ed42141-1abc-4cee-85fd-863316b20ec0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:07.283877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:07.283877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:07.283877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:07.283877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:07.283877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:07.283877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:07.283877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:07.283877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:07.283877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:07.283877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:07.283877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:07.283877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:07.283877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:07.283877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:07.284852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:07.284852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:07.284852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:07.284852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:07.284852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:07.284852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:07.284852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:07.284852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:07.284852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:07.284852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:07.284852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:07.284852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:07.284852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:07.284852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:07.284852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:07.284852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:07.284852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:07.285781 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:07.285781 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:07.285781 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:07.285781 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:07.285781 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 399/791] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:07.287045 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00093fda-d470-4499-9931-1fac4b9bbc4a None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:07.287334 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00093fda-d470-4499-9931-1fac4b9bbc4a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:07.287619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00093fda-d470-4499-9931-1fac4b9bbc4a None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:07.293815 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 400/792] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:07.294873 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00093fda-d470-4499-9931-1fac4b9bbc4a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:07.301233 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c8af9-e10d-433f-b0cc-1d810e841264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:07.302385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c8af9-e10d-433f-b0cc-1d810e841264 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:07.302904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c8af9-e10d-433f-b0cc-1d810e841264 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:07.303405 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c8af9-e10d-433f-b0cc-1d810e841264 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:07.313868 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:07.315937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c8af9-e10d-433f-b0cc-1d810e841264 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:30:07.324712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-c52c8af9-e10d-433f-b0cc-1d810e841264 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:30:07.324712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:07.324712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:07.324712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:07.324712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:07.324712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:07.324712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:07.324712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:07.324712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:07.324712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:07.324712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:07.324712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:07.324712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:30:07.324712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:30:07.324712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:30:07.324712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:30:07.338911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:30:07.338911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:30:07.338911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:30:07.338911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:30:07.338911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:07.338911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:07.338911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:07.338911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:07.338911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:07.338911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:07.338911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:07.338911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:07.338911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:07.338911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:07.338911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:07.338911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:07.340317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:07.340317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:07.340317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:07.340317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:07.340317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:30:07.340317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:30:07.340317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:30:07.340317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:30:07.340317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:30:07.340317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:30:07.340317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:30:07.340317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:07.340317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 393/793] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:30:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:07.340317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d34015-0ab6-4148-9e59-afcfe02caf42 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:07.341379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d34015-0ab6-4148-9e59-afcfe02caf42 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:07.341379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d34015-0ab6-4148-9e59-afcfe02caf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:07.351852 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-93d34015-0ab6-4148-9e59-afcfe02caf42 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:07.353408 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-93d34015-0ab6-4148-9e59-afcfe02caf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:07.433088 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 394/794] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:07.434963 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d34015-0ab6-4148-9e59-afcfe02caf42 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:07.438915 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00093fda-d470-4499-9931-1fac4b9bbc4a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:07.484143 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff3618-f91e-4142-8f33-c83ec74bde7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:07.485298 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff3618-f91e-4142-8f33-c83ec74bde7d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:07.485782 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff3618-f91e-4142-8f33-c83ec74bde7d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:07.486288 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff3618-f91e-4142-8f33-c83ec74bde7d None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:07.487245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff3618-f91e-4142-8f33-c83ec74bde7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:07.487849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff3618-f91e-4142-8f33-c83ec74bde7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:07.489527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff3618-f91e-4142-8f33-c83ec74bde7d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:07.503798 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 401/795] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:07.505630 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff3618-f91e-4142-8f33-c83ec74bde7d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:07.546117 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:07.572936 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d34015-0ab6-4148-9e59-afcfe02caf42 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:07.611756 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:07.613771 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f611084-b6b9-451f-8378-84d45ea2ff50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:07.614600 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f611084-b6b9-451f-8378-84d45ea2ff50 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:07.614890 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f611084-b6b9-451f-8378-84d45ea2ff50 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:07.615167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f611084-b6b9-451f-8378-84d45ea2ff50 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:07.615934 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f611084-b6b9-451f-8378-84d45ea2ff50 None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:07.616245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f611084-b6b9-451f-8378-84d45ea2ff50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:07.617701 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f611084-b6b9-451f-8378-84d45ea2ff50 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:07.634930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 395/796] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 16:30:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:07.634930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f611084-b6b9-451f-8378-84d45ea2ff50 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:07.655727 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff3618-f91e-4142-8f33-c83ec74bde7d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:07.692875 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85b4f6-0dc4-4a45-a44f-297e0003de57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:07.694128 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85b4f6-0dc4-4a45-a44f-297e0003de57 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:07.694611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85b4f6-0dc4-4a45-a44f-297e0003de57 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:07.695077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85b4f6-0dc4-4a45-a44f-297e0003de57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:07.708382 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f85b4f6-0dc4-4a45-a44f-297e0003de57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:30:07.717328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-1f85b4f6-0dc4-4a45-a44f-297e0003de57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:30:07.717328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:07.717328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:07.717328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:07.717328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:07.717328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:07.717328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:07.717328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:07.717328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:07.717328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:07.717328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:07.717328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:07.717328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:30:07.717328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:30:07.717328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:30:07.717328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:30:07.718339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:30:07.718339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:30:07.718339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:30:07.718339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:30:07.718339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:07.718339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:07.718339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:07.718339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:07.718339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:07.718339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:07.718339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:07.718339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:07.718339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:07.718339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:07.718339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:07.718339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:07.719216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:07.719216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:07.719216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:07.719216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:07.719216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:30:07.719216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:30:07.719216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:30:07.719216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:30:07.719216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:30:07.719216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:30:07.719216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:30:07.719216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:07.719216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 402/797] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:30:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:07.719950 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85b4f6-0dc4-4a45-a44f-297e0003de57 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:07.762953 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f611084-b6b9-451f-8378-84d45ea2ff50 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:07.805101 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d05dde-e7f3-4885-9ea9-3e2b60b0c604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:07.806085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d05dde-e7f3-4885-9ea9-3e2b60b0c604 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:07.806378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d05dde-e7f3-4885-9ea9-3e2b60b0c604 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:07.806661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d05dde-e7f3-4885-9ea9-3e2b60b0c604 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:07.814579 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d05dde-e7f3-4885-9ea9-3e2b60b0c604 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:07.816032 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d05dde-e7f3-4885-9ea9-3e2b60b0c604 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:07.817945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:07.831189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-b8d05dde-e7f3-4885-9ea9-3e2b60b0c604 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:07.831189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:07.831189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:07.831189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:07.831189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:07.831189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:07.831189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:07.831189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:07.831189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:07.831189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:07.831189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:07.831189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:07.831189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:30:07.831189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:30:07.831189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:30:07.838193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:30:07.838193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:07.838193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:07.838193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:07.838193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:07.838193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:07.838193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:07.838193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:07.838193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:07.838193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:07.838193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:07.838193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:07.838193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:07.838193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:07.838193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:07.838193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:07.838193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:07.839114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:30:07.839114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:30:07.839114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:30:07.839114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:30:07.839114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:30:07.839114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:30:07.839114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:07.839114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:07.839114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 396/798] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:30:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:07.839941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85b4f6-0dc4-4a45-a44f-297e0003de57 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:07.840349 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ea95c-5392-4dea-b493-40f7052bfd70 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:07.840349 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ea95c-5392-4dea-b493-40f7052bfd70 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:07.840349 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ea95c-5392-4dea-b493-40f7052bfd70 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:07.840349 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 397/799] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:07.840349 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ea95c-5392-4dea-b493-40f7052bfd70 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:07.872609 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:07.877663 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f67b3-321b-49fa-bd4e-b771aa054b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:07.882943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f67b3-321b-49fa-bd4e-b771aa054b95 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:07.882943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f67b3-321b-49fa-bd4e-b771aa054b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:07.882943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f67b3-321b-49fa-bd4e-b771aa054b95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:07.890618 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f67b3-321b-49fa-bd4e-b771aa054b95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:07.892082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f67b3-321b-49fa-bd4e-b771aa054b95 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:07.909060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-4d5f67b3-321b-49fa-bd4e-b771aa054b95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:07.909060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:07.909060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:07.909060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:07.909060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:07.909060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:07.909060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:07.909060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:07.909060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:07.909060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:07.909060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:07.909060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:07.909060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:07.909060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:07.909060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:07.910178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:07.910178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:07.910178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:07.910178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:07.910178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:07.910178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:07.910178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:07.910178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:07.910178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:07.910178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:07.910178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:07.910178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:07.910178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:07.910178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:07.910178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:07.910178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:07.910178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:07.911220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:07.911220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:07.911220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:07.911220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:07.911220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 403/800] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:07.911502 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f67b3-321b-49fa-bd4e-b771aa054b95 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:07.959345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ea95c-5392-4dea-b493-40f7052bfd70 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:07.997020 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e67a6-37b9-49c7-85f5-4bef5375c172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:07.997841 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e67a6-37b9-49c7-85f5-4bef5375c172 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:07.998134 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e67a6-37b9-49c7-85f5-4bef5375c172 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:07.998411 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e67a6-37b9-49c7-85f5-4bef5375c172 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:07.999162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e67a6-37b9-49c7-85f5-4bef5375c172 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:07.999467 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e67a6-37b9-49c7-85f5-4bef5375c172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:08.000842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e67a6-37b9-49c7-85f5-4bef5375c172 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:08.010033 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 398/801] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:30:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:08.011339 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91922d25-d5ca-4d26-ac24-1d4106387257 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:08.011612 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91922d25-d5ca-4d26-ac24-1d4106387257 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:08.011893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91922d25-d5ca-4d26-ac24-1d4106387257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:08.028084 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f67b3-321b-49fa-bd4e-b771aa054b95 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:08.029676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-91922d25-d5ca-4d26-ac24-1d4106387257 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:08.031170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-91922d25-d5ca-4d26-ac24-1d4106387257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:08.072958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48247b55-8ee3-4d85-8426-f94af32f4b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:08.073660 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48247b55-8ee3-4d85-8426-f94af32f4b05 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:08.074114 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48247b55-8ee3-4d85-8426-f94af32f4b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:08.074718 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48247b55-8ee3-4d85-8426-f94af32f4b05 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:08.075063 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48247b55-8ee3-4d85-8426-f94af32f4b05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:08.075408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48247b55-8ee3-4d85-8426-f94af32f4b05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:08.076924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48247b55-8ee3-4d85-8426-f94af32f4b05 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:08.091722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 404/802] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:30:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:08.093054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48247b55-8ee3-4d85-8426-f94af32f4b05 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:08.097323 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:08.109320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 399/803] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:08.110536 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91922d25-d5ca-4d26-ac24-1d4106387257 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:08.158712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:08.225752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48247b55-8ee3-4d85-8426-f94af32f4b05 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:08.228649 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91922d25-d5ca-4d26-ac24-1d4106387257 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:08.261911 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03b40e-47e4-478c-b408-07f6e9db410d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:08.262588 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03b40e-47e4-478c-b408-07f6e9db410d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:08.262873 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03b40e-47e4-478c-b408-07f6e9db410d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:08.263150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03b40e-47e4-478c-b408-07f6e9db410d None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:08.263877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03b40e-47e4-478c-b408-07f6e9db410d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:08.264206 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03b40e-47e4-478c-b408-07f6e9db410d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:08.265608 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c03b40e-47e4-478c-b408-07f6e9db410d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:08.266735 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abfbab-aa32-4c31-9b6c-7822feb2788a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:08.267681 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abfbab-aa32-4c31-9b6c-7822feb2788a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:08.268106 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abfbab-aa32-4c31-9b6c-7822feb2788a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:08.268386 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1abfbab-aa32-4c31-9b6c-7822feb2788a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:08.282847 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 405/804] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:08.282847 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03b40e-47e4-478c-b408-07f6e9db410d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:08.284380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abfbab-aa32-4c31-9b6c-7822feb2788a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:08.285916 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1abfbab-aa32-4c31-9b6c-7822feb2788a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:08.305632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-c1abfbab-aa32-4c31-9b6c-7822feb2788a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:08.305632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:08.305632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:08.305632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:08.305632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:08.305632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:08.305632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:08.305632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:08.305632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:08.305632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:08.305632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:08.305632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:08.305632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:08.305632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:08.305632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:08.306575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:08.306575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:08.306575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:08.306575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:08.306575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:08.306575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:08.306575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:08.306575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:08.306575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:08.306575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:08.306575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:08.306575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:08.306575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:08.306575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:08.306575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:08.306575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:08.306575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:08.307520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:08.307520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:08.307520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:08.307520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:08.307520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 400/805] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:08.307800 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abfbab-aa32-4c31-9b6c-7822feb2788a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:08.356419 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:08.394081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c03b40e-47e4-478c-b408-07f6e9db410d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:08.396423 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:08.421749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1abfbab-aa32-4c31-9b6c-7822feb2788a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:08.434007 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e81e1-b78c-4fd0-8a10-153189e344a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:08.435078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e81e1-b78c-4fd0-8a10-153189e344a7 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:08.435365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e81e1-b78c-4fd0-8a10-153189e344a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:08.435642 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e81e1-b78c-4fd0-8a10-153189e344a7 None admin] PATH_INFO: `/v3/projects/30a4824228ec47519a01574d82879b25/users/50bc0fa34b414328a342d685bc1eaca3/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:08.438442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e81e1-b78c-4fd0-8a10-153189e344a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=30a4824228ec47519a01574d82879b25, user_id=50bc0fa34b414328a342d685bc1eaca3, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:08.440486 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1e81e1-b78c-4fd0-8a10-153189e344a7 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:08.458724 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8eaf-74d2-4d6b-82df-3eb4e0265bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:08.459605 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8eaf-74d2-4d6b-82df-3eb4e0265bfa None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:08.459889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8eaf-74d2-4d6b-82df-3eb4e0265bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:08.460168 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209b8eaf-74d2-4d6b-82df-3eb4e0265bfa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:08.460820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b8eaf-74d2-4d6b-82df-3eb4e0265bfa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:08.462230 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209b8eaf-74d2-4d6b-82df-3eb4e0265bfa None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:08.475104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-209b8eaf-74d2-4d6b-82df-3eb4e0265bfa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 16:30:08.475104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:08.475104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:30:08.475104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:30:08.475104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:30:08.475104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:30:08.475104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:30:08.475104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:08.475104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 16:30:08.475104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:08.475104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:08.475104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:08.475104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:08.475104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:08.475104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:08.475104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:08.476172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:08.476172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:08.476172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:08.476172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:08.476172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:08.476172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:08.476172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:08.476172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:30:08.476172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:30:08.476172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:30:08.476172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:30:08.476172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:08.476172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:08.476172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:08.476172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:08.476172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:08.477061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:08.477061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:08.477061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:08.477061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:08.477061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:08.477061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:08.477061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:08.477061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:08.477061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:08.477061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:08.477061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:08.477061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:30:08.477061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:08.477061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 18 16:30:08.477061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:08.477061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 401/806] 10.222.0.76 () {56 vars in 1129 bytes} [Mon Jul 18 16:30:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:08.478473 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8eaf-74d2-4d6b-82df-3eb4e0265bfa None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:08.563229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 406/807] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:30:08 2022] PUT /identity/v3/projects/30a4824228ec47519a01574d82879b25/users/50bc0fa34b414328a342d685bc1eaca3/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:30:08.563955 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e81e1-b78c-4fd0-8a10-153189e344a7 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:08.582188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209b8eaf-74d2-4d6b-82df-3eb4e0265bfa None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:08.591828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:08.624092 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97eeb13-cc9a-4907-b3f1-f850b900b064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:08.624946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97eeb13-cc9a-4907-b3f1-f850b900b064 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:08.625262 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97eeb13-cc9a-4907-b3f1-f850b900b064 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:08.625553 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97eeb13-cc9a-4907-b3f1-f850b900b064 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:08.634359 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97eeb13-cc9a-4907-b3f1-f850b900b064 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:08.635883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97eeb13-cc9a-4907-b3f1-f850b900b064 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:08.653656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-a97eeb13-cc9a-4907-b3f1-f850b900b064 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:30:08.653656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:08.653656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:08.653656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:08.653656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:08.653656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:08.653656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:08.653656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:08.653656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:08.653656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:08.653656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:08.653656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:08.653656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:30:08.653656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:30:08.653656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:30:08.653656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:30:08.654692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:08.654692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:08.654692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:30:08.654692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:08.654692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:30:08.654692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:08.654692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:08.654692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:08.654692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:08.654692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:08.654692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:08.654692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:08.654692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:08.654692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:08.654692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:08.654692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:08.654692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:08.654692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:08.655706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:08.655706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:08.655706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:30:08.655706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:30:08.655706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:30:08.655706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:30:08.655706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:30:08.655706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:30:08.655706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:30:08.655706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:08.655706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 402/808] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Jul 18 16:30:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:08.656946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97eeb13-cc9a-4907-b3f1-f850b900b064 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:08.696023 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e81e1-b78c-4fd0-8a10-153189e344a7 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:08.739162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d287f8-bc64-4538-b78a-1a3a246f8ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:08.739860 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d287f8-bc64-4538-b78a-1a3a246f8ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:08.740139 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d287f8-bc64-4538-b78a-1a3a246f8ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:08.740415 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d287f8-bc64-4538-b78a-1a3a246f8ef3 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:08.741219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d287f8-bc64-4538-b78a-1a3a246f8ef3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:08.741535 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d287f8-bc64-4538-b78a-1a3a246f8ef3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:08.742915 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d287f8-bc64-4538-b78a-1a3a246f8ef3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:08.756518 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 407/809] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:08.757711 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e42f06-906a-4919-b82c-dba41541ecdc None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:08.758006 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e42f06-906a-4919-b82c-dba41541ecdc None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:08.758285 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e42f06-906a-4919-b82c-dba41541ecdc None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:08.759710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 408/810] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:08.761684 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e42f06-906a-4919-b82c-dba41541ecdc None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:08.785951 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97eeb13-cc9a-4907-b3f1-f850b900b064 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:08.792058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:08.823458 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af478fe5-5944-40e2-9d49-30376356ae93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:08.824360 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af478fe5-5944-40e2-9d49-30376356ae93 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:08.824844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af478fe5-5944-40e2-9d49-30376356ae93 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:08.825080 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af478fe5-5944-40e2-9d49-30376356ae93 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:08.825815 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af478fe5-5944-40e2-9d49-30376356ae93 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:08.826129 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af478fe5-5944-40e2-9d49-30376356ae93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:08.827572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af478fe5-5944-40e2-9d49-30376356ae93 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:08.832598 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 403/811] 10.222.0.76 () {56 vars in 1124 bytes} [Mon Jul 18 16:30:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:08.833434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af478fe5-5944-40e2-9d49-30376356ae93 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:08.868848 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:08.892656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e42f06-906a-4919-b82c-dba41541ecdc None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:08.932093 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2d96d8-e147-4515-b377-a816e3a72141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:08.932779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d96d8-e147-4515-b377-a816e3a72141 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:08.933223 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d96d8-e147-4515-b377-a816e3a72141 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:08.933657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2d96d8-e147-4515-b377-a816e3a72141 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:08.934738 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d96d8-e147-4515-b377-a816e3a72141 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:08.935054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d96d8-e147-4515-b377-a816e3a72141 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:08.936499 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2d96d8-e147-4515-b377-a816e3a72141 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:08.940446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af478fe5-5944-40e2-9d49-30376356ae93 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:08.955242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 409/812] 10.222.0.76 () {56 vars in 1149 bytes} [Mon Jul 18 16:30:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:08.961342 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab393d8-50a4-4559-a139-f8d47a6ac5d5 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:08.961635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab393d8-50a4-4559-a139-f8d47a6ac5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:08.961913 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab393d8-50a4-4559-a139-f8d47a6ac5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:08.975492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dc7f8-54bd-4da7-853e-a11e7da70764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:08.976290 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dc7f8-54bd-4da7-853e-a11e7da70764 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:08.976637 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dc7f8-54bd-4da7-853e-a11e7da70764 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:08.976914 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65dc7f8-54bd-4da7-853e-a11e7da70764 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:08.980642 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-eab393d8-50a4-4559-a139-f8d47a6ac5d5 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:08.981908 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-eab393d8-50a4-4559-a139-f8d47a6ac5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:08.985038 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65dc7f8-54bd-4da7-853e-a11e7da70764 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:08.986491 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65dc7f8-54bd-4da7-853e-a11e7da70764 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:09.002889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-c65dc7f8-54bd-4da7-853e-a11e7da70764 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:30:09.002889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:09.002889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:09.002889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:09.002889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:09.002889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:09.002889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:09.002889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:09.002889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:09.002889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:09.002889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:09.002889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:09.002889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:30:09.002889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:30:09.002889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:30:09.002889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:30:09.003881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:09.003881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:09.003881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:30:09.003881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:09.003881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:30:09.003881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:09.003881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:09.003881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:09.003881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:09.003881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:09.003881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:09.003881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:09.003881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:09.003881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:09.003881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:09.003881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:09.003881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:09.003881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:09.004846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:09.004846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:09.004846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:30:09.004846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:30:09.004846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:30:09.004846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:30:09.004846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:30:09.004846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:30:09.004846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:30:09.004846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:09.004846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 404/813] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Jul 18 16:30:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:09.005495 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dc7f8-54bd-4da7-853e-a11e7da70764 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:09.066784 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 410/814] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:09.067866 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab393d8-50a4-4559-a139-f8d47a6ac5d5 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:09.083113 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:09.121288 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:09.130942 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65dc7f8-54bd-4da7-853e-a11e7da70764 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:09.175255 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b799f32-3557-49cf-9613-d279747f7d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:09.175937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b799f32-3557-49cf-9613-d279747f7d92 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:09.176223 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b799f32-3557-49cf-9613-d279747f7d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:09.176329 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab393d8-50a4-4559-a139-f8d47a6ac5d5 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:09.176500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b799f32-3557-49cf-9613-d279747f7d92 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:09.177246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b799f32-3557-49cf-9613-d279747f7d92 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:09.177553 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b799f32-3557-49cf-9613-d279747f7d92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:09.179220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b799f32-3557-49cf-9613-d279747f7d92 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:09.190141 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 405/815] 10.222.0.76 () {56 vars in 1124 bytes} [Mon Jul 18 16:30:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:09.190141 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b799f32-3557-49cf-9613-d279747f7d92 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:09.220127 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220006b-8886-445d-a46f-eeca8c65d6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:09.221188 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220006b-8886-445d-a46f-eeca8c65d6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:09.221481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220006b-8886-445d-a46f-eeca8c65d6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:09.221852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220006b-8886-445d-a46f-eeca8c65d6d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:09.236139 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220006b-8886-445d-a46f-eeca8c65d6d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:09.237666 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220006b-8886-445d-a46f-eeca8c65d6d1 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:09.256879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-a220006b-8886-445d-a46f-eeca8c65d6d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:09.256879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:09.256879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:09.256879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:09.256879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:09.256879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:09.256879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:09.256879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:09.256879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:09.256879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:09.256879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:09.256879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:09.256879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:09.256879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:09.256879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:09.257862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:09.257862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:09.257862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:09.257862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:09.257862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:09.257862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:09.257862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:09.257862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:09.257862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:09.257862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:09.257862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:09.257862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:09.257862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:09.257862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:09.257862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:09.257862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:09.257862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:09.258811 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:09.258811 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:09.258811 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:09.258811 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:09.258811 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 411/816] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:09.259090 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220006b-8886-445d-a46f-eeca8c65d6d1 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:09.303269 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b799f32-3557-49cf-9613-d279747f7d92 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:09.342867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df920bd-b77e-43d5-aabc-619654deff6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:09.343877 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df920bd-b77e-43d5-aabc-619654deff6a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:09.344368 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df920bd-b77e-43d5-aabc-619654deff6a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:09.344856 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df920bd-b77e-43d5-aabc-619654deff6a None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:09.345967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df920bd-b77e-43d5-aabc-619654deff6a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:09.346477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df920bd-b77e-43d5-aabc-619654deff6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:09.348152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df920bd-b77e-43d5-aabc-619654deff6a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:09.374660 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 406/817] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Jul 18 16:30:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:09.374660 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df920bd-b77e-43d5-aabc-619654deff6a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:09.393085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:09.445970 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:09.489454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220006b-8886-445d-a46f-eeca8c65d6d1 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:09.492647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df920bd-b77e-43d5-aabc-619654deff6a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:09.529271 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f646a-8731-4f77-b81b-6decab7cf49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:09.530078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f646a-8731-4f77-b81b-6decab7cf49e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:09.530362 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f646a-8731-4f77-b81b-6decab7cf49e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:09.530636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66f646a-8731-4f77-b81b-6decab7cf49e None admin] PATH_INFO: `/v3/services/network` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:09.531199 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a3787-070a-41d8-b375-f60056d4d40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:09.531578 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f646a-8731-4f77-b81b-6decab7cf49e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:09.531858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a3787-070a-41d8-b375-f60056d4d40f None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:09.532143 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a3787-070a-41d8-b375-f60056d4d40f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:09.532419 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a3787-070a-41d8-b375-f60056d4d40f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:09.532973 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66f646a-8731-4f77-b81b-6decab7cf49e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:09.533193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a3787-070a-41d8-b375-f60056d4d40f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:09.534542 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a3787-070a-41d8-b375-f60056d4d40f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:09.546227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-b66f646a-8731-4f77-b81b-6decab7cf49e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 16:30:09.546227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:09.546227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:30:09.546227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:30:09.546227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:30:09.546227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:30:09.546227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:30:09.546227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:09.546227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 16:30:09.546227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:09.546227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:09.546227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:09.546227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:09.546227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:09.546227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:09.546227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:09.546227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:09.547384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:09.547384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:09.547384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:09.547384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:09.547384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:09.547384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:09.547384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:30:09.547384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:30:09.547384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:30:09.547384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:30:09.547384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:09.547384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:09.547384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:09.547384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:09.547384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:09.547384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:09.548257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:09.548257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:09.548257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:09.548257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:09.548257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:09.548257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:09.548257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:09.548257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:09.548257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:09.548257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:09.548257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:30:09.548257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:09.548257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 18 16:30:09.548257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:09.548257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 412/818] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:30:09 2022] GET /identity/v3/services/network => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:09.549228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f646a-8731-4f77-b81b-6decab7cf49e None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:09.652211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66f646a-8731-4f77-b81b-6decab7cf49e None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:09.658510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 407/819] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Jul 18 16:30:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:30:09.660517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a3787-070a-41d8-b375-f60056d4d40f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:09.697961 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:09.714169 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309bd9a5-1c4f-4f5d-bcf6-7f7c727b05bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:09.715641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bd9a5-1c4f-4f5d-bcf6-7f7c727b05bb None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:09.715929 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bd9a5-1c4f-4f5d-bcf6-7f7c727b05bb None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:09.716221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309bd9a5-1c4f-4f5d-bcf6-7f7c727b05bb None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:09.717078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309bd9a5-1c4f-4f5d-bcf6-7f7c727b05bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:09.717394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309bd9a5-1c4f-4f5d-bcf6-7f7c727b05bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:09.719206 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309bd9a5-1c4f-4f5d-bcf6-7f7c727b05bb None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:09.735849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 413/820] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:09.736992 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309bd9a5-1c4f-4f5d-bcf6-7f7c727b05bb None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:09.771015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:09.828373 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a3787-070a-41d8-b375-f60056d4d40f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:09.861542 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309bd9a5-1c4f-4f5d-bcf6-7f7c727b05bb None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:09.871862 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead0aa2-860c-421d-9437-5703e2eafdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:09.872535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead0aa2-860c-421d-9437-5703e2eafdb4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:09.872828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead0aa2-860c-421d-9437-5703e2eafdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:09.873140 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead0aa2-860c-421d-9437-5703e2eafdb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:09.912584 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42700c8f-354e-4726-bb62-59f163f2435c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:09.913984 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42700c8f-354e-4726-bb62-59f163f2435c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:09.914472 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42700c8f-354e-4726-bb62-59f163f2435c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:09.914969 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42700c8f-354e-4726-bb62-59f163f2435c None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:09.915895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42700c8f-354e-4726-bb62-59f163f2435c None admin] RBAC: Adding query filter params (name=network) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:09.916439 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42700c8f-354e-4726-bb62-59f163f2435c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:09.918542 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42700c8f-354e-4726-bb62-59f163f2435c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:09.924163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 414/821] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 16:30:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:09.925368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42700c8f-354e-4726-bb62-59f163f2435c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:09.961235 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead0aa2-860c-421d-9437-5703e2eafdb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:09.962888 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead0aa2-860c-421d-9437-5703e2eafdb4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:09.989175 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:10.035338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:10.067791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42700c8f-354e-4726-bb62-59f163f2435c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:10.081334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 408/822] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:30:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:30:10.082379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead0aa2-860c-421d-9437-5703e2eafdb4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:10.116383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628f464-27f4-4a78-991c-189141d7a277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:10.117873 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628f464-27f4-4a78-991c-189141d7a277 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:10.118167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628f464-27f4-4a78-991c-189141d7a277 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:10.119099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6628f464-27f4-4a78-991c-189141d7a277 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:10.129238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628f464-27f4-4a78-991c-189141d7a277 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:10.131978 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6628f464-27f4-4a78-991c-189141d7a277 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:10.151122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-6628f464-27f4-4a78-991c-189141d7a277 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:10.151122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:10.151122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:10.151122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:10.151122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:10.151122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:10.151122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:10.151122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:10.151122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:10.151122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:10.151122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:10.151122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:10.151122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:30:10.151122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:30:10.151122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:30:10.152125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:30:10.152125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:10.152125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:10.152125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:10.152125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:10.152125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:10.152125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:10.152125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:10.152125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:10.152125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:10.152125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:10.152125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:10.152125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:10.152125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:10.152125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:10.152125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:10.152125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:10.153268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:30:10.153268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:30:10.153268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:30:10.153268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:30:10.153268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:30:10.153268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:30:10.153268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:10.153268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:10.159606 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 415/823] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:30:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:10.159606 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628f464-27f4-4a78-991c-189141d7a277 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:10.222269 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead0aa2-860c-421d-9437-5703e2eafdb4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:10.268369 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df371ddd-db2a-44b9-b912-88eb77f7be4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:10.269473 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df371ddd-db2a-44b9-b912-88eb77f7be4d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:10.270294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df371ddd-db2a-44b9-b912-88eb77f7be4d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:10.271264 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df371ddd-db2a-44b9-b912-88eb77f7be4d None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:10.272477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df371ddd-db2a-44b9-b912-88eb77f7be4d None admin] RBAC: Adding query filter params (type=network) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:10.273033 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df371ddd-db2a-44b9-b912-88eb77f7be4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:10.275352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df371ddd-db2a-44b9-b912-88eb77f7be4d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:10.283446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 409/824] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 16:30:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:10.285104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df371ddd-db2a-44b9-b912-88eb77f7be4d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:10.291143 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6628f464-27f4-4a78-991c-189141d7a277 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:10.301556 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:10.329001 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:10.338334 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff98721-de4b-4e32-a390-2bc2f2e39605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:10.339625 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff98721-de4b-4e32-a390-2bc2f2e39605 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:10.340430 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff98721-de4b-4e32-a390-2bc2f2e39605 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:10.341407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff98721-de4b-4e32-a390-2bc2f2e39605 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:10.353601 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff98721-de4b-4e32-a390-2bc2f2e39605 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:10.355282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff98721-de4b-4e32-a390-2bc2f2e39605 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:10.374265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-6ff98721-de4b-4e32-a390-2bc2f2e39605 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:10.374265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:10.374265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:10.374265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:10.374265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:10.374265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:10.374265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:10.374265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:10.374265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:10.374265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:10.374265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:10.374265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:10.374265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:10.374265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:10.374265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:10.375394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:10.375394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:10.375394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:10.375394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:10.375394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:10.375394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:10.375394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:10.375394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:10.375394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:10.375394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:10.375394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:10.375394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:10.375394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:10.375394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:10.375394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:10.375394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:10.375394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:10.376492 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:10.376492 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:10.376492 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:10.376492 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:10.381296 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 416/825] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:10.382268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff98721-de4b-4e32-a390-2bc2f2e39605 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:10.427946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df371ddd-db2a-44b9-b912-88eb77f7be4d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:10.476903 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b8b01-d45e-4cf5-b2d4-c541015a9925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:10.478280 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b8b01-d45e-4cf5-b2d4-c541015a9925 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:10.478719 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b8b01-d45e-4cf5-b2d4-c541015a9925 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:10.479387 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b8b01-d45e-4cf5-b2d4-c541015a9925 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:10.480872 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b8b01-d45e-4cf5-b2d4-c541015a9925 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:10.481396 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b8b01-d45e-4cf5-b2d4-c541015a9925 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:10.483035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b8b01-d45e-4cf5-b2d4-c541015a9925 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:10.505303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 410/826] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:30:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:10.505303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b8b01-d45e-4cf5-b2d4-c541015a9925 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:10.533606 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff98721-de4b-4e32-a390-2bc2f2e39605 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:10.571572 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c2df3-57df-4ed1-bb91-34761a47eef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:10.572381 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c2df3-57df-4ed1-bb91-34761a47eef6 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:10.572878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c2df3-57df-4ed1-bb91-34761a47eef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:10.573419 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c2df3-57df-4ed1-bb91-34761a47eef6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:10.574854 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c2df3-57df-4ed1-bb91-34761a47eef6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:10.576370 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c2df3-57df-4ed1-bb91-34761a47eef6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:10.633244 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:10.642937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b8b01-d45e-4cf5-b2d4-c541015a9925 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:10.661990 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 417/827] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Jul 18 16:30:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:30:10.662912 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c2df3-57df-4ed1-bb91-34761a47eef6 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:10.686579 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:10.704029 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcfb5a-67d6-45b4-b6f6-01c3f7cebf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:10.705429 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcfb5a-67d6-45b4-b6f6-01c3f7cebf61 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:10.705873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcfb5a-67d6-45b4-b6f6-01c3f7cebf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:10.706319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcfb5a-67d6-45b4-b6f6-01c3f7cebf61 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:10.707851 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcfb5a-67d6-45b4-b6f6-01c3f7cebf61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:10.708363 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcfb5a-67d6-45b4-b6f6-01c3f7cebf61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:10.710415 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcfb5a-67d6-45b4-b6f6-01c3f7cebf61 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:10.734331 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 411/828] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:10.736185 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849a5ba-df41-4ca6-b41f-349c604bab3c None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:10.736622 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849a5ba-df41-4ca6-b41f-349c604bab3c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:10.737103 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4849a5ba-df41-4ca6-b41f-349c604bab3c None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:10.743532 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 412/829] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:10.743532 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849a5ba-df41-4ca6-b41f-349c604bab3c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:10.830583 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c2df3-57df-4ed1-bb91-34761a47eef6 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:10.880814 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d87132-694f-40f2-b34a-32c3e36ba241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:10.881681 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4849a5ba-df41-4ca6-b41f-349c604bab3c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:10.882124 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d87132-694f-40f2-b34a-32c3e36ba241 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:10.882124 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d87132-694f-40f2-b34a-32c3e36ba241 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:10.882296 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d87132-694f-40f2-b34a-32c3e36ba241 None admin] PATH_INFO: `/v3/projects/30a4824228ec47519a01574d82879b25/users/ff65e481807b4344897b1499cd450f9d/roles/ce6bff4fd8b6468b94dc4af858dde77b` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:10.900109 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d87132-694f-40f2-b34a-32c3e36ba241 None admin] RBAC: Authorizing `identity:create_grant(project_id=30a4824228ec47519a01574d82879b25, user_id=ff65e481807b4344897b1499cd450f9d, role_id=ce6bff4fd8b6468b94dc4af858dde77b)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:10.903262 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d87132-694f-40f2-b34a-32c3e36ba241 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:10.936319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fe497-873b-44f9-bbab-630c58930e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:10.939555 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fe497-873b-44f9-bbab-630c58930e21 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:10.939796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fe497-873b-44f9-bbab-630c58930e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:10.940071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fe497-873b-44f9-bbab-630c58930e21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:10.947647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fe497-873b-44f9-bbab-630c58930e21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:10.949175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fe497-873b-44f9-bbab-630c58930e21 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:10.964058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-fe3fe497-873b-44f9-bbab-630c58930e21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:10.964058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:10.964058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:10.964058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:10.964058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:10.964058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:10.964058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:10.964058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:10.964058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:10.964058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:10.964058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:10.964058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:10.964058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:30:10.964058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:30:10.964058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:30:10.968343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:30:10.968343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:10.968343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:10.968343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:10.968343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:10.968343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:10.968343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:10.968343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:10.968343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:10.968343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:10.968343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:10.968343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:10.968343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:10.968343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:10.968343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:10.968343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:10.968343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:10.969328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:30:10.969328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:30:10.969328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:30:10.969328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:30:10.969328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:30:10.969328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:30:10.969328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:10.969328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:10.969328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 413/830] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:30:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:10.969328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f530b38-1173-4009-b451-adaacc6da3d3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:10.969328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f530b38-1173-4009-b451-adaacc6da3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:10.970012 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f530b38-1173-4009-b451-adaacc6da3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:10.985360 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8f530b38-1173-4009-b451-adaacc6da3d3 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:10.986573 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8f530b38-1173-4009-b451-adaacc6da3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:10.988823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:11.001075 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 418/831] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:30:10 2022] PUT /identity/v3/projects/30a4824228ec47519a01574d82879b25/users/ff65e481807b4344897b1499cd450f9d/roles/ce6bff4fd8b6468b94dc4af858dde77b => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:30:11.001075 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d87132-694f-40f2-b34a-32c3e36ba241 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:11.078373 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 414/832] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:10 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:11.089917 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:11.104657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f530b38-1173-4009-b451-adaacc6da3d3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:11.133617 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d87132-694f-40f2-b34a-32c3e36ba241 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:11.183559 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2742a16-4e6d-4434-a555-5487219fadbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:11.184480 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2742a16-4e6d-4434-a555-5487219fadbf None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:11.184817 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2742a16-4e6d-4434-a555-5487219fadbf None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:11.185227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2742a16-4e6d-4434-a555-5487219fadbf None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:11.185904 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2742a16-4e6d-4434-a555-5487219fadbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:11.186216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2742a16-4e6d-4434-a555-5487219fadbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:11.187707 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2742a16-4e6d-4434-a555-5487219fadbf None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:11.203382 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 419/833] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:30:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:11.209516 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2742a16-4e6d-4434-a555-5487219fadbf None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:11.340836 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2742a16-4e6d-4434-a555-5487219fadbf None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:11.353251 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f530b38-1173-4009-b451-adaacc6da3d3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:11.378247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:11.392292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc671fcd-2a04-4224-8e7e-8f8b5cc6b01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:11.393519 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc671fcd-2a04-4224-8e7e-8f8b5cc6b01a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:11.394025 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc671fcd-2a04-4224-8e7e-8f8b5cc6b01a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:11.394466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae25dff-84f5-48f5-aa72-4cc587cbfede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:11.394741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc671fcd-2a04-4224-8e7e-8f8b5cc6b01a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:11.395275 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae25dff-84f5-48f5-aa72-4cc587cbfede None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:11.395561 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae25dff-84f5-48f5-aa72-4cc587cbfede None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:11.395842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae25dff-84f5-48f5-aa72-4cc587cbfede None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:11.396406 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc671fcd-2a04-4224-8e7e-8f8b5cc6b01a None admin] RBAC: Adding query filter params (role.id=c2d5d80485df4730903a874937d68aa3, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=381cf4381ce64379b285d75e2909813d) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:11.396908 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc671fcd-2a04-4224-8e7e-8f8b5cc6b01a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:11.399310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc671fcd-2a04-4224-8e7e-8f8b5cc6b01a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:11.403886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:11.408589 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae25dff-84f5-48f5-aa72-4cc587cbfede None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:30:11.409631 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 420/834] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:30:11 2022] GET /identity/v3/role_assignments?user.id=381cf4381ce64379b285d75e2909813d&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=c2d5d80485df4730903a874937d68aa3 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:11.419167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-bae25dff-84f5-48f5-aa72-4cc587cbfede None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:30:11.419167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:11.419167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:11.419167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:11.419167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:11.419167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:11.419167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:11.419167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:11.419167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:11.419167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:11.419167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:11.419167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:11.419167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:30:11.419167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:30:11.419167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:30:11.419167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:30:11.422456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:30:11.422456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:30:11.422456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:30:11.422456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:30:11.422456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:11.422456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:11.422456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:11.422456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:11.422456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:11.422456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:11.422456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:11.422456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:11.422456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:11.422456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:11.422456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:11.422456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:11.423320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:11.423320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:11.423320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:11.423320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:11.423320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:30:11.423320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:30:11.423320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:30:11.423320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:30:11.423320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:30:11.423320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:30:11.423320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:30:11.423320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:11.423320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 415/835] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:30:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:11.426560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc671fcd-2a04-4224-8e7e-8f8b5cc6b01a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:11.544259 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc671fcd-2a04-4224-8e7e-8f8b5cc6b01a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:11.587262 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcedbdf-df14-497f-8597-967676883591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:11.587938 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcedbdf-df14-497f-8597-967676883591 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:11.588220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcedbdf-df14-497f-8597-967676883591 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:11.588493 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcedbdf-df14-497f-8597-967676883591 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:11.589299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcedbdf-df14-497f-8597-967676883591 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:11.589834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcedbdf-df14-497f-8597-967676883591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:11.591353 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcedbdf-df14-497f-8597-967676883591 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:11.600041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 421/836] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:30:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:11.606880 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae25dff-84f5-48f5-aa72-4cc587cbfede None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:11.724629 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae25dff-84f5-48f5-aa72-4cc587cbfede None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:11.762658 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870723e-1c1e-4695-baae-244506407c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:11.763551 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870723e-1c1e-4695-baae-244506407c24 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:11.763836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870723e-1c1e-4695-baae-244506407c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:11.764116 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870723e-1c1e-4695-baae-244506407c24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:11.776177 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870723e-1c1e-4695-baae-244506407c24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:11.778749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870723e-1c1e-4695-baae-244506407c24 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:11.798794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-7870723e-1c1e-4695-baae-244506407c24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:11.798794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:11.798794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:11.798794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:11.798794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:11.798794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:11.798794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:11.798794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:11.798794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:11.798794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:11.798794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:11.798794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:11.798794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:11.798794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:11.798794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:11.799722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:11.799722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:11.799722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:11.799722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:11.799722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:11.799722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:11.799722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:11.799722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:11.799722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:11.799722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:11.799722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:11.799722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:11.799722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:11.799722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:11.799722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:11.799722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:11.799722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:11.800623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:11.800623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:11.800623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:11.800623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:11.800623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 416/837] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:11.805890 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcedbdf-df14-497f-8597-967676883591 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:11.862762 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:11.882150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342aeeb8-1a30-41c9-9538-01d2edd912f4 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:11.883246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342aeeb8-1a30-41c9-9538-01d2edd912f4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:11.883532 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342aeeb8-1a30-41c9-9538-01d2edd912f4 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:11.885180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 417/838] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:30:11.894366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3701b18-e4f9-4ee6-a26f-3ab69ad99a74 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:11.894779 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3701b18-e4f9-4ee6-a26f-3ab69ad99a74 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:11.895163 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3701b18-e4f9-4ee6-a26f-3ab69ad99a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:11.914490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f3701b18-e4f9-4ee6-a26f-3ab69ad99a74 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:11.916411 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f3701b18-e4f9-4ee6-a26f-3ab69ad99a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:11.918521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcedbdf-df14-497f-8597-967676883591 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:11.959404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358c629-269c-40ed-8668-971d90903287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:11.960075 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358c629-269c-40ed-8668-971d90903287 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:11.960357 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358c629-269c-40ed-8668-971d90903287 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:11.960629 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358c629-269c-40ed-8668-971d90903287 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:11.961390 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358c629-269c-40ed-8668-971d90903287 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:11.961694 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358c629-269c-40ed-8668-971d90903287 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:11.963069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2358c629-269c-40ed-8668-971d90903287 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:11.972023 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:11.976488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 422/839] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:11.982411 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358c629-269c-40ed-8668-971d90903287 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:12.005055 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 418/840] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:11 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:12.023901 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3701b18-e4f9-4ee6-a26f-3ab69ad99a74 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:12.095976 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358c629-269c-40ed-8668-971d90903287 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:12.110796 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:12.131733 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3701b18-e4f9-4ee6-a26f-3ab69ad99a74 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:12.134554 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d3e51-c5c1-4595-a2db-436c71b13e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:12.136547 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d3e51-c5c1-4595-a2db-436c71b13e5b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:12.136547 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d3e51-c5c1-4595-a2db-436c71b13e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:12.136547 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d3e51-c5c1-4595-a2db-436c71b13e5b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:12.144616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d3e51-c5c1-4595-a2db-436c71b13e5b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:12.146170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d3e51-c5c1-4595-a2db-436c71b13e5b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:12.165749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-335d3e51-c5c1-4595-a2db-436c71b13e5b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:30:12.165749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:12.165749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:12.165749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:12.165749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:12.165749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:12.165749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:12.165749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:12.165749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:12.165749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:12.165749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:12.165749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:12.165749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:30:12.165749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:30:12.165749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:30:12.165749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:30:12.166769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:12.166769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:12.166769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:30:12.166769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:12.166769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:30:12.166769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:12.166769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:12.166769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:12.166769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:12.166769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:12.166769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:12.166769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:12.166769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:12.166769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:12.166769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:12.166769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:12.166769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:12.166769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:12.168358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:12.168358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:12.168358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:30:12.168358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:30:12.168358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:30:12.168358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:30:12.168358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:30:12.168358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:30:12.168358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 18 16:30:12.168358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:12.172076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 423/841] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:30:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:12.174150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d3e51-c5c1-4595-a2db-436c71b13e5b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:12.178565 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9a9e2-8e95-4d24-b5d0-e0070848dbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:12.180176 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9a9e2-8e95-4d24-b5d0-e0070848dbe4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:12.180462 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9a9e2-8e95-4d24-b5d0-e0070848dbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:12.181312 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd9a9e2-8e95-4d24-b5d0-e0070848dbe4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:12.182208 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9a9e2-8e95-4d24-b5d0-e0070848dbe4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:12.183980 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd9a9e2-8e95-4d24-b5d0-e0070848dbe4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:12.200427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-9fd9a9e2-8e95-4d24-b5d0-e0070848dbe4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 16:30:12.200427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:12.200427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:30:12.200427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:30:12.200427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:30:12.200427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:30:12.200427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:30:12.200427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:12.200427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 16:30:12.200427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:12.200427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:12.200427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:12.200427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:12.200427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:12.200427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:12.200427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:12.200427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:12.201516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:12.201516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:12.201516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:12.201516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:12.201516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:12.201516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:12.201516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:30:12.201516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:30:12.201516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:30:12.201516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:30:12.201516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:12.201516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:12.201516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:12.201516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:12.201516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:12.201516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:12.202374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:12.202374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:12.202374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:12.202374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:12.202374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:12.202374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:12.202374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:12.202374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:12.202374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:12.202374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:12.202374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:30:12.202374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:12.202374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 16:30:12.202374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:12.205437 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 419/842] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 16:30:12 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:12.210650 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9a9e2-8e95-4d24-b5d0-e0070848dbe4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:12.266896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:12.297456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d3e51-c5c1-4595-a2db-436c71b13e5b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:12.327663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd9a9e2-8e95-4d24-b5d0-e0070848dbe4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:12.335105 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa9c34-b656-4730-b7af-8c20f6438f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:12.336059 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa9c34-b656-4730-b7af-8c20f6438f4d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:12.336570 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa9c34-b656-4730-b7af-8c20f6438f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:12.337096 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa9c34-b656-4730-b7af-8c20f6438f4d None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:12.338138 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa9c34-b656-4730-b7af-8c20f6438f4d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:12.338694 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa9c34-b656-4730-b7af-8c20f6438f4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:12.341344 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaa9c34-b656-4730-b7af-8c20f6438f4d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:12.360459 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 424/843] 10.222.0.76 () {56 vars in 1135 bytes} [Mon Jul 18 16:30:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:12.366236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa9c34-b656-4730-b7af-8c20f6438f4d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:12.368036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6976e-9488-44c4-9f3e-48af13357cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:12.368929 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6976e-9488-44c4-9f3e-48af13357cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:12.369390 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6976e-9488-44c4-9f3e-48af13357cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:12.370076 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d6976e-9488-44c4-9f3e-48af13357cc8 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:12.370842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6976e-9488-44c4-9f3e-48af13357cc8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:12.371152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6976e-9488-44c4-9f3e-48af13357cc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:12.372545 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d6976e-9488-44c4-9f3e-48af13357cc8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:12.382372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 420/844] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 16:30:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:12.383377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6976e-9488-44c4-9f3e-48af13357cc8 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:12.425635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:12.489725 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa9c34-b656-4730-b7af-8c20f6438f4d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:12.518660 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d6976e-9488-44c4-9f3e-48af13357cc8 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:12.529036 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b586b-9537-4fca-93d5-354bdbd5eb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:12.529885 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b586b-9537-4fca-93d5-354bdbd5eb07 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:12.530266 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b586b-9537-4fca-93d5-354bdbd5eb07 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:12.530637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b586b-9537-4fca-93d5-354bdbd5eb07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:12.531794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:12.564299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8c63f-986c-4391-96d6-fa07098daa82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:12.565445 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8c63f-986c-4391-96d6-fa07098daa82 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:12.566186 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8c63f-986c-4391-96d6-fa07098daa82 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:12.566769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8c63f-986c-4391-96d6-fa07098daa82 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:12.567735 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8c63f-986c-4391-96d6-fa07098daa82 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:12.568194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8c63f-986c-4391-96d6-fa07098daa82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:12.569901 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8c63f-986c-4391-96d6-fa07098daa82 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:12.577845 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 421/845] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 16:30:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:12.615021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b586b-9537-4fca-93d5-354bdbd5eb07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:12.616840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b586b-9537-4fca-93d5-354bdbd5eb07 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:12.664284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:12.741958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 425/846] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:30:12 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:30:12.743908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8c63f-986c-4391-96d6-fa07098daa82 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:12.862341 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8c63f-986c-4391-96d6-fa07098daa82 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:12.900213 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f503bd-2bd9-4539-9642-c00cc754c6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:12.901986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f503bd-2bd9-4539-9642-c00cc754c6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:12.902499 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f503bd-2bd9-4539-9642-c00cc754c6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:12.902978 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f503bd-2bd9-4539-9642-c00cc754c6b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:12.914229 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f503bd-2bd9-4539-9642-c00cc754c6b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:12.915945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f503bd-2bd9-4539-9642-c00cc754c6b6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:12.935041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-e5f503bd-2bd9-4539-9642-c00cc754c6b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:12.935041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:12.935041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:12.935041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:12.935041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:12.935041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:12.935041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:12.935041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:12.935041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:12.935041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:12.935041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:12.935041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:12.935041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:12.935041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:12.935041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:12.935991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:12.935991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:12.935991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:12.935991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:12.935991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:12.935991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:12.935991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:12.935991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:12.935991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:12.935991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:12.935991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:12.935991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:12.935991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:12.935991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:12.935991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:12.935991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:12.935991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:12.936902 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:12.936902 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:12.936902 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:12.936902 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:12.943505 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 422/847] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:12.945126 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b586b-9537-4fca-93d5-354bdbd5eb07 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:13.049305 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b586b-9537-4fca-93d5-354bdbd5eb07 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:13.081099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:13.087351 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba1a020-c8b8-4b93-9878-df1f873ea7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:13.095871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1a020-c8b8-4b93-9878-df1f873ea7ec None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:13.095871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1a020-c8b8-4b93-9878-df1f873ea7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:13.095871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba1a020-c8b8-4b93-9878-df1f873ea7ec None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:13.095871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1a020-c8b8-4b93-9878-df1f873ea7ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:13.095871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1a020-c8b8-4b93-9878-df1f873ea7ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:13.095871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba1a020-c8b8-4b93-9878-df1f873ea7ec None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:13.106022 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 426/848] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:13.111237 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f503bd-2bd9-4539-9642-c00cc754c6b6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:13.140683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:13.192267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24468ed8-a8ff-46e5-8930-37678611e685 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:13.192573 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24468ed8-a8ff-46e5-8930-37678611e685 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:13.192833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24468ed8-a8ff-46e5-8930-37678611e685 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:13.194534 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 427/849] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:13.200143 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724b580-0b2b-4e86-96c4-ac824ac9f715 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:13.200461 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724b580-0b2b-4e86-96c4-ac824ac9f715 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:13.201145 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724b580-0b2b-4e86-96c4-ac824ac9f715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:13.222282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-4724b580-0b2b-4e86-96c4-ac824ac9f715 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:13.224060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4724b580-0b2b-4e86-96c4-ac824ac9f715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:13.226085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f503bd-2bd9-4539-9642-c00cc754c6b6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:13.265611 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0371f4-cfb2-4825-a980-252e0ab1fcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:13.266824 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0371f4-cfb2-4825-a980-252e0ab1fcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:13.267335 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0371f4-cfb2-4825-a980-252e0ab1fcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:13.268010 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0371f4-cfb2-4825-a980-252e0ab1fcf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:13.275848 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0371f4-cfb2-4825-a980-252e0ab1fcf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:13.277896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0371f4-cfb2-4825-a980-252e0ab1fcf4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:13.294423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-2c0371f4-cfb2-4825-a980-252e0ab1fcf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:13.294423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:13.294423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:13.294423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:13.294423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:13.294423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:13.294423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:13.294423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:13.294423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:13.294423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:13.294423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:13.294423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:13.294423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:30:13.294423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:30:13.294423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:30:13.295380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:30:13.295380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:13.295380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:13.295380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:13.295380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:13.295380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:13.295380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:13.295380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:13.295380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:13.295380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:13.295380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:13.295380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:13.295380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:13.295380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:13.295380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:13.295380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:13.295380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:13.296294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:30:13.296294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:30:13.296294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:30:13.296294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:30:13.296294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:30:13.296294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:30:13.296294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:13.296294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:13.299084 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 423/850] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:30:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:13.309035 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 428/851] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:30:13.309237 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0371f4-cfb2-4825-a980-252e0ab1fcf4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:13.328725 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724b580-0b2b-4e86-96c4-ac824ac9f715 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:13.401897 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:13.426038 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0371f4-cfb2-4825-a980-252e0ab1fcf4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:13.452027 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724b580-0b2b-4e86-96c4-ac824ac9f715 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:13.478609 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:13.481230 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0bbfb-a95c-490d-ae60-d203dc623b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:13.482117 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0bbfb-a95c-490d-ae60-d203dc623b5c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:13.482415 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0bbfb-a95c-490d-ae60-d203dc623b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:13.482698 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0bbfb-a95c-490d-ae60-d203dc623b5c None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:13.484116 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0bbfb-a95c-490d-ae60-d203dc623b5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:13.484485 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0bbfb-a95c-490d-ae60-d203dc623b5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:13.486434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0bbfb-a95c-490d-ae60-d203dc623b5c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:13.494720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b082570-cd7a-41c9-bda6-d877593f8a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:13.495632 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b082570-cd7a-41c9-bda6-d877593f8a1a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:13.495984 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b082570-cd7a-41c9-bda6-d877593f8a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:13.496334 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b082570-cd7a-41c9-bda6-d877593f8a1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:13.506993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 424/852] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:30:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:13.507971 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0bbfb-a95c-490d-ae60-d203dc623b5c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:13.512349 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b082570-cd7a-41c9-bda6-d877593f8a1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:30:13.520407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-8b082570-cd7a-41c9-bda6-d877593f8a1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:30:13.520407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:13.520407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:13.520407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:13.520407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:13.520407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:13.520407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:13.520407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:13.520407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:13.520407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:13.520407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:13.520407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:13.520407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:30:13.520407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:30:13.520407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:30:13.520407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:30:13.521405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:30:13.521405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:30:13.521405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:30:13.521405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:30:13.521405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:13.521405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:13.521405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:13.521405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:13.521405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:13.521405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:13.521405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:13.521405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:13.521405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:13.521405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:13.521405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:13.521405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:13.522278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:13.522278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:13.522278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:13.522278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:13.522278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:30:13.522278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:30:13.522278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:30:13.522278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:30:13.522278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:30:13.522278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:30:13.522278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:30:13.522278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:13.522927 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 429/853] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:30:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:13.528559 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b082570-cd7a-41c9-bda6-d877593f8a1a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:13.638379 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b082570-cd7a-41c9-bda6-d877593f8a1a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:13.641975 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0bbfb-a95c-490d-ae60-d203dc623b5c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:13.677195 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bccf5ad-5053-45a4-9e35-d269baa7c82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:13.678128 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccf5ad-5053-45a4-9e35-d269baa7c82c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:13.678488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccf5ad-5053-45a4-9e35-d269baa7c82c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:13.678766 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccf5ad-5053-45a4-9e35-d269baa7c82c None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:13.679378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066cecd-2eeb-44a7-b52d-4d5a7f749282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:13.679564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bccf5ad-5053-45a4-9e35-d269baa7c82c None admin] RBAC: Adding query filter params (name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:13.679872 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bccf5ad-5053-45a4-9e35-d269baa7c82c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:13.680045 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066cecd-2eeb-44a7-b52d-4d5a7f749282 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:13.680340 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066cecd-2eeb-44a7-b52d-4d5a7f749282 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:13.680620 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7066cecd-2eeb-44a7-b52d-4d5a7f749282 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:13.681375 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bccf5ad-5053-45a4-9e35-d269baa7c82c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:13.681472 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066cecd-2eeb-44a7-b52d-4d5a7f749282 None admin] RBAC: Adding query filter params (role.id=c2d5d80485df4730903a874937d68aa3, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=50bc0fa34b414328a342d685bc1eaca3) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:13.681792 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066cecd-2eeb-44a7-b52d-4d5a7f749282 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:13.683290 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7066cecd-2eeb-44a7-b52d-4d5a7f749282 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:13.690135 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 430/854] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 16:30:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:13.690463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 425/855] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:30:13 2022] GET /identity/v3/role_assignments?user.id=50bc0fa34b414328a342d685bc1eaca3&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=c2d5d80485df4730903a874937d68aa3 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:13.691402 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd8c27-2714-42b3-a9fd-bace60da4648 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:13.691693 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd8c27-2714-42b3-a9fd-bace60da4648 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:13.691968 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedd8c27-2714-42b3-a9fd-bace60da4648 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:13.697628 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 431/856] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:13.699086 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066cecd-2eeb-44a7-b52d-4d5a7f749282 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:13.705746 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b60e40-1e26-4e61-a220-d0d4ec8017a0 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:13.706079 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b60e40-1e26-4e61-a220-d0d4ec8017a0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:13.706302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b60e40-1e26-4e61-a220-d0d4ec8017a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:13.724020 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:13.725668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-37b60e40-1e26-4e61-a220-d0d4ec8017a0 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:13.726872 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-37b60e40-1e26-4e61-a220-d0d4ec8017a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:13.794087 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:13.833036 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 432/857] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:30:13.845510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7066cecd-2eeb-44a7-b52d-4d5a7f749282 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:13.852688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b60e40-1e26-4e61-a220-d0d4ec8017a0 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:13.887502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39762d8e-280a-4a6f-bbd3-650b05d921c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:13.888432 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39762d8e-280a-4a6f-bbd3-650b05d921c3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:13.888723 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39762d8e-280a-4a6f-bbd3-650b05d921c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:13.889056 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39762d8e-280a-4a6f-bbd3-650b05d921c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:13.900086 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39762d8e-280a-4a6f-bbd3-650b05d921c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:13.901709 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39762d8e-280a-4a6f-bbd3-650b05d921c3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:13.924885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-39762d8e-280a-4a6f-bbd3-650b05d921c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:13.924885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:13.924885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:13.924885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:13.924885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:13.924885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:13.924885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:13.924885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:13.924885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:13.924885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:13.924885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:13.924885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:13.924885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:13.924885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:13.924885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:13.925925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:13.925925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:13.925925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:13.925925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:13.925925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:13.925925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:13.925925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:13.925925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:13.925925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:13.925925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:13.925925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:13.925925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:13.925925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:13.925925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:13.925925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:13.925925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:13.925925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:13.926850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:13.926850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:13.926850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:13.926850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:13.926850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 426/858] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:13.934661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39762d8e-280a-4a6f-bbd3-650b05d921c3 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:13.992250 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b60e40-1e26-4e61-a220-d0d4ec8017a0 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:14.005447 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:14.034580 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9bfce-f6ff-43b6-8d0b-0193212fc770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:14.035897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9bfce-f6ff-43b6-8d0b-0193212fc770 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:14.036220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9bfce-f6ff-43b6-8d0b-0193212fc770 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:14.036658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9bfce-f6ff-43b6-8d0b-0193212fc770 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:14.037495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9bfce-f6ff-43b6-8d0b-0193212fc770 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:14.039013 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9bfce-f6ff-43b6-8d0b-0193212fc770 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:14.051719 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39762d8e-280a-4a6f-bbd3-650b05d921c3 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:14.052910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-a0c9bfce-f6ff-43b6-8d0b-0193212fc770 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 16:30:14.052910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:14.052910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:30:14.052910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:30:14.052910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:30:14.052910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:30:14.052910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:30:14.052910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:14.052910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 16:30:14.052910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:14.052910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:14.052910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:14.052910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:14.052910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:14.052910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:14.052910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:14.054039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:14.054039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:14.054039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:14.054039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:14.054039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:14.054039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:14.054039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:14.054039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:30:14.054039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:30:14.054039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:30:14.054039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:30:14.054039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:14.054039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:14.054039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:14.054039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:14.054039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:14.055041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:14.055041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:14.055041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:14.055041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:14.055041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:14.055041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:14.055041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:14.055041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:14.055041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:14.055041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:14.055041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:14.055041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:30:14.055041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:14.055041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 16:30:14.055041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:14.057491 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 433/859] 10.222.0.76 () {56 vars in 1132 bytes} [Mon Jul 18 16:30:13 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:14.064076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9bfce-f6ff-43b6-8d0b-0193212fc770 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:14.095232 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f3812-ce41-44b9-85fa-2116556e771c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:14.096221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f3812-ce41-44b9-85fa-2116556e771c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:14.096517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f3812-ce41-44b9-85fa-2116556e771c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:14.096900 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f3812-ce41-44b9-85fa-2116556e771c None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:14.097666 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f3812-ce41-44b9-85fa-2116556e771c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:14.097974 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f3812-ce41-44b9-85fa-2116556e771c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:14.100013 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f3812-ce41-44b9-85fa-2116556e771c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:14.103170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:14.114624 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 427/860] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:14.126631 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f3812-ce41-44b9-85fa-2116556e771c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:14.202326 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9bfce-f6ff-43b6-8d0b-0193212fc770 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:14.240342 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2c442-152e-408b-b58d-bfdae8850996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:14.241366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2c442-152e-408b-b58d-bfdae8850996 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:14.241366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2c442-152e-408b-b58d-bfdae8850996 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:14.241552 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f2c442-152e-408b-b58d-bfdae8850996 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:14.242272 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2c442-152e-408b-b58d-bfdae8850996 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:14.242577 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2c442-152e-408b-b58d-bfdae8850996 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:14.244679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f2c442-152e-408b-b58d-bfdae8850996 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:14.253100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 434/861] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Jul 18 16:30:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:14.257102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2c442-152e-408b-b58d-bfdae8850996 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:14.263879 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f3812-ce41-44b9-85fa-2116556e771c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:14.286492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:14.302955 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431588e-eab9-4bac-b3c8-aadccad5a7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:14.309963 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431588e-eab9-4bac-b3c8-aadccad5a7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:14.309963 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431588e-eab9-4bac-b3c8-aadccad5a7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:14.309963 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431588e-eab9-4bac-b3c8-aadccad5a7c4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:14.313425 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e431588e-eab9-4bac-b3c8-aadccad5a7c4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:14.314888 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e431588e-eab9-4bac-b3c8-aadccad5a7c4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:14.330187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-e431588e-eab9-4bac-b3c8-aadccad5a7c4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:30:14.330187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:14.330187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:14.330187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:14.330187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:14.330187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:14.330187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:14.330187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:14.330187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:14.330187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:14.330187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:14.330187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:14.330187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:30:14.330187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:30:14.330187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:30:14.330187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:30:14.331170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:14.331170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:14.331170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:30:14.331170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:14.331170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:30:14.331170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:14.331170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:14.331170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:14.331170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:14.331170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:14.331170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:14.331170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:14.331170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:14.331170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:14.331170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:14.331170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:14.331170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:14.331170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:14.332124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:14.332124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:14.332124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:30:14.332124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:30:14.332124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:30:14.332124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:30:14.332124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:30:14.332124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:30:14.332124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:30:14.332124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:14.336380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 428/862] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Jul 18 16:30:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:14.337288 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431588e-eab9-4bac-b3c8-aadccad5a7c4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:14.371646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f2c442-152e-408b-b58d-bfdae8850996 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:14.382110 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:14.409101 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c177e60-5941-4e02-a029-c5f775402eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:14.410200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c177e60-5941-4e02-a029-c5f775402eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:14.410682 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c177e60-5941-4e02-a029-c5f775402eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:14.411193 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c177e60-5941-4e02-a029-c5f775402eb5 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:14.412112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c177e60-5941-4e02-a029-c5f775402eb5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:14.412678 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c177e60-5941-4e02-a029-c5f775402eb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:14.414264 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c177e60-5941-4e02-a029-c5f775402eb5 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:14.426066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 435/863] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Jul 18 16:30:14 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:14.455411 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431588e-eab9-4bac-b3c8-aadccad5a7c4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:14.502570 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77fe62-de33-4dbd-bf7b-db1576792853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:14.503305 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77fe62-de33-4dbd-bf7b-db1576792853 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:14.503592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77fe62-de33-4dbd-bf7b-db1576792853 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:14.503870 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77fe62-de33-4dbd-bf7b-db1576792853 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:14.504820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77fe62-de33-4dbd-bf7b-db1576792853 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:14.505171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77fe62-de33-4dbd-bf7b-db1576792853 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:14.506666 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77fe62-de33-4dbd-bf7b-db1576792853 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:14.529413 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 429/864] 10.222.0.76 () {56 vars in 1149 bytes} [Mon Jul 18 16:30:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:14.535149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c177e60-5941-4e02-a029-c5f775402eb5 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:14.654596 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c177e60-5941-4e02-a029-c5f775402eb5 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:14.690930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7039824-4fac-4f49-a75a-593ab7e29e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:14.691978 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7039824-4fac-4f49-a75a-593ab7e29e7e None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:14.692472 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7039824-4fac-4f49-a75a-593ab7e29e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:14.692958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7039824-4fac-4f49-a75a-593ab7e29e7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:14.727403 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:14.768769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7039824-4fac-4f49-a75a-593ab7e29e7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:14.770280 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7039824-4fac-4f49-a75a-593ab7e29e7e None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:14.777718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726270a5-eb30-4227-90e8-f809f1b1bd5f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:14.778815 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726270a5-eb30-4227-90e8-f809f1b1bd5f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:14.779304 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726270a5-eb30-4227-90e8-f809f1b1bd5f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:14.781245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 430/865] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:14.786434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e5875-f00f-48d5-858d-3a93a84c04ff None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:14.786727 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e5875-f00f-48d5-858d-3a93a84c04ff None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:14.787008 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e5875-f00f-48d5-858d-3a93a84c04ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:14.804381 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c15e5875-f00f-48d5-858d-3a93a84c04ff None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:14.805638 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c15e5875-f00f-48d5-858d-3a93a84c04ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:14.850366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:14.883675 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 436/866] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:30:14 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:30:14.891483 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7039824-4fac-4f49-a75a-593ab7e29e7e None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:14.901834 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 431/867] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:30:14.924640 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e5875-f00f-48d5-858d-3a93a84c04ff None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:14.977517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:15.028646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7039824-4fac-4f49-a75a-593ab7e29e7e None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:15.041517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e5875-f00f-48d5-858d-3a93a84c04ff None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:15.076435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f19d5c-2358-490e-bebd-ead1749caba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:15.077400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f19d5c-2358-490e-bebd-ead1749caba8 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:15.077748 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f19d5c-2358-490e-bebd-ead1749caba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:15.078102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f19d5c-2358-490e-bebd-ead1749caba8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:15.079324 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2eb27c-2d4b-4621-acc1-bfb36ac5bee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:15.080065 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2eb27c-2d4b-4621-acc1-bfb36ac5bee6 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:15.080426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2eb27c-2d4b-4621-acc1-bfb36ac5bee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:15.080778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2eb27c-2d4b-4621-acc1-bfb36ac5bee6 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:15.081621 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2eb27c-2d4b-4621-acc1-bfb36ac5bee6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:15.083076 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2eb27c-2d4b-4621-acc1-bfb36ac5bee6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:15.091004 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f19d5c-2358-490e-bebd-ead1749caba8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:15.092567 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f19d5c-2358-490e-bebd-ead1749caba8 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:15.112119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-d5f19d5c-2358-490e-bebd-ead1749caba8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:15.112119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:15.112119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:15.112119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:15.112119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:15.112119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:15.112119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:15.112119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:15.112119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:15.112119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:15.112119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:15.112119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:15.112119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:15.112119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:15.112119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:15.113553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:15.113553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:15.113553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:15.113553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:15.113553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:15.113553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:15.113553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:15.113553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:15.113553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:15.113553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:15.113553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:15.113553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:15.113553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:15.113553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:15.113553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:15.113553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:15.113553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:15.114876 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:15.114876 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:15.114876 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:15.114876 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:15.118152 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 437/868] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:15.118957 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f19d5c-2358-490e-bebd-ead1749caba8 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:15.189395 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 432/869] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 16:30:14 2022] POST /identity/v3/services => generated 251 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:30:15.247938 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f19d5c-2358-490e-bebd-ead1749caba8 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:15.268465 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:15.296483 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c310c-43ed-4562-941b-bc152b7ba810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:15.297205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c310c-43ed-4562-941b-bc152b7ba810 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:15.297492 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c310c-43ed-4562-941b-bc152b7ba810 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:15.297770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c310c-43ed-4562-941b-bc152b7ba810 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:15.298502 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c310c-43ed-4562-941b-bc152b7ba810 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:15.298808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c310c-43ed-4562-941b-bc152b7ba810 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:15.300207 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c310c-43ed-4562-941b-bc152b7ba810 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:15.314519 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 438/870] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:15.320131 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2eb27c-2d4b-4621-acc1-bfb36ac5bee6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:15.351672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:15.435515 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2eb27c-2d4b-4621-acc1-bfb36ac5bee6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:15.471488 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bd18f-5a13-466c-af6f-acd5f7b760aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:15.472302 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bd18f-5a13-466c-af6f-acd5f7b760aa None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:15.472592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bd18f-5a13-466c-af6f-acd5f7b760aa None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:15.472874 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770bd18f-5a13-466c-af6f-acd5f7b760aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:15.480895 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bd18f-5a13-466c-af6f-acd5f7b760aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:15.482660 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770bd18f-5a13-466c-af6f-acd5f7b760aa None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:15.499120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-770bd18f-5a13-466c-af6f-acd5f7b760aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:15.499120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:15.499120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:15.499120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:15.499120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:15.499120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:15.499120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:15.499120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:15.499120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:15.499120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:15.499120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:15.499120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:15.499120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:30:15.499120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:30:15.499120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:30:15.501200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:30:15.501200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:15.501200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:15.501200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:15.501200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:15.501200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:15.501200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:15.501200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:15.501200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:15.501200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:15.501200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:15.501200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:15.501200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:15.501200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:15.501200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:15.501200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:15.501200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:15.502873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:30:15.502873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:30:15.502873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:30:15.502873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:30:15.502873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:30:15.502873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:30:15.502873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:15.502873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:15.502873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 433/871] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:30:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:15.509260 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c310c-43ed-4562-941b-bc152b7ba810 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:15.625723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c310c-43ed-4562-941b-bc152b7ba810 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:15.661107 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4e0b6-3374-45c1-ac7a-9af507765c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:15.661790 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4e0b6-3374-45c1-ac7a-9af507765c9a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:15.662113 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4e0b6-3374-45c1-ac7a-9af507765c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:15.662370 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4e0b6-3374-45c1-ac7a-9af507765c9a None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:15.663135 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4e0b6-3374-45c1-ac7a-9af507765c9a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:15.663447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4e0b6-3374-45c1-ac7a-9af507765c9a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:15.664905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4e0b6-3374-45c1-ac7a-9af507765c9a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:15.678775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 439/872] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:30:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:15.685674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bd18f-5a13-466c-af6f-acd5f7b760aa None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:15.787876 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:15.801677 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770bd18f-5a13-466c-af6f-acd5f7b760aa None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:15.841877 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be77e4-80e0-41ce-8455-3c62ff76e800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:15.842547 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be77e4-80e0-41ce-8455-3c62ff76e800 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:15.842836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be77e4-80e0-41ce-8455-3c62ff76e800 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:15.843117 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be77e4-80e0-41ce-8455-3c62ff76e800 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:15.843962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be77e4-80e0-41ce-8455-3c62ff76e800 None admin] RBAC: Adding query filter params (role.id=ce6bff4fd8b6468b94dc4af858dde77b, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=ff65e481807b4344897b1499cd450f9d) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:15.844280 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be77e4-80e0-41ce-8455-3c62ff76e800 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:15.845875 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99be77e4-80e0-41ce-8455-3c62ff76e800 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:15.852601 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 434/873] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:30:15 2022] GET /identity/v3/role_assignments?user.id=ff65e481807b4344897b1499cd450f9d&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=ce6bff4fd8b6468b94dc4af858dde77b => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:15.900874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de17bc9-3478-4536-881b-b1e0d0bb37a5 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:15.902002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de17bc9-3478-4536-881b-b1e0d0bb37a5 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:15.902304 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de17bc9-3478-4536-881b-b1e0d0bb37a5 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:15.904112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 440/874] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:15.910338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d8b45-6a74-48cf-b92d-8298c511ce36 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:15.910900 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d8b45-6a74-48cf-b92d-8298c511ce36 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:15.910900 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d8b45-6a74-48cf-b92d-8298c511ce36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:15.933126 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c07d8b45-6a74-48cf-b92d-8298c511ce36 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:15.934513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c07d8b45-6a74-48cf-b92d-8298c511ce36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:16.016567 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 435/875] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:15 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:16.038419 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de17bc9-3478-4536-881b-b1e0d0bb37a5 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:16.074922 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:16.156041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de17bc9-3478-4536-881b-b1e0d0bb37a5 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:16.194029 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d5e19-2b73-4faf-8e23-d9ff2790079d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:16.194847 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d5e19-2b73-4faf-8e23-d9ff2790079d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:16.195129 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d5e19-2b73-4faf-8e23-d9ff2790079d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:16.195400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d5e19-2b73-4faf-8e23-d9ff2790079d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:16.196077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d5e19-2b73-4faf-8e23-d9ff2790079d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:16.197531 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d5e19-2b73-4faf-8e23-d9ff2790079d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:16.211270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-6c4d5e19-2b73-4faf-8e23-d9ff2790079d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:30:16.211270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:16.211270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:30:16.211270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:30:16.211270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:30:16.211270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:30:16.211270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:30:16.211270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:16.211270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:30:16.211270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:16.211270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:16.211270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:16.211270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:16.211270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:16.211270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:16.211270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:16.211270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:16.212294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:16.212294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:16.212294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:16.212294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:16.212294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:16.212294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:16.212294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:30:16.212294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:30:16.212294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:30:16.212294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:30:16.212294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:16.212294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:16.212294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:16.212294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:16.212294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:16.212294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:16.213648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:16.213648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:16.213648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:16.213648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:16.213648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:16.213648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:16.213648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:16.213648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:16.213648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:16.213648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:16.213648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:30:16.213648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:16.213648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:30:16.213648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:16.213648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 441/876] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Jul 18 16:30:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:16.220454 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d8b45-6a74-48cf-b92d-8298c511ce36 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:16.320197 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:16.339766 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d8b45-6a74-48cf-b92d-8298c511ce36 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:16.380618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074c213-6b40-4c40-8aa1-27327f9875e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:16.381335 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074c213-6b40-4c40-8aa1-27327f9875e1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:16.381622 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074c213-6b40-4c40-8aa1-27327f9875e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:16.381904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074c213-6b40-4c40-8aa1-27327f9875e1 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:16.382620 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074c213-6b40-4c40-8aa1-27327f9875e1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:16.382930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074c213-6b40-4c40-8aa1-27327f9875e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:16.384311 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074c213-6b40-4c40-8aa1-27327f9875e1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:16.389841 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 436/877] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Jul 18 16:30:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:16.395810 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d5e19-2b73-4faf-8e23-d9ff2790079d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:16.520166 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:16.527442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d5e19-2b73-4faf-8e23-d9ff2790079d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:16.564292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8b3a8-3585-4ba0-a3f6-f258d6f7b5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:16.564965 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8b3a8-3585-4ba0-a3f6-f258d6f7b5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:16.565263 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8b3a8-3585-4ba0-a3f6-f258d6f7b5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:16.565552 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8b3a8-3585-4ba0-a3f6-f258d6f7b5e4 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:16.566310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8b3a8-3585-4ba0-a3f6-f258d6f7b5e4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:16.566614 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8b3a8-3585-4ba0-a3f6-f258d6f7b5e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:16.568039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8b3a8-3585-4ba0-a3f6-f258d6f7b5e4 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:16.575489 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 442/878] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Jul 18 16:30:16 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:16.753835 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a6da8-d66a-4fa3-922f-0db83971637d None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:16.754249 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a6da8-d66a-4fa3-922f-0db83971637d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:16.754493 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a6da8-d66a-4fa3-922f-0db83971637d None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:16.756128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 437/879] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:30:16.762937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659aad02-22c5-4180-9837-56191d0a4922 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:16.763245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659aad02-22c5-4180-9837-56191d0a4922 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:16.763606 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659aad02-22c5-4180-9837-56191d0a4922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:16.782259 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-659aad02-22c5-4180-9837-56191d0a4922 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:16.783477 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-659aad02-22c5-4180-9837-56191d0a4922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:16.865224 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 443/880] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:16 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:16.880749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a6da8-d66a-4fa3-922f-0db83971637d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:16.995333 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a6da8-d66a-4fa3-922f-0db83971637d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:17.032939 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d58928e-168c-408b-a1f7-4e3323012d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:17.033648 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58928e-168c-408b-a1f7-4e3323012d36 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:17.033938 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58928e-168c-408b-a1f7-4e3323012d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:17.034219 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d58928e-168c-408b-a1f7-4e3323012d36 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:17.034956 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58928e-168c-408b-a1f7-4e3323012d36 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:17.036425 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d58928e-168c-408b-a1f7-4e3323012d36 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:17.152890 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 438/881] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 16:30:16 2022] POST /identity/v3/services => generated 269 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:30:17.487242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aebe27-f01f-4130-a8ce-9221cd665436 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:17.487750 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aebe27-f01f-4130-a8ce-9221cd665436 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:17.487750 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aebe27-f01f-4130-a8ce-9221cd665436 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:17.489396 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 444/882] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:17.494929 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed5522-61a6-4c4c-9455-0b5b0f04708e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:17.495812 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed5522-61a6-4c4c-9455-0b5b0f04708e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:17.496317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ed5522-61a6-4c4c-9455-0b5b0f04708e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:17.508825 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:17.514554 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-63ed5522-61a6-4c4c-9455-0b5b0f04708e None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:17.515749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-63ed5522-61a6-4c4c-9455-0b5b0f04708e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:17.593508 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 439/883] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:17 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:17.616616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aebe27-f01f-4130-a8ce-9221cd665436 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:17.715036 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:17.725613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aebe27-f01f-4130-a8ce-9221cd665436 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:17.767280 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1cbeee-cc1e-494d-af05-9498072d3ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:17.768123 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cbeee-cc1e-494d-af05-9498072d3ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:17.768406 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cbeee-cc1e-494d-af05-9498072d3ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:17.768680 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cbeee-cc1e-494d-af05-9498072d3ca3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:17.769398 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1cbeee-cc1e-494d-af05-9498072d3ca3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:17.770800 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1cbeee-cc1e-494d-af05-9498072d3ca3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:17.784764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-ee1cbeee-cc1e-494d-af05-9498072d3ca3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 16:30:17.784764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:17.784764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:30:17.784764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:30:17.784764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:30:17.784764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:30:17.784764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:30:17.784764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:17.784764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 16:30:17.784764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:17.784764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:17.784764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:17.784764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:17.784764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:17.784764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:17.784764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:17.784764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:17.785937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:17.785937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:17.785937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:17.785937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:17.785937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:17.785937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:17.785937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:30:17.785937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:30:17.785937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:30:17.785937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:30:17.785937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:17.785937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:17.785937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:17.785937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:17.785937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:17.785937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:17.787495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:17.787495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:17.787495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:17.787495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:17.787495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:17.787495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:17.787495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:17.787495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:17.787495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:17.787495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:17.787495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:30:17.787495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:17.787495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 16:30:17.787495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:17.787495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 445/884] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 16:30:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:17.794126 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed5522-61a6-4c4c-9455-0b5b0f04708e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:17.903296 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ed5522-61a6-4c4c-9455-0b5b0f04708e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:17.937438 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:17.941811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76a08e-3c8f-4547-969b-d4d21dfb4779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:17.942362 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76a08e-3c8f-4547-969b-d4d21dfb4779 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:17.942697 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76a08e-3c8f-4547-969b-d4d21dfb4779 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:17.942975 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c76a08e-3c8f-4547-969b-d4d21dfb4779 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:17.943702 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76a08e-3c8f-4547-969b-d4d21dfb4779 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:17.944003 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76a08e-3c8f-4547-969b-d4d21dfb4779 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:17.945412 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c76a08e-3c8f-4547-969b-d4d21dfb4779 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:17.951520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 440/885] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 16:30:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:17.957634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1cbeee-cc1e-494d-af05-9498072d3ca3 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:18.064438 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1cbeee-cc1e-494d-af05-9498072d3ca3 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:18.099656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c65d6-cb7c-4b27-af95-243de687ad90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:18.100340 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c65d6-cb7c-4b27-af95-243de687ad90 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:18.100623 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c65d6-cb7c-4b27-af95-243de687ad90 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:18.100959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c65d6-cb7c-4b27-af95-243de687ad90 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:18.101713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c65d6-cb7c-4b27-af95-243de687ad90 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:18.102022 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c65d6-cb7c-4b27-af95-243de687ad90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:18.103464 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c65d6-cb7c-4b27-af95-243de687ad90 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:18.109414 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 446/886] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 16:30:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:18.115195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76a08e-3c8f-4547-969b-d4d21dfb4779 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:18.193686 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b045c65-77d1-4890-8984-883e9b23299d None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:18.194013 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b045c65-77d1-4890-8984-883e9b23299d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:18.194265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b045c65-77d1-4890-8984-883e9b23299d None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:18.195911 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 447/887] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:18.201707 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7d895-b985-48dd-a01f-3bb65207e0f8 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:18.202002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7d895-b985-48dd-a01f-3bb65207e0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:18.202289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7d895-b985-48dd-a01f-3bb65207e0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:18.219412 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-10c7d895-b985-48dd-a01f-3bb65207e0f8 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:18.220618 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-10c7d895-b985-48dd-a01f-3bb65207e0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:18.225491 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c76a08e-3c8f-4547-969b-d4d21dfb4779 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:18.237417 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:18.265157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6915d-2b77-4ea0-872c-367173b9cdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:18.265842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6915d-2b77-4ea0-872c-367173b9cdc3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:18.266132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6915d-2b77-4ea0-872c-367173b9cdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:18.266464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6915d-2b77-4ea0-872c-367173b9cdc3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:18.267226 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6915d-2b77-4ea0-872c-367173b9cdc3 None admin] RBAC: Adding query filter params (interface=public, service_id=acd79302ebc94887a740e9c69e0a3fe0, region_id=RegionOne) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:18.267545 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6915d-2b77-4ea0-872c-367173b9cdc3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:18.269092 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6915d-2b77-4ea0-872c-367173b9cdc3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:18.279740 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 441/888] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Jul 18 16:30:18 2022] GET /identity/v3/endpoints?service_id=acd79302ebc94887a740e9c69e0a3fe0&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:18.280708 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6915d-2b77-4ea0-872c-367173b9cdc3 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:18.309150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 448/889] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:30:18.326958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7d895-b985-48dd-a01f-3bb65207e0f8 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:18.345158 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:18.389730 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6915d-2b77-4ea0-872c-367173b9cdc3 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:18.427651 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a124f2-e5c7-4d57-ad08-039cf81a0924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:18.428724 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a124f2-e5c7-4d57-ad08-039cf81a0924 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:18.429240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a124f2-e5c7-4d57-ad08-039cf81a0924 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:18.429722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a124f2-e5c7-4d57-ad08-039cf81a0924 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:18.430615 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a124f2-e5c7-4d57-ad08-039cf81a0924 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:18.432190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a124f2-e5c7-4d57-ad08-039cf81a0924 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:18.436562 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7d895-b985-48dd-a01f-3bb65207e0f8 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:18.439706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 442/890] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Jul 18 16:30:18 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:30:18.481882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163e3f0-f006-4c33-98da-37f298ae6708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:18.483144 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163e3f0-f006-4c33-98da-37f298ae6708 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:18.483635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163e3f0-f006-4c33-98da-37f298ae6708 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:18.484134 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9163e3f0-f006-4c33-98da-37f298ae6708 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:18.501724 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9163e3f0-f006-4c33-98da-37f298ae6708 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:30:18.511728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-9163e3f0-f006-4c33-98da-37f298ae6708 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:30:18.511728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:18.511728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:18.511728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:18.511728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:18.511728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:18.511728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:18.511728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:18.511728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:18.511728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:18.511728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:18.511728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:18.511728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:30:18.511728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:30:18.511728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:30:18.511728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:30:18.512765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:30:18.512765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:30:18.512765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:30:18.512765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:30:18.512765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:18.512765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:18.512765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:18.512765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:18.512765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:18.512765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:18.512765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:18.512765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:18.512765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:18.512765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:18.512765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:18.512765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:18.513650 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:18.513650 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:18.513650 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:18.513650 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:18.513650 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:30:18.513650 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:30:18.513650 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:30:18.513650 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:30:18.513650 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:30:18.513650 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:30:18.513650 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:30:18.513650 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:18.516669 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 449/891] 10.222.0.76 () {56 vars in 1120 bytes} [Mon Jul 18 16:30:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:18.522708 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a124f2-e5c7-4d57-ad08-039cf81a0924 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:18.642784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a124f2-e5c7-4d57-ad08-039cf81a0924 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:18.668611 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:18.679617 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cfe6b-6a29-4ff6-aeb9-ffe96cd907bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:18.680309 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cfe6b-6a29-4ff6-aeb9-ffe96cd907bb None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:18.680598 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cfe6b-6a29-4ff6-aeb9-ffe96cd907bb None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:18.680879 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cfe6b-6a29-4ff6-aeb9-ffe96cd907bb None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:18.681786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cfe6b-6a29-4ff6-aeb9-ffe96cd907bb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:18.682102 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cfe6b-6a29-4ff6-aeb9-ffe96cd907bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:18.684314 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cfe6b-6a29-4ff6-aeb9-ffe96cd907bb None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:18.693437 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 443/892] 10.222.0.76 () {56 vars in 1115 bytes} [Mon Jul 18 16:30:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:18.700059 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163e3f0-f006-4c33-98da-37f298ae6708 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:18.712530 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:18.725969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc2f49-c28a-431f-822f-dde4980273fe None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:18.726267 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc2f49-c28a-431f-822f-dde4980273fe None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:18.726868 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc2f49-c28a-431f-822f-dde4980273fe None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:18.728897 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 444/893] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:30:18.734693 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b6621-42e2-4154-a275-25848aa05113 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:18.734985 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b6621-42e2-4154-a275-25848aa05113 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:18.735267 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b6621-42e2-4154-a275-25848aa05113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:18.759399 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c86b6621-42e2-4154-a275-25848aa05113 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:18.762240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c86b6621-42e2-4154-a275-25848aa05113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:18.832191 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9163e3f0-f006-4c33-98da-37f298ae6708 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:18.861036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 445/894] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:18.874177 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b783a63-1c72-4d16-abe5-4d674913c9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:18.874985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b783a63-1c72-4d16-abe5-4d674913c9ae None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:18.875317 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b783a63-1c72-4d16-abe5-4d674913c9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:18.875597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b783a63-1c72-4d16-abe5-4d674913c9ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:18.880433 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b6621-42e2-4154-a275-25848aa05113 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:18.890010 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b783a63-1c72-4d16-abe5-4d674913c9ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:18.892099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b783a63-1c72-4d16-abe5-4d674913c9ae None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:18.914133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-0b783a63-1c72-4d16-abe5-4d674913c9ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:18.914133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:18.914133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:18.914133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:18.914133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:18.914133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:18.914133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:18.914133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:18.914133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:18.914133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:18.914133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:18.914133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:18.914133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:18.914133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:18.914133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:18.915069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:18.915069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:18.915069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:18.915069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:18.915069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:18.915069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:18.915069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:18.915069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:18.915069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:18.915069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:18.915069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:18.915069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:18.915069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:18.915069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:18.915069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:18.915069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:18.915069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:18.916038 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:18.916038 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:18.916038 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:18.916038 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:18.923034 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 450/895] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:18.924191 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b783a63-1c72-4d16-abe5-4d674913c9ae None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:18.993083 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:18.999026 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b6621-42e2-4154-a275-25848aa05113 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:19.017829 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:19.037096 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94222c2-ee67-4b08-b4c5-aa1e6c53d03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:19.037792 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94222c2-ee67-4b08-b4c5-aa1e6c53d03f None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:19.038384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94222c2-ee67-4b08-b4c5-aa1e6c53d03f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:19.038668 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94222c2-ee67-4b08-b4c5-aa1e6c53d03f None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:19.039469 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94222c2-ee67-4b08-b4c5-aa1e6c53d03f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:19.041372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94222c2-ee67-4b08-b4c5-aa1e6c53d03f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:19.051092 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b783a63-1c72-4d16-abe5-4d674913c9ae None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:19.088240 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f028a-fec6-492d-88cd-2072aee1b8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:19.089928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f028a-fec6-492d-88cd-2072aee1b8ed None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:19.090296 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f028a-fec6-492d-88cd-2072aee1b8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:19.090589 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f028a-fec6-492d-88cd-2072aee1b8ed None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:19.091341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f028a-fec6-492d-88cd-2072aee1b8ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:19.091653 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f028a-fec6-492d-88cd-2072aee1b8ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:19.093066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f028a-fec6-492d-88cd-2072aee1b8ed None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:19.105854 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 451/896] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:19.111166 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f028a-fec6-492d-88cd-2072aee1b8ed None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:19.123719 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 446/897] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 16:30:18 2022] POST /identity/v3/services => generated 241 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:30:19.243408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f028a-fec6-492d-88cd-2072aee1b8ed None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:19.268383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:19.291307 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24522164-b24a-4df5-b548-b7c60199dd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:19.292345 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24522164-b24a-4df5-b548-b7c60199dd18 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:19.292685 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24522164-b24a-4df5-b548-b7c60199dd18 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:19.292911 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24522164-b24a-4df5-b548-b7c60199dd18 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:19.300601 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24522164-b24a-4df5-b548-b7c60199dd18 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:19.302089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24522164-b24a-4df5-b548-b7c60199dd18 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:19.317770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-24522164-b24a-4df5-b548-b7c60199dd18 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:30:19.317770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:19.317770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:19.317770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:19.317770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:19.317770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:19.317770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:19.317770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:19.317770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:19.317770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:19.317770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:19.317770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:19.317770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:30:19.317770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:30:19.317770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:30:19.317770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:30:19.318834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:19.318834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:19.318834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:30:19.318834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:19.318834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:30:19.318834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:19.318834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:19.318834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:19.318834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:19.318834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:19.318834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:19.318834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:19.318834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:19.318834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:19.318834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:19.318834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:19.318834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:19.318834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:19.319786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:19.319786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:19.319786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:30:19.319786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:30:19.319786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:30:19.319786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:30:19.319786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:30:19.319786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:30:19.319786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:30:19.319786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:19.324553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 452/898] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Jul 18 16:30:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:19.331159 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94222c2-ee67-4b08-b4c5-aa1e6c53d03f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:19.366166 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc03181-9d7d-4132-9f4d-7139569e3092 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:19.366490 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc03181-9d7d-4132-9f4d-7139569e3092 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:19.366728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc03181-9d7d-4132-9f4d-7139569e3092 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:19.368355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 453/899] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:30:19.376276 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9646fa-482d-4ac7-a0cc-dd49d898fc24 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:19.376567 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9646fa-482d-4ac7-a0cc-dd49d898fc24 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:19.376851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9646fa-482d-4ac7-a0cc-dd49d898fc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:19.394805 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-dc9646fa-482d-4ac7-a0cc-dd49d898fc24 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:19.396018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-dc9646fa-482d-4ac7-a0cc-dd49d898fc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:19.461178 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94222c2-ee67-4b08-b4c5-aa1e6c53d03f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:19.476877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 454/900] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:30:19.500429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9646fa-482d-4ac7-a0cc-dd49d898fc24 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:19.504688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c7aac-2296-41e7-8371-a34186b3f4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:19.505625 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c7aac-2296-41e7-8371-a34186b3f4ba None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:19.506129 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c7aac-2296-41e7-8371-a34186b3f4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:19.506598 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957c7aac-2296-41e7-8371-a34186b3f4ba None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:19.507639 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c7aac-2296-41e7-8371-a34186b3f4ba None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:19.508137 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c7aac-2296-41e7-8371-a34186b3f4ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:19.511085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957c7aac-2296-41e7-8371-a34186b3f4ba None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:19.538014 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 447/901] 10.222.0.76 () {56 vars in 1149 bytes} [Mon Jul 18 16:30:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:19.544203 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c7aac-2296-41e7-8371-a34186b3f4ba None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:19.596254 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:19.620147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9646fa-482d-4ac7-a0cc-dd49d898fc24 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:19.629155 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:19.665373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb1970-237a-4d82-9646-a5bcc977f45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:19.666775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb1970-237a-4d82-9646-a5bcc977f45a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:19.667273 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb1970-237a-4d82-9646-a5bcc977f45a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:19.667736 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb1970-237a-4d82-9646-a5bcc977f45a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:19.668734 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb1970-237a-4d82-9646-a5bcc977f45a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:19.670454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb1970-237a-4d82-9646-a5bcc977f45a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:19.684386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-7abb1970-237a-4d82-9646-a5bcc977f45a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 16:30:19.684386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:19.684386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:30:19.684386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:30:19.684386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:30:19.684386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:30:19.684386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:30:19.684386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:19.684386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 16:30:19.684386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:19.684386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:19.684386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:19.684386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:19.684386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:19.684386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:19.684386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:19.685397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:19.685397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:19.685397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:19.685397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:19.685397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:19.685397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:19.685397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:19.685397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:30:19.685397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:30:19.685397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:30:19.685397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:30:19.685397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:19.685397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:19.685397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:19.685397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:19.685397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:19.686257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:19.686257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:19.686257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:19.686257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:19.686257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:19.686257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:19.686257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:19.686257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:19.686257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:19.686257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:19.686257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:19.686257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:30:19.686257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:19.686257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 16:30:19.686257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:19.689233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 455/902] 10.222.0.76 () {56 vars in 1132 bytes} [Mon Jul 18 16:30:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:19.694727 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb1970-237a-4d82-9646-a5bcc977f45a None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:19.698430 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957c7aac-2296-41e7-8371-a34186b3f4ba None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:19.739059 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ff25d-77bf-49f7-9647-c5493afb6938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:19.740070 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ff25d-77bf-49f7-9647-c5493afb6938 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:19.740574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ff25d-77bf-49f7-9647-c5493afb6938 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:19.741089 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ff25d-77bf-49f7-9647-c5493afb6938 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:19.821918 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb1970-237a-4d82-9646-a5bcc977f45a None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:19.827949 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ff25d-77bf-49f7-9647-c5493afb6938 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:19.829456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ff25d-77bf-49f7-9647-c5493afb6938 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:19.860409 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc79d65-8cc8-44dd-ae5a-a5009689bac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:19.861560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc79d65-8cc8-44dd-ae5a-a5009689bac1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:19.862111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc79d65-8cc8-44dd-ae5a-a5009689bac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:19.862605 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc79d65-8cc8-44dd-ae5a-a5009689bac1 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:19.863522 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc79d65-8cc8-44dd-ae5a-a5009689bac1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:19.864033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc79d65-8cc8-44dd-ae5a-a5009689bac1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:19.865003 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:19.866267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc79d65-8cc8-44dd-ae5a-a5009689bac1 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:19.873194 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 456/903] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Jul 18 16:30:19 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:19.883527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc79d65-8cc8-44dd-ae5a-a5009689bac1 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:19.936750 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:19.956954 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 448/904] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:30:19 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:30:19.962612 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ff25d-77bf-49f7-9647-c5493afb6938 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:20.029438 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc79d65-8cc8-44dd-ae5a-a5009689bac1 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:20.077423 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2bf5b-f3cd-4d86-9acc-11bede8487b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:20.078832 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2bf5b-f3cd-4d86-9acc-11bede8487b7 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:20.079553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2bf5b-f3cd-4d86-9acc-11bede8487b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:20.080044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2bf5b-f3cd-4d86-9acc-11bede8487b7 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:20.081723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2bf5b-f3cd-4d86-9acc-11bede8487b7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:20.082230 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2bf5b-f3cd-4d86-9acc-11bede8487b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:20.084888 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2bf5b-f3cd-4d86-9acc-11bede8487b7 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:20.088807 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ff25d-77bf-49f7-9647-c5493afb6938 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:20.097455 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 457/905] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Jul 18 16:30:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:20.100146 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2bf5b-f3cd-4d86-9acc-11bede8487b7 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:20.131431 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd561117-8183-49e7-887f-82135cc1e8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:20.132240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd561117-8183-49e7-887f-82135cc1e8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:20.132528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd561117-8183-49e7-887f-82135cc1e8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:20.132806 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd561117-8183-49e7-887f-82135cc1e8a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:20.135701 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:20.149242 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd561117-8183-49e7-887f-82135cc1e8a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:20.152284 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd561117-8183-49e7-887f-82135cc1e8a5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:20.187434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-bd561117-8183-49e7-887f-82135cc1e8a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:20.187434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:20.187434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:20.187434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:20.187434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:20.187434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:20.187434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:20.187434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:20.187434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:20.187434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:20.187434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:20.187434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:20.187434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:20.187434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:20.187434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:20.188446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:20.188446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:20.188446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:20.188446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:20.188446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:20.188446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:20.188446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:20.188446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:20.188446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:20.188446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:20.188446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:20.188446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:20.188446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:20.188446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:20.188446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:20.188446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:20.188446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:20.189401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:20.189401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:20.189401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:20.189401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:20.195678 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 449/906] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:20.197297 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd561117-8183-49e7-887f-82135cc1e8a5 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:20.238192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:20.242925 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2bf5b-f3cd-4d86-9acc-11bede8487b7 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:20.279105 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b36640-3cf1-4eb9-931b-216f3a2bdf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:20.280196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b36640-3cf1-4eb9-931b-216f3a2bdf42 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:20.280696 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b36640-3cf1-4eb9-931b-216f3a2bdf42 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:20.281199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b36640-3cf1-4eb9-931b-216f3a2bdf42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:20.282204 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b36640-3cf1-4eb9-931b-216f3a2bdf42 None admin] RBAC: Adding query filter params (interface=public, service_id=b5b817c559e6490b9c170b8d3c65fa3c, region_id=RegionOne) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:20.282742 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b36640-3cf1-4eb9-931b-216f3a2bdf42 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:20.284319 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b36640-3cf1-4eb9-931b-216f3a2bdf42 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:20.291656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 458/907] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Jul 18 16:30:20 2022] GET /identity/v3/endpoints?service_id=b5b817c559e6490b9c170b8d3c65fa3c&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:20.298081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b36640-3cf1-4eb9-931b-216f3a2bdf42 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:20.314365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd561117-8183-49e7-887f-82135cc1e8a5 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:20.351029 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b4687-f57a-4269-ac0d-a93e120d8032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:20.351726 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b4687-f57a-4269-ac0d-a93e120d8032 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:20.352016 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b4687-f57a-4269-ac0d-a93e120d8032 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:20.352299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b4687-f57a-4269-ac0d-a93e120d8032 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:20.353113 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b4687-f57a-4269-ac0d-a93e120d8032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:20.353434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b4687-f57a-4269-ac0d-a93e120d8032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:20.355479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80b4687-f57a-4269-ac0d-a93e120d8032 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:20.369594 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 450/908] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:20.375112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b4687-f57a-4269-ac0d-a93e120d8032 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:20.429346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b36640-3cf1-4eb9-931b-216f3a2bdf42 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:20.436427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:20.478028 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467a077-5d93-4ae3-83df-d3f7b4895de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:20.479683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467a077-5d93-4ae3-83df-d3f7b4895de7 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:20.480754 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467a077-5d93-4ae3-83df-d3f7b4895de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:20.481675 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467a077-5d93-4ae3-83df-d3f7b4895de7 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:20.482602 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467a077-5d93-4ae3-83df-d3f7b4895de7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:20.484959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a467a077-5d93-4ae3-83df-d3f7b4895de7 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:20.492206 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b4687-f57a-4269-ac0d-a93e120d8032 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:20.494795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 459/909] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Jul 18 16:30:20 2022] GET /identity/v3/services => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:30:20.539829 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ddc06-1c17-4076-8886-8122d6f1bead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:20.541371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ddc06-1c17-4076-8886-8122d6f1bead None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:20.542565 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ddc06-1c17-4076-8886-8122d6f1bead None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:20.543240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ddc06-1c17-4076-8886-8122d6f1bead None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:20.551983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ddc06-1c17-4076-8886-8122d6f1bead None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:20.553954 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4ddc06-1c17-4076-8886-8122d6f1bead None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:20.570944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-8f4ddc06-1c17-4076-8886-8122d6f1bead None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:20.570944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:20.570944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:20.570944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:20.570944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:20.570944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:20.570944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:20.570944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:20.570944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:20.570944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:20.570944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:20.570944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:20.570944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:30:20.570944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:30:20.570944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:30:20.571904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:30:20.571904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:20.571904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:20.571904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:20.571904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:20.571904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:20.571904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:20.571904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:20.571904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:20.571904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:20.571904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:20.571904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:20.571904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:20.571904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:20.571904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:20.571904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:20.571904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:20.573466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:30:20.573466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:30:20.573466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:30:20.573466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:30:20.573466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:30:20.573466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:30:20.573466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:20.573466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:20.580328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 451/910] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:30:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:20.587264 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467a077-5d93-4ae3-83df-d3f7b4895de7 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:20.594687 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407306e3-abf2-4635-b1fb-92840fedc21c None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:20.595010 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407306e3-abf2-4635-b1fb-92840fedc21c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:20.595258 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407306e3-abf2-4635-b1fb-92840fedc21c None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:20.597344 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 452/911] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:20.603681 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a962a91-250d-4de6-8fb8-b663d0438eb7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:20.604155 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a962a91-250d-4de6-8fb8-b663d0438eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:20.604331 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a962a91-250d-4de6-8fb8-b663d0438eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:20.625656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2a962a91-250d-4de6-8fb8-b663d0438eb7 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:20.641272 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:20.641758 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2a962a91-250d-4de6-8fb8-b663d0438eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:20.716891 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 453/912] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:30:20.730774 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467a077-5d93-4ae3-83df-d3f7b4895de7 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:20.740421 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a962a91-250d-4de6-8fb8-b663d0438eb7 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:20.779069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1055914-0be2-4334-80fc-e675e2d6d978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:20.780323 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1055914-0be2-4334-80fc-e675e2d6d978 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:20.780930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1055914-0be2-4334-80fc-e675e2d6d978 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:20.781770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1055914-0be2-4334-80fc-e675e2d6d978 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:20.783766 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1055914-0be2-4334-80fc-e675e2d6d978 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:20.784280 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1055914-0be2-4334-80fc-e675e2d6d978 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:20.785926 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1055914-0be2-4334-80fc-e675e2d6d978 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:20.789443 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:20.807639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 460/913] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:30:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:20.811041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1055914-0be2-4334-80fc-e675e2d6d978 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:20.868996 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a962a91-250d-4de6-8fb8-b663d0438eb7 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:20.916607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06cdd1-c83b-43be-a8dc-2252636e7e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:20.918248 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06cdd1-c83b-43be-a8dc-2252636e7e73 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:20.918646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06cdd1-c83b-43be-a8dc-2252636e7e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:20.919003 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06cdd1-c83b-43be-a8dc-2252636e7e73 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:20.919748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06cdd1-c83b-43be-a8dc-2252636e7e73 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:20.921911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06cdd1-c83b-43be-a8dc-2252636e7e73 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:20.928530 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:20.938799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-be06cdd1-c83b-43be-a8dc-2252636e7e73 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 16:30:20.938799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:20.938799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:30:20.938799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:30:20.938799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:30:20.938799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:30:20.938799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:30:20.938799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:20.938799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 16:30:20.938799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:20.938799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:20.938799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:20.938799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:20.938799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:20.938799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:20.938799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:20.938799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:20.946403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:20.946403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:20.946403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:20.946403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:20.946403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:20.946403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:20.946403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:30:20.946403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:30:20.946403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:30:20.946403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:30:20.946403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:20.946403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:20.946403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:20.946403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:20.946403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:20.946403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:20.947375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:20.947375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:20.947375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:20.947375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:20.947375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:20.947375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:20.947375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:20.947375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:20.947375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:20.947375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:20.947375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:30:20.947375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:20.947375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 18 16:30:20.947375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:20.949815 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 454/914] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 16:30:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:20.952335 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06cdd1-c83b-43be-a8dc-2252636e7e73 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:20.956958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1055914-0be2-4334-80fc-e675e2d6d978 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:21.004146 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757660c-0754-441b-8870-13cb27acf7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:21.004848 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757660c-0754-441b-8870-13cb27acf7cb None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:21.005165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757660c-0754-441b-8870-13cb27acf7cb None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:21.005442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757660c-0754-441b-8870-13cb27acf7cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:21.006279 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757660c-0754-441b-8870-13cb27acf7cb None admin] RBAC: Adding query filter params (role.id=96360c5874dd4a1f87b4695f1088f5b1, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=ff65e481807b4344897b1499cd450f9d) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:21.006591 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757660c-0754-441b-8870-13cb27acf7cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:21.008646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8757660c-0754-441b-8870-13cb27acf7cb None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:21.016119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 461/915] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:30:20 2022] GET /identity/v3/role_assignments?user.id=ff65e481807b4344897b1499cd450f9d&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=96360c5874dd4a1f87b4695f1088f5b1 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:21.081435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:21.084857 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06cdd1-c83b-43be-a8dc-2252636e7e73 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:21.123974 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6445a2e-08f3-4390-a20b-dc49923cac02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:21.125106 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6445a2e-08f3-4390-a20b-dc49923cac02 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:21.125944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6445a2e-08f3-4390-a20b-dc49923cac02 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:21.126226 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6445a2e-08f3-4390-a20b-dc49923cac02 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:21.126972 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6445a2e-08f3-4390-a20b-dc49923cac02 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:21.127284 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6445a2e-08f3-4390-a20b-dc49923cac02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:21.128708 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6445a2e-08f3-4390-a20b-dc49923cac02 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:21.134518 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 455/916] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 16:30:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:21.141254 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757660c-0754-441b-8870-13cb27acf7cb None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:21.258630 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757660c-0754-441b-8870-13cb27acf7cb None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:21.297408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2912e7b-115b-461d-a84a-3343e172f901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:21.298088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2912e7b-115b-461d-a84a-3343e172f901 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:21.298368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2912e7b-115b-461d-a84a-3343e172f901 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:21.298648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2912e7b-115b-461d-a84a-3343e172f901 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:21.299375 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2912e7b-115b-461d-a84a-3343e172f901 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:21.299685 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2912e7b-115b-461d-a84a-3343e172f901 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:21.301076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2912e7b-115b-461d-a84a-3343e172f901 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:21.306905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 462/917] 10.222.0.76 () {56 vars in 1114 bytes} [Mon Jul 18 16:30:21 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:21.312851 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6445a2e-08f3-4390-a20b-dc49923cac02 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:21.314782 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa9bbb-0d46-4d00-b6dd-58eb40c217f4 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:21.315072 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa9bbb-0d46-4d00-b6dd-58eb40c217f4 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:21.315353 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa9bbb-0d46-4d00-b6dd-58eb40c217f4 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:21.316815 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 463/918] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:21.322163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef5c4c-fe10-4a69-895c-7652b2f46c98 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:21.322454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef5c4c-fe10-4a69-895c-7652b2f46c98 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:21.322773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef5c4c-fe10-4a69-895c-7652b2f46c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:21.340780 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-49ef5c4c-fe10-4a69-895c-7652b2f46c98 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:21.341927 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-49ef5c4c-fe10-4a69-895c-7652b2f46c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:21.353659 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:21.431379 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 464/919] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:30:21.436729 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6445a2e-08f3-4390-a20b-dc49923cac02 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:21.448853 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef5c4c-fe10-4a69-895c-7652b2f46c98 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:21.474712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b548e5a-7edc-411c-bb2c-9890dc1d5d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:21.475702 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b548e5a-7edc-411c-bb2c-9890dc1d5d8f None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:21.476285 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b548e5a-7edc-411c-bb2c-9890dc1d5d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:21.476914 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b548e5a-7edc-411c-bb2c-9890dc1d5d8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:21.477845 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b548e5a-7edc-411c-bb2c-9890dc1d5d8f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:21.480244 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b548e5a-7edc-411c-bb2c-9890dc1d5d8f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:21.556208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef5c4c-fe10-4a69-895c-7652b2f46c98 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:21.578448 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 456/920] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Jul 18 16:30:21 2022] POST /identity/v3/endpoints => generated 346 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:30:21.609373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb375f0-cc05-4158-8eb5-c5426fee3383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:21.610195 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb375f0-cc05-4158-8eb5-c5426fee3383 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:21.610480 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb375f0-cc05-4158-8eb5-c5426fee3383 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:21.610758 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb375f0-cc05-4158-8eb5-c5426fee3383 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:21.611436 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb375f0-cc05-4158-8eb5-c5426fee3383 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:21.612935 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb375f0-cc05-4158-8eb5-c5426fee3383 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:21.627595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-0cb375f0-cc05-4158-8eb5-c5426fee3383 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:30:21.627595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:21.627595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:30:21.627595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:30:21.627595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:30:21.627595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:30:21.627595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:30:21.627595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:21.627595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:30:21.627595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:21.627595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:21.627595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:21.627595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:21.627595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:21.627595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:21.627595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:21.627595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:21.632292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:21.632292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:21.632292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:21.632292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:21.632292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:21.632292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:21.632292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:30:21.632292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:30:21.632292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:30:21.632292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:30:21.632292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:21.632292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:21.632292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:21.632292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:21.632292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:21.632292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:21.633198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:21.633198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:21.633198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:21.633198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:21.633198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:21.633198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:21.633198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:21.633198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:21.633198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:21.633198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:21.633198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:30:21.633198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:21.633198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:30:21.633198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:21.634694 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 465/921] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Jul 18 16:30:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:21.636630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b548e5a-7edc-411c-bb2c-9890dc1d5d8f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:21.663412 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:21.763320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b548e5a-7edc-411c-bb2c-9890dc1d5d8f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:21.805418 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317630d-b477-4f10-bd3e-27d54fa571d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:21.806109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317630d-b477-4f10-bd3e-27d54fa571d7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:21.806400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317630d-b477-4f10-bd3e-27d54fa571d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:21.806682 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317630d-b477-4f10-bd3e-27d54fa571d7 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:21.807478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317630d-b477-4f10-bd3e-27d54fa571d7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:21.807792 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317630d-b477-4f10-bd3e-27d54fa571d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:21.809216 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317630d-b477-4f10-bd3e-27d54fa571d7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:21.814916 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 457/922] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Jul 18 16:30:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:21.820566 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb375f0-cc05-4158-8eb5-c5426fee3383 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:21.825089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:21.929124 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb375f0-cc05-4158-8eb5-c5426fee3383 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:21.965236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5f9f5-3d21-41ca-a3a4-253ccdd55945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:21.965921 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5f9f5-3d21-41ca-a3a4-253ccdd55945 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:21.966208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5f9f5-3d21-41ca-a3a4-253ccdd55945 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:21.966487 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5f9f5-3d21-41ca-a3a4-253ccdd55945 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:21.967202 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5f9f5-3d21-41ca-a3a4-253ccdd55945 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:21.967517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5f9f5-3d21-41ca-a3a4-253ccdd55945 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:21.968887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5f9f5-3d21-41ca-a3a4-253ccdd55945 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:21.974317 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 466/923] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Jul 18 16:30:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:21.980716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317630d-b477-4f10-bd3e-27d54fa571d7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:22.070522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:22.085900 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317630d-b477-4f10-bd3e-27d54fa571d7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:22.123843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f97fc-ec19-4961-939b-45e72c2b6a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:22.124526 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f97fc-ec19-4961-939b-45e72c2b6a91 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:22.124814 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f97fc-ec19-4961-939b-45e72c2b6a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:22.125125 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f97fc-ec19-4961-939b-45e72c2b6a91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:22.125932 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f97fc-ec19-4961-939b-45e72c2b6a91 None admin] RBAC: Adding query filter params (interface=public, service_id=8210e08c11004da5bd8964a694728d5e, region_id=RegionOne) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:22.126251 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f97fc-ec19-4961-939b-45e72c2b6a91 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:22.127634 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f97fc-ec19-4961-939b-45e72c2b6a91 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:22.133585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 458/924] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Jul 18 16:30:21 2022] GET /identity/v3/endpoints?service_id=8210e08c11004da5bd8964a694728d5e&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:22.139384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5f9f5-3d21-41ca-a3a4-253ccdd55945 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:22.211182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:22.248637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5f9f5-3d21-41ca-a3a4-253ccdd55945 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:22.286521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35731b8b-124c-426e-9309-4d50f50ddb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:22.287219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35731b8b-124c-426e-9309-4d50f50ddb94 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:22.287505 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35731b8b-124c-426e-9309-4d50f50ddb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:22.287786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35731b8b-124c-426e-9309-4d50f50ddb94 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:22.288484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35731b8b-124c-426e-9309-4d50f50ddb94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:22.289897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35731b8b-124c-426e-9309-4d50f50ddb94 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:22.297141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 467/925] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Jul 18 16:30:22 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:30:22.699916 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b006e2-0f6b-4985-ae04-f90527942415 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:22.700964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b006e2-0f6b-4985-ae04-f90527942415 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:22.701493 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b006e2-0f6b-4985-ae04-f90527942415 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:22.703396 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 459/926] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:30:22.709277 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe6fc3-cdf3-4321-a8a3-2dadd64edf6d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:22.709858 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe6fc3-cdf3-4321-a8a3-2dadd64edf6d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:22.710345 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fe6fc3-cdf3-4321-a8a3-2dadd64edf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:22.730836 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-30fe6fc3-cdf3-4321-a8a3-2dadd64edf6d None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:22.732375 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-30fe6fc3-cdf3-4321-a8a3-2dadd64edf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:22.818233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 468/927] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:22.841503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b006e2-0f6b-4985-ae04-f90527942415 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:22.948745 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b006e2-0f6b-4985-ae04-f90527942415 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:22.985745 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757415d8-34ee-4a1c-9bce-2f40257c44c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:22.986903 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757415d8-34ee-4a1c-9bce-2f40257c44c0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:22.987417 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757415d8-34ee-4a1c-9bce-2f40257c44c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:22.987892 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757415d8-34ee-4a1c-9bce-2f40257c44c0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:22.988774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757415d8-34ee-4a1c-9bce-2f40257c44c0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:22.990377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757415d8-34ee-4a1c-9bce-2f40257c44c0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:23.003849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-757415d8-34ee-4a1c-9bce-2f40257c44c0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 16:30:23.003849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:23.003849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:30:23.003849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:30:23.003849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:30:23.003849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:30:23.003849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:30:23.003849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:23.003849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 16:30:23.003849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:23.003849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:23.003849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:23.003849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:23.003849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:23.003849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:23.003849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:23.004836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:23.004836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:23.004836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:23.004836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:23.004836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:23.004836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:23.004836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:23.004836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:30:23.004836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:30:23.004836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:30:23.004836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:30:23.004836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:23.004836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:23.004836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:23.004836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:23.004836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:23.005761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:23.005761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:23.005761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:23.005761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:23.005761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:23.005761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:23.005761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:23.005761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:23.005761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:23.005761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:23.005761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:23.005761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:30:23.005761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:23.005761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 18 16:30:23.005761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:23.013105 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 460/928] 10.222.0.76 () {56 vars in 1132 bytes} [Mon Jul 18 16:30:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:23.014836 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe6fc3-cdf3-4321-a8a3-2dadd64edf6d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:23.080453 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:23.123655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fe6fc3-cdf3-4321-a8a3-2dadd64edf6d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:23.165090 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5bf4e-2897-4c62-8a88-8a6ceca3dc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:23.165775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5bf4e-2897-4c62-8a88-8a6ceca3dc1a None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:23.166059 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5bf4e-2897-4c62-8a88-8a6ceca3dc1a None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:23.166445 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5bf4e-2897-4c62-8a88-8a6ceca3dc1a None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:23.167436 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5bf4e-2897-4c62-8a88-8a6ceca3dc1a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:23.167744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5bf4e-2897-4c62-8a88-8a6ceca3dc1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:23.169188 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5bf4e-2897-4c62-8a88-8a6ceca3dc1a None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:23.175072 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 469/929] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Jul 18 16:30:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:23.181524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757415d8-34ee-4a1c-9bce-2f40257c44c0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:23.198813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:23.208195 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001a6d6-d24f-4d03-809e-1b8f6a77b8ac None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:23.215992 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001a6d6-d24f-4d03-809e-1b8f6a77b8ac None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:23.215992 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001a6d6-d24f-4d03-809e-1b8f6a77b8ac None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:23.215992 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 470/930] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:30:23.215992 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d7193-47df-40ea-a74f-f967b1da0428 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:23.215992 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d7193-47df-40ea-a74f-f967b1da0428 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:23.215992 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d7193-47df-40ea-a74f-f967b1da0428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:23.233617 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-b93d7193-47df-40ea-a74f-f967b1da0428 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:23.234828 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b93d7193-47df-40ea-a74f-f967b1da0428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:23.308720 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757415d8-34ee-4a1c-9bce-2f40257c44c0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:23.311511 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 471/931] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:23.333398 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d7193-47df-40ea-a74f-f967b1da0428 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:23.356703 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32189f42-ef1e-4418-b60a-50c660934d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:23.357429 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32189f42-ef1e-4418-b60a-50c660934d42 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:23.357719 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32189f42-ef1e-4418-b60a-50c660934d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:23.358005 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32189f42-ef1e-4418-b60a-50c660934d42 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:23.358728 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32189f42-ef1e-4418-b60a-50c660934d42 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:23.359592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32189f42-ef1e-4418-b60a-50c660934d42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:23.361315 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32189f42-ef1e-4418-b60a-50c660934d42 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:23.369193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 461/932] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Jul 18 16:30:23 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:23.375116 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32189f42-ef1e-4418-b60a-50c660934d42 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:23.408177 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:23.462566 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d7193-47df-40ea-a74f-f967b1da0428 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:23.477495 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:23.503085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32189f42-ef1e-4418-b60a-50c660934d42 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:23.509729 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517dd2de-d2ff-4ae0-ad70-f3dc8fe14582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:23.511157 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dd2de-d2ff-4ae0-ad70-f3dc8fe14582 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:23.511441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dd2de-d2ff-4ae0-ad70-f3dc8fe14582 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:23.511843 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dd2de-d2ff-4ae0-ad70-f3dc8fe14582 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:23.528115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517dd2de-d2ff-4ae0-ad70-f3dc8fe14582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:30:23.539648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-517dd2de-d2ff-4ae0-ad70-f3dc8fe14582 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:30:23.539648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:23.539648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:23.539648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:23.539648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:23.539648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:23.539648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:23.539648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:23.539648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:23.539648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:23.539648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:23.539648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:23.539648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:30:23.539648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:30:23.539648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:30:23.539648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:30:23.540655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:30:23.540655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:30:23.540655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:30:23.540655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:30:23.540655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:23.540655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:23.540655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:23.540655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:23.540655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:23.540655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:23.540655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:23.540655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:23.540655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:23.540655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:23.540655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:23.540655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:23.542384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:23.542384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:23.542384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:23.542384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:23.542384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:30:23.542384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:30:23.542384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:30:23.542384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:30:23.542384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:30:23.542384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:30:23.542384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:30:23.542384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:23.542384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 472/933] 10.222.0.76 () {56 vars in 1120 bytes} [Mon Jul 18 16:30:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:23.550003 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517dd2de-d2ff-4ae0-ad70-f3dc8fe14582 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:23.552422 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eeac06-f7a6-4a32-89e8-4e235aa57c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:23.553371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeac06-f7a6-4a32-89e8-4e235aa57c55 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:23.553874 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeac06-f7a6-4a32-89e8-4e235aa57c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:23.554214 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eeac06-f7a6-4a32-89e8-4e235aa57c55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:23.555037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eeac06-f7a6-4a32-89e8-4e235aa57c55 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:23.556530 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eeac06-f7a6-4a32-89e8-4e235aa57c55 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:23.660814 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517dd2de-d2ff-4ae0-ad70-f3dc8fe14582 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:23.677565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:23.701692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 462/934] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Jul 18 16:30:23 2022] POST /identity/v3/endpoints => generated 347 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:30:23.708010 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473ed0d-95d9-4f0a-87e5-3bd0defb0a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:23.709139 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473ed0d-95d9-4f0a-87e5-3bd0defb0a12 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:23.709569 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473ed0d-95d9-4f0a-87e5-3bd0defb0a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:23.710034 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473ed0d-95d9-4f0a-87e5-3bd0defb0a12 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:23.710988 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473ed0d-95d9-4f0a-87e5-3bd0defb0a12 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:23.711454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473ed0d-95d9-4f0a-87e5-3bd0defb0a12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:23.713834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473ed0d-95d9-4f0a-87e5-3bd0defb0a12 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:23.728004 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 473/935] 10.222.0.76 () {56 vars in 1115 bytes} [Mon Jul 18 16:30:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:23.736924 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eeac06-f7a6-4a32-89e8-4e235aa57c55 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:23.770890 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c16d75-340c-4b88-9d49-7722ec36700e None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:23.771182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c16d75-340c-4b88-9d49-7722ec36700e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:23.771533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c16d75-340c-4b88-9d49-7722ec36700e None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:23.773057 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 474/936] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:30:23.781670 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5743a-2d10-4fc4-9f41-0e1e3b1e3909 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:23.782185 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5743a-2d10-4fc4-9f41-0e1e3b1e3909 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:23.782687 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5743a-2d10-4fc4-9f41-0e1e3b1e3909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:23.816378 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-65d5743a-2d10-4fc4-9f41-0e1e3b1e3909 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:23.818734 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-65d5743a-2d10-4fc4-9f41-0e1e3b1e3909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:23.883861 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eeac06-f7a6-4a32-89e8-4e235aa57c55 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:23.922121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:23.924705 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 475/937] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:30:23.928259 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea88065-1cd8-44dd-acb5-0aa427c90d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:23.929847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea88065-1cd8-44dd-acb5-0aa427c90d98 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:23.929847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea88065-1cd8-44dd-acb5-0aa427c90d98 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:23.929847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea88065-1cd8-44dd-acb5-0aa427c90d98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:23.942552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea88065-1cd8-44dd-acb5-0aa427c90d98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:23.944112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea88065-1cd8-44dd-acb5-0aa427c90d98 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:23.949372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5743a-2d10-4fc4-9f41-0e1e3b1e3909 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:23.967614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-aea88065-1cd8-44dd-acb5-0aa427c90d98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:23.967614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:23.967614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:23.967614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:23.967614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:23.967614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:23.967614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:23.967614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:23.967614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:23.967614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:23.967614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:23.967614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:23.967614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:23.967614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:23.967614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:23.968578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:23.968578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:23.968578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:23.968578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:23.968578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:23.968578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:23.968578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:23.968578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:23.968578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:23.968578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:23.968578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:23.968578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:23.968578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:23.968578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:23.968578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:23.968578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:23.968578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:23.969499 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:23.969499 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:23.969499 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:23.969499 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:23.971222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 463/938] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:23.976564 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea88065-1cd8-44dd-acb5-0aa427c90d98 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:24.075263 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d5743a-2d10-4fc4-9f41-0e1e3b1e3909 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:24.078652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:24.113086 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea88065-1cd8-44dd-acb5-0aa427c90d98 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:24.125434 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df0703-901a-46c2-a1df-15f222927f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:24.127173 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df0703-901a-46c2-a1df-15f222927f23 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:24.127681 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df0703-901a-46c2-a1df-15f222927f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:24.128138 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df0703-901a-46c2-a1df-15f222927f23 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:24.129362 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df0703-901a-46c2-a1df-15f222927f23 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:24.131782 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df0703-901a-46c2-a1df-15f222927f23 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:24.134081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: WARNING keystone.server.flask.common [None req-f8df0703-901a-46c2-a1df-15f222927f23 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 18 16:30:24.159487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c59a3-d2ac-410c-9d5f-40bd2f97b74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:24.159487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c59a3-d2ac-410c-9d5f-40bd2f97b74b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:24.167829 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c59a3-d2ac-410c-9d5f-40bd2f97b74b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:24.171546 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c59a3-d2ac-410c-9d5f-40bd2f97b74b None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:24.172263 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c59a3-d2ac-410c-9d5f-40bd2f97b74b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:24.172537 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c59a3-d2ac-410c-9d5f-40bd2f97b74b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:24.181164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c59a3-d2ac-410c-9d5f-40bd2f97b74b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:24.209070 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 464/939] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:24.214807 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c59a3-d2ac-410c-9d5f-40bd2f97b74b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:24.230822 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.sql.core [None req-f8df0703-901a-46c2-a1df-15f222927f23 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 16:30:24.230822 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 18 16:30:24.230822 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [parameters: {'id': 'c090a2ccf3284b9eb88c6328728e8d6d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 18 16:30:24.230822 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80507) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 16:30:24.239433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-f8df0703-901a-46c2-a1df-15f222927f23 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c090a2ccf3284b9eb88c6328728e8d6d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c090a2ccf3284b9eb88c6328728e8d6d. Jul 18 16:30:24.239433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:24.239433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 16:30:24.239433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 16:30:24.239433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 16:30:24.239433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 16:30:24.239433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 16:30:24.239433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 16:30:24.239433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 16:30:24.239433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application conn.query(q) Jul 18 16:30:24.239433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 16:30:24.239433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 16:30:24.239433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 16:30:24.248691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application result.read() Jul 18 16:30:24.248691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 16:30:24.248691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 16:30:24.248691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 16:30:24.248691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 16:30:24.248691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 16:30:24.248691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 16:30:24.248691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 16:30:24.248691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 16:30:24.248691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 16:30:24.248691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:24.248691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 16:30:24.248691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:24.248691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:24.248691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 16:30:24.248691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 16:30:24.248691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 18 16:30:24.248691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 18 16:30:24.249714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 16:30:24.249714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application next(self.gen) Jul 18 16:30:24.249714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 16:30:24.249714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application yield resource Jul 18 16:30:24.249714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 16:30:24.249714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application next(self.gen) Jul 18 16:30:24.249714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 16:30:24.249714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 16:30:24.249714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 16:30:24.249714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 16:30:24.249714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 16:30:24.249714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise self.value Jul 18 16:30:24.249714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 16:30:24.249714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 16:30:24.249714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 16:30:24.249714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application session.commit() Jul 18 16:30:24.249714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 16:30:24.250635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 16:30:24.250635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 16:30:24.250635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 16:30:24.250635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 16:30:24.250635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.session.flush() Jul 18 16:30:24.250635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 16:30:24.250635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 16:30:24.250635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 16:30:24.250635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 16:30:24.250635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 16:30:24.250635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application compat.raise_( Jul 18 16:30:24.250635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 16:30:24.250635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception Jul 18 16:30:24.250635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 16:30:24.250635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 16:30:24.250635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 16:30:24.250635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 16:30:24.251560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 16:30:24.251560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 16:30:24.251560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 16:30:24.251560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 16:30:24.251560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 18 16:30:24.251560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 18 16:30:24.251560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 16:30:24.251560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 16:30:24.251560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 16:30:24.251560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 16:30:24.251560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 16:30:24.251560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 16:30:24.251560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 16:30:24.251560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 16:30:24.251560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 16:30:24.253404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 16:30:24.253404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 16:30:24.253404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception Jul 18 16:30:24.253404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 16:30:24.253404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 16:30:24.253404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 16:30:24.253404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 16:30:24.253404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 16:30:24.253404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 16:30:24.253404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 16:30:24.253404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application conn.query(q) Jul 18 16:30:24.253404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 16:30:24.253404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 16:30:24.253404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 16:30:24.253404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application result.read() Jul 18 16:30:24.253404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 16:30:24.253404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 16:30:24.255001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 16:30:24.255001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 16:30:24.255001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 16:30:24.255001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 16:30:24.255001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 16:30:24.255001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 16:30:24.255001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 18 16:30:24.255001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 18 16:30:24.255001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [parameters: {'id': 'c090a2ccf3284b9eb88c6328728e8d6d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 18 16:30:24.255001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 16:30:24.255001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:24.255001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:24.255001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:24.255001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:24.255001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 18 16:30:24.256510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 18 16:30:24.256510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 16:30:24.256510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 16:30:24.256510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 18 16:30:24.256510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:24.256510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:24.256510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:24.256510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:24.256510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:24.256510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:24.256510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:24.256510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:24.256510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:24.256510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:24.256510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:24.256510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:24.256510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:24.258839 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:24.258839 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 18 16:30:24.258839 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 18 16:30:24.258839 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:24.258839 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:24.258839 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 18 16:30:24.258839 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 18 16:30:24.258839 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c090a2ccf3284b9eb88c6328728e8d6d. Jul 18 16:30:24.258839 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:24.258839 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 476/940] 10.222.0.76 () {60 vars in 1140 bytes} [Mon Jul 18 16:30:23 2022] POST /identity/v3/projects => generated 262 bytes in 293 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:24.264698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df0703-901a-46c2-a1df-15f222927f23 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:24.321455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:24.383688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c59a3-d2ac-410c-9d5f-40bd2f97b74b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:24.435318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c8080-ee07-4583-a275-c515af7edbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:24.436049 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c8080-ee07-4583-a275-c515af7edbfd None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:24.436330 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c8080-ee07-4583-a275-c515af7edbfd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:24.436605 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c8080-ee07-4583-a275-c515af7edbfd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:24.448831 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c8080-ee07-4583-a275-c515af7edbfd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:24.450319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c8080-ee07-4583-a275-c515af7edbfd None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:24.476797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-1b5c8080-ee07-4583-a275-c515af7edbfd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:30:24.476797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:24.476797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:24.476797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:24.476797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:24.476797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:24.476797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:24.476797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:24.476797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:24.476797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:24.476797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:24.476797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:24.476797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:30:24.476797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:30:24.476797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:30:24.476797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:30:24.477849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:24.477849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:24.477849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:30:24.477849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:24.477849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:30:24.477849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:24.477849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:24.477849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:24.477849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:24.477849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:24.477849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:24.477849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:24.477849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:24.477849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:24.477849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:24.477849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:24.477849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:24.477849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:24.478867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:24.478867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:24.478867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:30:24.478867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:30:24.478867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:30:24.478867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:30:24.478867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:30:24.478867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:30:24.478867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:30:24.478867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:24.483837 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 465/941] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Jul 18 16:30:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:24.485498 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c8080-ee07-4583-a275-c515af7edbfd None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:24.517104 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df0703-901a-46c2-a1df-15f222927f23 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:24.563270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40ab0b-429b-4832-8f50-af5e7ab1b3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:24.564749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40ab0b-429b-4832-8f50-af5e7ab1b3a7 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:24.565063 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40ab0b-429b-4832-8f50-af5e7ab1b3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:24.565347 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40ab0b-429b-4832-8f50-af5e7ab1b3a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:24.576463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40ab0b-429b-4832-8f50-af5e7ab1b3a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:24.578280 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40ab0b-429b-4832-8f50-af5e7ab1b3a7 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:24.596014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-2d40ab0b-429b-4832-8f50-af5e7ab1b3a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:24.596014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:24.596014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:24.596014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:24.596014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:24.596014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:24.596014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:24.596014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:24.596014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:24.596014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:24.596014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:24.596014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:24.596014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:30:24.596014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:30:24.596014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:30:24.596967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:30:24.596967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:24.596967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:24.596967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:24.596967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:24.596967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:24.596967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:24.596967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:24.596967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:24.596967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:24.596967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:24.596967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:24.596967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:24.596967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:24.596967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:24.596967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:24.596967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:24.597935 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:30:24.597935 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:30:24.597935 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:30:24.597935 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:30:24.597935 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:30:24.597935 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:30:24.597935 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:24.597935 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:24.602445 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 477/942] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:30:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:24.604412 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891a97e-e31e-4bed-9a0e-8cbcea53c456 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:24.604697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891a97e-e31e-4bed-9a0e-8cbcea53c456 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:24.605022 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891a97e-e31e-4bed-9a0e-8cbcea53c456 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:24.609161 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c8080-ee07-4583-a275-c515af7edbfd None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:24.611954 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:24.613780 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 478/943] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:24 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:24.614660 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891a97e-e31e-4bed-9a0e-8cbcea53c456 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:24.643533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:24.651395 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590a0d7a-1d42-405f-89fb-fd1dedc6ebbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:24.657205 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a0d7a-1d42-405f-89fb-fd1dedc6ebbe None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:24.657205 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a0d7a-1d42-405f-89fb-fd1dedc6ebbe None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:24.657205 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590a0d7a-1d42-405f-89fb-fd1dedc6ebbe None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:24.657205 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a0d7a-1d42-405f-89fb-fd1dedc6ebbe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:24.657205 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a0d7a-1d42-405f-89fb-fd1dedc6ebbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:24.657205 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590a0d7a-1d42-405f-89fb-fd1dedc6ebbe None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:24.675528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 466/944] 10.222.0.76 () {56 vars in 1149 bytes} [Mon Jul 18 16:30:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:24.677120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3899906-a25f-4d20-b610-6d88c438bc21 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:24.677443 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3899906-a25f-4d20-b610-6d88c438bc21 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:24.677791 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3899906-a25f-4d20-b610-6d88c438bc21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:24.696058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b3899906-a25f-4d20-b610-6d88c438bc21 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:24.697253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b3899906-a25f-4d20-b610-6d88c438bc21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:24.737370 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891a97e-e31e-4bed-9a0e-8cbcea53c456 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:24.767602 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 467/945] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:24.768438 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3899906-a25f-4d20-b610-6d88c438bc21 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:24.783387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf4c76-3499-449a-bdf6-c5e0daf74d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:24.784353 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf4c76-3499-449a-bdf6-c5e0daf74d1b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:24.784787 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf4c76-3499-449a-bdf6-c5e0daf74d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:24.785236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf4c76-3499-449a-bdf6-c5e0daf74d1b None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:24.786186 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf4c76-3499-449a-bdf6-c5e0daf74d1b None admin] RBAC: Adding query filter params (name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:24.786662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf4c76-3499-449a-bdf6-c5e0daf74d1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:24.788497 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf4c76-3499-449a-bdf6-c5e0daf74d1b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:24.821399 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 479/946] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 16:30:24 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:24.822460 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf4c76-3499-449a-bdf6-c5e0daf74d1b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:24.901216 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:24.912269 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3899906-a25f-4d20-b610-6d88c438bc21 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:24.933480 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:24.953671 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de934a89-ac70-4712-8b65-ed1bb04ce02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:24.954784 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf4c76-3499-449a-bdf6-c5e0daf74d1b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:24.955325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de934a89-ac70-4712-8b65-ed1bb04ce02e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:24.955926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de934a89-ac70-4712-8b65-ed1bb04ce02e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:24.956426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de934a89-ac70-4712-8b65-ed1bb04ce02e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:24.969283 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de934a89-ac70-4712-8b65-ed1bb04ce02e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:24.971103 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de934a89-ac70-4712-8b65-ed1bb04ce02e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:24.991194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-de934a89-ac70-4712-8b65-ed1bb04ce02e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:24.991194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:24.991194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:24.991194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:24.991194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:24.991194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:24.991194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:24.991194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:24.991194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:24.991194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:24.991194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:24.991194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:24.991194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:24.991194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:24.991194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:24.992188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:24.992188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:24.992188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:24.992188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:24.992188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:24.992188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:24.992188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:24.992188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:24.992188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:24.992188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:24.992188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:24.992188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:24.992188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:24.992188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:24.992188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:24.992188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:24.992188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:24.993115 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:24.993115 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:24.993115 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:24.993115 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:24.999407 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 468/947] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:25.000689 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de934a89-ac70-4712-8b65-ed1bb04ce02e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:25.002719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1f3f8-404f-4d5e-9c3f-91a4d799de0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:25.003564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1f3f8-404f-4d5e-9c3f-91a4d799de0b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:25.004485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1f3f8-404f-4d5e-9c3f-91a4d799de0b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:25.004485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1f3f8-404f-4d5e-9c3f-91a4d799de0b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:25.004956 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1f3f8-404f-4d5e-9c3f-91a4d799de0b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:25.006414 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1f3f8-404f-4d5e-9c3f-91a4d799de0b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:25.022662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-26f1f3f8-404f-4d5e-9c3f-91a4d799de0b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:30:25.022662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:25.022662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:30:25.022662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:30:25.022662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:30:25.022662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:30:25.022662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:30:25.022662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:25.022662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:30:25.022662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:25.022662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:25.022662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:25.022662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:25.022662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:25.022662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:25.022662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:25.022662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:25.023751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:25.023751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:25.023751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:25.023751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:25.023751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:25.023751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:25.023751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:30:25.023751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:30:25.023751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:30:25.023751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:30:25.023751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:25.023751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:25.023751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:25.023751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:25.023751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:25.023751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:25.024604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:25.024604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:25.024604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:25.024604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:25.024604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:25.024604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:25.024604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:25.024604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:25.024604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:25.024604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:25.024604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:30:25.024604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:25.024604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:30:25.024604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:25.024604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 480/948] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Jul 18 16:30:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:25.030869 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1f3f8-404f-4d5e-9c3f-91a4d799de0b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:25.139096 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de934a89-ac70-4712-8b65-ed1bb04ce02e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:25.152422 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1f3f8-404f-4d5e-9c3f-91a4d799de0b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:25.190665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939dcf7-3a05-4222-8570-ed5e6efcbbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:25.191508 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939dcf7-3a05-4222-8570-ed5e6efcbbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:25.191899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939dcf7-3a05-4222-8570-ed5e6efcbbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:25.192437 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939dcf7-3a05-4222-8570-ed5e6efcbbf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:25.193636 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939dcf7-3a05-4222-8570-ed5e6efcbbf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:25.194060 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939dcf7-3a05-4222-8570-ed5e6efcbbf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:25.195999 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939dcf7-3a05-4222-8570-ed5e6efcbbf2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:25.203060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe50f92-5863-4cb7-9118-673dc5c73407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:25.203976 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe50f92-5863-4cb7-9118-673dc5c73407 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:25.204408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe50f92-5863-4cb7-9118-673dc5c73407 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:25.204831 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe50f92-5863-4cb7-9118-673dc5c73407 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:25.206318 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe50f92-5863-4cb7-9118-673dc5c73407 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:25.206778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe50f92-5863-4cb7-9118-673dc5c73407 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:25.208828 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe50f92-5863-4cb7-9118-673dc5c73407 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:25.219150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 469/949] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:25.219326 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 481/950] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Jul 18 16:30:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:25.223678 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939dcf7-3a05-4222-8570-ed5e6efcbbf2 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:25.225790 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe50f92-5863-4cb7-9118-673dc5c73407 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:25.225915 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:25.237397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:25.331994 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939dcf7-3a05-4222-8570-ed5e6efcbbf2 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:25.353847 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe50f92-5863-4cb7-9118-673dc5c73407 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:25.372233 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ab3eb-b17c-4dfa-93c4-e8c264b949d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:25.373500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ab3eb-b17c-4dfa-93c4-e8c264b949d4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:25.373904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ab3eb-b17c-4dfa-93c4-e8c264b949d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:25.374376 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738ab3eb-b17c-4dfa-93c4-e8c264b949d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:25.382347 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ab3eb-b17c-4dfa-93c4-e8c264b949d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:25.384277 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738ab3eb-b17c-4dfa-93c4-e8c264b949d4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:25.396204 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed467e-d920-47e7-8aba-bc6bce9c8227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:25.396886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed467e-d920-47e7-8aba-bc6bce9c8227 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:25.397200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed467e-d920-47e7-8aba-bc6bce9c8227 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:25.397485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed467e-d920-47e7-8aba-bc6bce9c8227 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:25.398201 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed467e-d920-47e7-8aba-bc6bce9c8227 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:25.398511 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed467e-d920-47e7-8aba-bc6bce9c8227 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:25.399882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed467e-d920-47e7-8aba-bc6bce9c8227 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:25.401384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-738ab3eb-b17c-4dfa-93c4-e8c264b949d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:25.401384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:25.401384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:25.401384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:25.401384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:25.401384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:25.401384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:25.401384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:25.401384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:25.401384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:25.401384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:25.401384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:25.401384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:30:25.401384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:30:25.401384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:30:25.402512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:30:25.402512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:25.402512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:25.402512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:25.402512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:25.402512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:25.402512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:25.402512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:25.402512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:25.402512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:25.402512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:25.402512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:25.402512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:25.402512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:25.402512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:25.402512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:25.402512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:25.403688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:30:25.403688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:30:25.403688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:30:25.403688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:30:25.403688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:30:25.403688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:30:25.403688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:25.403688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:25.412162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 482/951] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Jul 18 16:30:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:25.412327 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 470/952] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:30:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:25.412508 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed467e-d920-47e7-8aba-bc6bce9c8227 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:25.412992 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ab3eb-b17c-4dfa-93c4-e8c264b949d4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:25.489102 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:25.513166 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:25.534139 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738ab3eb-b17c-4dfa-93c4-e8c264b949d4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:25.553574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed467e-d920-47e7-8aba-bc6bce9c8227 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:25.580047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934f9ea-2649-40f5-b0e4-0d19fe48eefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:25.581409 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934f9ea-2649-40f5-b0e4-0d19fe48eefd None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:25.581929 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934f9ea-2649-40f5-b0e4-0d19fe48eefd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:25.582327 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934f9ea-2649-40f5-b0e4-0d19fe48eefd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:25.583338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934f9ea-2649-40f5-b0e4-0d19fe48eefd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:25.585426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934f9ea-2649-40f5-b0e4-0d19fe48eefd None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:25.593646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230b219-6a70-4b16-ad9a-4107b75ca508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:25.594663 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230b219-6a70-4b16-ad9a-4107b75ca508 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:25.595171 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230b219-6a70-4b16-ad9a-4107b75ca508 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:25.595816 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230b219-6a70-4b16-ad9a-4107b75ca508 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:25.596884 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230b219-6a70-4b16-ad9a-4107b75ca508 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:25.597365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230b219-6a70-4b16-ad9a-4107b75ca508 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:25.598992 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230b219-6a70-4b16-ad9a-4107b75ca508 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:25.613040 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 483/953] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:30:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:25.620162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230b219-6a70-4b16-ad9a-4107b75ca508 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:25.681534 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 471/954] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Jul 18 16:30:25 2022] POST /identity/v3/endpoints => generated 349 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:30:25.739712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230b219-6a70-4b16-ad9a-4107b75ca508 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:25.776082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:25.789104 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27200435-99c1-4efd-ad08-28c8eb0e4826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:25.790022 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27200435-99c1-4efd-ad08-28c8eb0e4826 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:25.790306 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27200435-99c1-4efd-ad08-28c8eb0e4826 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:25.790584 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27200435-99c1-4efd-ad08-28c8eb0e4826 None admin] PATH_INFO: `/v3/projects/30a4824228ec47519a01574d82879b25/users/ff65e481807b4344897b1499cd450f9d/roles/96360c5874dd4a1f87b4695f1088f5b1` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:25.793775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27200435-99c1-4efd-ad08-28c8eb0e4826 None admin] RBAC: Authorizing `identity:create_grant(project_id=30a4824228ec47519a01574d82879b25, user_id=ff65e481807b4344897b1499cd450f9d, role_id=96360c5874dd4a1f87b4695f1088f5b1)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:25.795251 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27200435-99c1-4efd-ad08-28c8eb0e4826 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:25.945051 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 484/955] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:30:25 2022] PUT /identity/v3/projects/30a4824228ec47519a01574d82879b25/users/ff65e481807b4344897b1499cd450f9d/roles/96360c5874dd4a1f87b4695f1088f5b1 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:30:26.000727 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c13bc-c470-4713-8dae-42752f289514 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:26.001245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c13bc-c470-4713-8dae-42752f289514 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:26.001245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c13bc-c470-4713-8dae-42752f289514 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:26.002925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 472/956] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:26.009466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f6c77-dcec-4ff1-9184-cd8abc9c850f None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:26.009855 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f6c77-dcec-4ff1-9184-cd8abc9c850f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:26.010333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360f6c77-dcec-4ff1-9184-cd8abc9c850f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:26.033784 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-360f6c77-dcec-4ff1-9184-cd8abc9c850f None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:26.035513 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-360f6c77-dcec-4ff1-9184-cd8abc9c850f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:26.127030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 485/957] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:26.152270 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c13bc-c470-4713-8dae-42752f289514 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:26.273365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c13bc-c470-4713-8dae-42752f289514 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:26.296254 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:26.312213 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fee28-aec5-4be9-b812-ae8581388926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:26.313041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fee28-aec5-4be9-b812-ae8581388926 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:26.313342 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fee28-aec5-4be9-b812-ae8581388926 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:26.313630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fee28-aec5-4be9-b812-ae8581388926 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:26.314299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fee28-aec5-4be9-b812-ae8581388926 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:26.315729 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fee28-aec5-4be9-b812-ae8581388926 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:26.329220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-233fee28-aec5-4be9-b812-ae8581388926 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 16:30:26.329220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:26.329220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:30:26.329220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:30:26.329220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:30:26.329220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:30:26.329220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:30:26.329220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:26.329220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 16:30:26.329220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:26.329220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:26.329220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:26.329220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:26.329220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:26.329220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:26.329220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:26.329220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:26.330346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:26.330346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:26.330346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:26.330346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:26.330346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:26.330346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:26.330346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:30:26.330346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:30:26.330346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:30:26.330346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:30:26.330346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:26.330346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:26.330346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:26.330346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:26.330346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:26.330346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:26.331635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:26.331635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:26.331635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:26.331635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:26.331635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:26.331635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:26.331635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:26.331635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:26.331635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:26.331635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:26.331635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:30:26.331635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:26.331635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 16:30:26.331635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:26.331635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 473/958] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:30:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:26.336651 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f6c77-dcec-4ff1-9184-cd8abc9c850f None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:26.442286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360f6c77-dcec-4ff1-9184-cd8abc9c850f None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:26.461674 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:26.481052 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52650c47-e758-402d-9155-c9cd020dde9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:26.482104 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52650c47-e758-402d-9155-c9cd020dde9b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:26.482620 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52650c47-e758-402d-9155-c9cd020dde9b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:26.483102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52650c47-e758-402d-9155-c9cd020dde9b None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:26.484042 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52650c47-e758-402d-9155-c9cd020dde9b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:26.484563 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52650c47-e758-402d-9155-c9cd020dde9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:26.486166 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52650c47-e758-402d-9155-c9cd020dde9b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:26.492039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 486/959] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 16:30:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:26.501061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fee28-aec5-4be9-b812-ae8581388926 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:26.621432 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fee28-aec5-4be9-b812-ae8581388926 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:26.657003 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771023b6-7a0f-4b92-9234-0c36b917a6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:26.657003 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771023b6-7a0f-4b92-9234-0c36b917a6ea None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:26.657326 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771023b6-7a0f-4b92-9234-0c36b917a6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:26.657536 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771023b6-7a0f-4b92-9234-0c36b917a6ea None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:26.658234 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771023b6-7a0f-4b92-9234-0c36b917a6ea None admin] RBAC: Adding query filter params (type=compute) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:26.658546 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771023b6-7a0f-4b92-9234-0c36b917a6ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:26.659920 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771023b6-7a0f-4b92-9234-0c36b917a6ea None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:26.664906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 474/960] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 16:30:26 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:27.114217 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b4dc6-70d0-431a-af85-6bc2f451e5ba None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:27.114606 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b4dc6-70d0-431a-af85-6bc2f451e5ba None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:27.114796 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b4dc6-70d0-431a-af85-6bc2f451e5ba None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:27.116441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 487/961] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:27.122874 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4d363-ec33-45eb-af1f-57bfe8a6c9f8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:27.123750 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4d363-ec33-45eb-af1f-57bfe8a6c9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:27.124252 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4d363-ec33-45eb-af1f-57bfe8a6c9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:27.141530 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-00e4d363-ec33-45eb-af1f-57bfe8a6c9f8 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:27.143057 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-00e4d363-ec33-45eb-af1f-57bfe8a6c9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:27.196797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:27.224984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 475/962] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:30:27.249929 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b4dc6-70d0-431a-af85-6bc2f451e5ba None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:27.364056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b4dc6-70d0-431a-af85-6bc2f451e5ba None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:27.401330 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfecde0-c597-4126-9667-9d24585407f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:27.402266 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfecde0-c597-4126-9667-9d24585407f1 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:27.402730 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfecde0-c597-4126-9667-9d24585407f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:27.403168 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfecde0-c597-4126-9667-9d24585407f1 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:27.404034 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfecde0-c597-4126-9667-9d24585407f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:27.405656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfecde0-c597-4126-9667-9d24585407f1 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:27.458997 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.sql.core [None req-2cfecde0-c597-4126-9667-9d24585407f1 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 16:30:27.458997 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 18 16:30:27.458997 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [parameters: {'user_id': 'bd76bcc0836e445488326448473c67ee', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 18 16:30:27.458997 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80507) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 18 16:30:27.467156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-2cfecde0-c597-4126-9667-9d24585407f1 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 18 16:30:27.467156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:27.467156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 16:30:27.467156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 16:30:27.467156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 16:30:27.467156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 16:30:27.467156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 16:30:27.467156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 16:30:27.467156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 16:30:27.467156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application conn.query(q) Jul 18 16:30:27.467156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 16:30:27.467156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 16:30:27.467156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 16:30:27.467156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application result.read() Jul 18 16:30:27.467156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 16:30:27.468235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 16:30:27.468235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 16:30:27.468235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 16:30:27.468235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 16:30:27.468235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 16:30:27.468235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 16:30:27.468235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 16:30:27.468235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 16:30:27.468235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:27.468235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 18 16:30:27.468235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:27.468235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:27.468235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 18 16:30:27.468235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 18 16:30:27.468235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 18 16:30:27.468235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 18 16:30:27.468235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 16:30:27.468235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application next(self.gen) Jul 18 16:30:27.469481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 18 16:30:27.469481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application yield resource Jul 18 16:30:27.469481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 18 16:30:27.469481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application next(self.gen) Jul 18 16:30:27.469481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 18 16:30:27.469481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.session.rollback() Jul 18 16:30:27.469481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 18 16:30:27.469481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.force_reraise() Jul 18 16:30:27.469481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 18 16:30:27.469481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise self.value Jul 18 16:30:27.469481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 18 16:30:27.469481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 18 16:30:27.469481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 18 16:30:27.469481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application session.commit() Jul 18 16:30:27.469481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 18 16:30:27.469481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 18 16:30:27.469481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 18 16:30:27.470639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._prepare_impl() Jul 18 16:30:27.470639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 18 16:30:27.470639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.session.flush() Jul 18 16:30:27.470639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 18 16:30:27.470639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._flush(objects) Jul 18 16:30:27.470639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 18 16:30:27.470639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 18 16:30:27.470639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 18 16:30:27.470639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application compat.raise_( Jul 18 16:30:27.470639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 16:30:27.470639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception Jul 18 16:30:27.470639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 18 16:30:27.470639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application flush_context.execute() Jul 18 16:30:27.470639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 18 16:30:27.470639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rec.execute(self) Jul 18 16:30:27.470639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 18 16:30:27.470639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 18 16:30:27.471778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 18 16:30:27.471778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 18 16:30:27.471778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 18 16:30:27.471778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 18 16:30:27.471778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 18 16:30:27.471778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 18 16:30:27.471778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 18 16:30:27.471778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 18 16:30:27.471778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 18 16:30:27.471778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 18 16:30:27.471778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 18 16:30:27.471778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 18 16:30:27.471778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 18 16:30:27.471778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 18 16:30:27.471778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 18 16:30:27.471778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception Jul 18 16:30:27.472767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 18 16:30:27.472767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 18 16:30:27.472767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 18 16:30:27.472767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 18 16:30:27.472767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 18 16:30:27.472767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application result = self._query(query) Jul 18 16:30:27.472767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 18 16:30:27.472767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application conn.query(q) Jul 18 16:30:27.472767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 18 16:30:27.472767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 18 16:30:27.472767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 18 16:30:27.472767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application result.read() Jul 18 16:30:27.472767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 18 16:30:27.472767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 18 16:30:27.472767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 18 16:30:27.472767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 18 16:30:27.480182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 18 16:30:27.480182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 18 16:30:27.480182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 18 16:30:27.480182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 18 16:30:27.480182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 18 16:30:27.480182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 18 16:30:27.480182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bd76bcc0836e445488326448473c67ee', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 18 16:30:27.480182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 18 16:30:27.480182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:27.480182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:27.480182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:27.480182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:27.480182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:27.480182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:27.480182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:27.481258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:27.481258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:27.481258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:27.481258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:27.481258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:27.481258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:27.481258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:27.481258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 18 16:30:27.481258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 18 16:30:27.481258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:27.481258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:27.481258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:30:27.481258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:27.481258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:30:27.481258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:27.481258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 18 16:30:27.481258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 18 16:30:27.482352 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 18 16:30:27.482352 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 18 16:30:27.482352 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 18 16:30:27.482352 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 18 16:30:27.482352 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 18 16:30:27.482352 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:27.482352 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 488/963] 10.222.0.76 () {60 vars in 1131 bytes} [Mon Jul 18 16:30:27 2022] POST /identity/v3/users => generated 160 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:27.482767 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4d363-ec33-45eb-af1f-57bfe8a6c9f8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:27.593260 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4d363-ec33-45eb-af1f-57bfe8a6c9f8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:27.629939 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19dfa43-987d-410a-bc5e-74942d05974f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:27.630750 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dfa43-987d-410a-bc5e-74942d05974f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:27.631034 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dfa43-987d-410a-bc5e-74942d05974f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:27.631310 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19dfa43-987d-410a-bc5e-74942d05974f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:27.639379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19dfa43-987d-410a-bc5e-74942d05974f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:27.640842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19dfa43-987d-410a-bc5e-74942d05974f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:27.656501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-f19dfa43-987d-410a-bc5e-74942d05974f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 16:30:27.656501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:27.656501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:27.656501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:27.656501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:27.656501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:27.656501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:27.656501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:27.656501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:27.656501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:27.656501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:27.656501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:27.656501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:30:27.656501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:30:27.656501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:30:27.656501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:30:27.658595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:27.658595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:27.658595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:30:27.658595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:27.658595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:30:27.658595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:27.658595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:27.658595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:27.658595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:27.658595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:27.658595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:27.658595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:27.658595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:27.658595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:27.658595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:27.658595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:27.658595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:27.658595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:27.660295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:27.660295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:27.660295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:30:27.660295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:30:27.660295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:30:27.660295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:30:27.660295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:30:27.660295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:30:27.660295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 18 16:30:27.660295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:27.660295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 476/964] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:30:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:27.667165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfecde0-c597-4126-9667-9d24585407f1 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:27.714274 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:27.773476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfecde0-c597-4126-9667-9d24585407f1 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:27.811396 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3246c4-41ce-4d58-a9ec-76be86d09978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:27.812429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3246c4-41ce-4d58-a9ec-76be86d09978 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:27.812917 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3246c4-41ce-4d58-a9ec-76be86d09978 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:27.813451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3246c4-41ce-4d58-a9ec-76be86d09978 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:27.814500 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3246c4-41ce-4d58-a9ec-76be86d09978 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:27.815039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3246c4-41ce-4d58-a9ec-76be86d09978 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:27.816914 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3246c4-41ce-4d58-a9ec-76be86d09978 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:27.861811 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 489/965] 10.222.0.76 () {56 vars in 1101 bytes} [Mon Jul 18 16:30:27 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:27.981973 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bc4e6-e8af-4d64-8391-b70d92bb116f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:27.982281 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bc4e6-e8af-4d64-8391-b70d92bb116f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:27.982470 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bc4e6-e8af-4d64-8391-b70d92bb116f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:27.984186 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 477/966] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:27.990079 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcc541-fb42-4bb6-8c73-6e9c7712e6d0 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:27.990379 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcc541-fb42-4bb6-8c73-6e9c7712e6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:27.990647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcc541-fb42-4bb6-8c73-6e9c7712e6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:28.010309 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-fbdcc541-fb42-4bb6-8c73-6e9c7712e6d0 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:28.011911 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fbdcc541-fb42-4bb6-8c73-6e9c7712e6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:28.089622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 490/967] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:28.111925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bc4e6-e8af-4d64-8391-b70d92bb116f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:28.158768 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:28.227289 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bc4e6-e8af-4d64-8391-b70d92bb116f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:28.256200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2abc8-f73a-4e39-b347-38e93b4b657e None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:28.256669 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2abc8-f73a-4e39-b347-38e93b4b657e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:28.256959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2abc8-f73a-4e39-b347-38e93b4b657e None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:28.259430 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 491/968] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:30:28.267745 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725dc3a-d62f-4814-8ec3-ce73a12f6b1c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:28.268082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725dc3a-d62f-4814-8ec3-ce73a12f6b1c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:28.268493 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725dc3a-d62f-4814-8ec3-ce73a12f6b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:28.286983 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-b725dc3a-d62f-4814-8ec3-ce73a12f6b1c None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:28.288185 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b725dc3a-d62f-4814-8ec3-ce73a12f6b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:28.288918 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c2ab9-cf15-407f-a09f-c879f7a680b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:28.290038 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c2ab9-cf15-407f-a09f-c879f7a680b4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:28.290427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c2ab9-cf15-407f-a09f-c879f7a680b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:28.290910 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619c2ab9-cf15-407f-a09f-c879f7a680b4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:28.292760 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c2ab9-cf15-407f-a09f-c879f7a680b4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:28.294815 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619c2ab9-cf15-407f-a09f-c879f7a680b4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:28.309318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-619c2ab9-cf15-407f-a09f-c879f7a680b4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:30:28.309318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:28.309318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:30:28.309318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:30:28.309318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:30:28.309318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:30:28.309318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:30:28.309318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:28.309318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:30:28.309318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:28.309318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:28.309318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:28.309318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:28.309318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:28.309318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:28.309318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:28.309318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:28.311294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:28.311294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:28.311294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:28.311294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:28.311294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:28.311294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:28.311294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:30:28.311294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:30:28.311294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:30:28.311294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:30:28.311294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:28.311294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:28.311294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:28.311294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:28.311294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:28.311294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:28.312990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:28.312990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:28.312990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:28.312990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:28.312990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:28.312990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:28.312990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:28.312990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:28.312990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:28.312990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:28.312990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:30:28.312990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:28.312990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:30:28.312990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:28.312990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 478/969] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Jul 18 16:30:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:28.317167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c2ab9-cf15-407f-a09f-c879f7a680b4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:28.329001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:28.379850 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 492/970] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:28.407325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725dc3a-d62f-4814-8ec3-ce73a12f6b1c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:28.450203 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619c2ab9-cf15-407f-a09f-c879f7a680b4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:28.452448 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:28.488095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87bdb9-653d-4790-a671-1e2dcef589cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:28.488809 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87bdb9-653d-4790-a671-1e2dcef589cf None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:28.489252 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87bdb9-653d-4790-a671-1e2dcef589cf None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:28.489551 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87bdb9-653d-4790-a671-1e2dcef589cf None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:28.490270 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87bdb9-653d-4790-a671-1e2dcef589cf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:28.490608 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87bdb9-653d-4790-a671-1e2dcef589cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:28.492026 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec87bdb9-653d-4790-a671-1e2dcef589cf None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:28.503064 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 479/971] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Jul 18 16:30:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:28.503792 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87bdb9-653d-4790-a671-1e2dcef589cf None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:28.529316 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725dc3a-d62f-4814-8ec3-ce73a12f6b1c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:28.568368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f144088-c92e-4765-a50f-9d131ec3a513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:28.569222 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f144088-c92e-4765-a50f-9d131ec3a513 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:28.569510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f144088-c92e-4765-a50f-9d131ec3a513 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:28.569782 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f144088-c92e-4765-a50f-9d131ec3a513 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:28.583482 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f144088-c92e-4765-a50f-9d131ec3a513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:30:28.593147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-4f144088-c92e-4765-a50f-9d131ec3a513 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:30:28.593147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:28.593147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:28.593147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:28.593147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:28.593147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:28.593147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:28.593147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:28.593147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:28.593147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:28.593147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:28.593147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:28.593147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:30:28.593147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:30:28.593147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:30:28.593147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:30:28.594100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:30:28.594100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:30:28.594100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:30:28.594100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:30:28.594100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:28.594100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:28.594100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:28.594100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:28.594100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:28.594100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:28.594100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:28.594100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:28.594100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:28.594100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:28.594100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:28.594100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:28.594994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:28.594994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:28.594994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:28.594994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:28.594994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:30:28.594994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:30:28.594994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:30:28.594994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:30:28.594994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:30:28.594994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:30:28.594994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:30:28.594994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:28.594994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 493/972] 10.222.0.76 () {56 vars in 1120 bytes} [Mon Jul 18 16:30:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:28.600497 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f144088-c92e-4765-a50f-9d131ec3a513 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:28.615601 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec87bdb9-653d-4790-a671-1e2dcef589cf None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:28.628510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:28.654024 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa7208-25a8-4282-b387-2b4f5a5d96ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:28.654717 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa7208-25a8-4282-b387-2b4f5a5d96ea None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:28.654994 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa7208-25a8-4282-b387-2b4f5a5d96ea None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:28.655261 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa7208-25a8-4282-b387-2b4f5a5d96ea None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:28.655982 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa7208-25a8-4282-b387-2b4f5a5d96ea None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:28.656336 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa7208-25a8-4282-b387-2b4f5a5d96ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:28.657691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa7208-25a8-4282-b387-2b4f5a5d96ea None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:28.662939 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 480/973] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Jul 18 16:30:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:28.669087 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa7208-25a8-4282-b387-2b4f5a5d96ea None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:28.701684 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:28.720464 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f144088-c92e-4765-a50f-9d131ec3a513 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:28.758709 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a28419-30cc-4669-bd75-fce614b57997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:28.759377 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a28419-30cc-4669-bd75-fce614b57997 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:28.759669 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a28419-30cc-4669-bd75-fce614b57997 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:28.760091 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a28419-30cc-4669-bd75-fce614b57997 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:28.761172 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a28419-30cc-4669-bd75-fce614b57997 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:28.761491 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a28419-30cc-4669-bd75-fce614b57997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:28.762920 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a28419-30cc-4669-bd75-fce614b57997 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:28.776652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 494/974] 10.222.0.76 () {56 vars in 1115 bytes} [Mon Jul 18 16:30:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:28.778090 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa7208-25a8-4282-b387-2b4f5a5d96ea None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:28.779870 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a28419-30cc-4669-bd75-fce614b57997 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:28.815273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eef2a39-ead7-4e09-be25-1c120a510af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:28.815946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef2a39-ead7-4e09-be25-1c120a510af5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:28.816252 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef2a39-ead7-4e09-be25-1c120a510af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:28.816533 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eef2a39-ead7-4e09-be25-1c120a510af5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:28.817371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef2a39-ead7-4e09-be25-1c120a510af5 None admin] RBAC: Adding query filter params (interface=admin, service_id=8210e08c11004da5bd8964a694728d5e, region_id=RegionOne) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:28.817688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef2a39-ead7-4e09-be25-1c120a510af5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:28.819068 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eef2a39-ead7-4e09-be25-1c120a510af5 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:28.824416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 481/975] 10.222.0.76 () {56 vars in 1249 bytes} [Mon Jul 18 16:30:28 2022] GET /identity/v3/endpoints?service_id=8210e08c11004da5bd8964a694728d5e&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:28.826211 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f66aa3-bd61-4933-8561-d00dcf26b1ee None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:28.826495 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f66aa3-bd61-4933-8561-d00dcf26b1ee None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:28.826783 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f66aa3-bd61-4933-8561-d00dcf26b1ee None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:28.828711 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 482/976] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:28.829774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f66aa3-bd61-4933-8561-d00dcf26b1ee None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:28.876692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:28.892014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a28419-30cc-4669-bd75-fce614b57997 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:28.926916 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc1da8-6fdd-4a4a-b03a-25378f88bd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:28.927724 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc1da8-6fdd-4a4a-b03a-25378f88bd02 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:28.927834 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:28.928122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc1da8-6fdd-4a4a-b03a-25378f88bd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:28.928412 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc1da8-6fdd-4a4a-b03a-25378f88bd02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:28.936477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f66aa3-bd61-4933-8561-d00dcf26b1ee None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:28.940078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc1da8-6fdd-4a4a-b03a-25378f88bd02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:28.941561 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc1da8-6fdd-4a4a-b03a-25378f88bd02 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:28.959299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-84cc1da8-6fdd-4a4a-b03a-25378f88bd02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:28.959299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:28.959299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:28.959299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:28.959299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:28.959299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:28.959299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:28.959299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:28.959299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:28.959299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:28.959299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:28.959299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:28.959299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:28.959299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:28.959299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:28.960386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:28.960386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:28.960386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:28.960386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:28.960386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:28.960386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:28.960386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:28.960386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:28.960386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:28.960386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:28.960386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:28.960386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:28.960386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:28.960386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:28.960386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:28.960386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:28.960386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:28.961745 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:28.961745 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:28.961745 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:28.961745 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:28.961745 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 495/977] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:28.962029 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e25bc-13f4-4e64-bb57-8ecdccb1abe7 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:28.962097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e25bc-13f4-4e64-bb57-8ecdccb1abe7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:28.962386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e25bc-13f4-4e64-bb57-8ecdccb1abe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:28.976972 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7e729-bb4c-4166-b5ab-419d643a9af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:28.977632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7e729-bb4c-4166-b5ab-419d643a9af0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:28.977920 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7e729-bb4c-4166-b5ab-419d643a9af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:28.978308 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a7e729-bb4c-4166-b5ab-419d643a9af0 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:28.979001 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7e729-bb4c-4166-b5ab-419d643a9af0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:28.979871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c94e25bc-13f4-4e64-bb57-8ecdccb1abe7 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:28.980314 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a7e729-bb4c-4166-b5ab-419d643a9af0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:28.981091 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c94e25bc-13f4-4e64-bb57-8ecdccb1abe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:28.986509 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 483/978] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Jul 18 16:30:28 2022] GET /identity/v3/services => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:30:28.987290 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7e729-bb4c-4166-b5ab-419d643a9af0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:29.076360 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 496/979] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:29.091037 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e25bc-13f4-4e64-bb57-8ecdccb1abe7 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:29.114555 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a7e729-bb4c-4166-b5ab-419d643a9af0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:29.166244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:29.170151 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131e17b-2bae-4cb4-bb5f-5fb754bb6767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:29.170151 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131e17b-2bae-4cb4-bb5f-5fb754bb6767 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:29.170151 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131e17b-2bae-4cb4-bb5f-5fb754bb6767 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:29.170151 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e131e17b-2bae-4cb4-bb5f-5fb754bb6767 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:29.170862 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131e17b-2bae-4cb4-bb5f-5fb754bb6767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:29.170862 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131e17b-2bae-4cb4-bb5f-5fb754bb6767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:29.170862 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e131e17b-2bae-4cb4-bb5f-5fb754bb6767 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:29.185400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 484/980] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:29.191027 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131e17b-2bae-4cb4-bb5f-5fb754bb6767 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:29.207690 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e25bc-13f4-4e64-bb57-8ecdccb1abe7 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:29.213182 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:29.245239 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c3f0d-bfea-4354-ab7c-ebfb226d9ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:29.245901 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c3f0d-bfea-4354-ab7c-ebfb226d9ef4 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:29.246186 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c3f0d-bfea-4354-ab7c-ebfb226d9ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:29.246463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c3f0d-bfea-4354-ab7c-ebfb226d9ef4 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:29.247189 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c3f0d-bfea-4354-ab7c-ebfb226d9ef4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:29.248578 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c3f0d-bfea-4354-ab7c-ebfb226d9ef4 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:29.297744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e131e17b-2bae-4cb4-bb5f-5fb754bb6767 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:29.333546 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc35b5e-65e3-432c-ad98-ecc4ea5e1f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:29.334426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 497/981] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 16:30:29 2022] POST /identity/v3/services => generated 242 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:30:29.334555 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc35b5e-65e3-432c-ad98-ecc4ea5e1f0b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:29.334636 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc35b5e-65e3-432c-ad98-ecc4ea5e1f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:29.334864 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc35b5e-65e3-432c-ad98-ecc4ea5e1f0b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:29.343435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc35b5e-65e3-432c-ad98-ecc4ea5e1f0b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:29.344961 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc35b5e-65e3-432c-ad98-ecc4ea5e1f0b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:29.361402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-ecc35b5e-65e3-432c-ad98-ecc4ea5e1f0b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:30:29.361402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:29.361402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:29.361402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:29.361402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:29.361402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:29.361402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:29.361402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:29.361402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:29.361402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:29.361402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:29.361402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:29.361402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:30:29.361402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:30:29.361402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:30:29.361402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:30:29.362522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:29.362522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:29.362522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:30:29.362522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:29.362522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:30:29.362522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:29.362522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:29.362522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:29.362522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:29.362522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:29.362522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:29.362522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:29.362522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:29.362522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:29.362522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:29.362522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:29.362522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:29.362522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:29.363572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:29.363572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:29.363572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:30:29.363572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:30:29.363572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:30:29.363572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:30:29.363572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:30:29.363572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:30:29.363572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 18 16:30:29.363572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:29.365384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 485/982] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Jul 18 16:30:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:29.369476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c3f0d-bfea-4354-ab7c-ebfb226d9ef4 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:29.495097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c3f0d-bfea-4354-ab7c-ebfb226d9ef4 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:29.523986 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:29.538038 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a56f11-136c-447f-b6b4-c4302684d994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:29.538731 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a56f11-136c-447f-b6b4-c4302684d994 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:29.539017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a56f11-136c-447f-b6b4-c4302684d994 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:29.539298 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a56f11-136c-447f-b6b4-c4302684d994 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:29.540159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a56f11-136c-447f-b6b4-c4302684d994 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:29.540476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a56f11-136c-447f-b6b4-c4302684d994 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:29.542660 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a56f11-136c-447f-b6b4-c4302684d994 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:29.562958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 498/983] 10.222.0.76 () {56 vars in 1149 bytes} [Mon Jul 18 16:30:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:29.568570 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc35b5e-65e3-432c-ad98-ecc4ea5e1f0b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:29.654884 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:29.681077 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc35b5e-65e3-432c-ad98-ecc4ea5e1f0b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:29.732844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26df14-8da7-4713-84e8-5ab1039c8a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:29.733736 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26df14-8da7-4713-84e8-5ab1039c8a0e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:29.734030 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26df14-8da7-4713-84e8-5ab1039c8a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:29.734310 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26df14-8da7-4713-84e8-5ab1039c8a0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:29.815724 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26df14-8da7-4713-84e8-5ab1039c8a0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:29.817226 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26df14-8da7-4713-84e8-5ab1039c8a0e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:29.915196 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:29.943236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 486/984] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:30:29 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:30:29.950045 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a56f11-136c-447f-b6b4-c4302684d994 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:30.086440 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a56f11-136c-447f-b6b4-c4302684d994 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:30.132634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde71938-a409-4e69-b363-c4d8f4102062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:30.133785 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde71938-a409-4e69-b363-c4d8f4102062 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:30.134221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde71938-a409-4e69-b363-c4d8f4102062 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:30.134738 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde71938-a409-4e69-b363-c4d8f4102062 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:30.149784 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde71938-a409-4e69-b363-c4d8f4102062 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:30.152125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde71938-a409-4e69-b363-c4d8f4102062 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:30.172896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-dde71938-a409-4e69-b363-c4d8f4102062 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:30.172896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:30.172896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:30.172896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:30.172896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:30.172896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:30.172896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:30.172896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:30.172896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:30.172896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:30.172896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:30.172896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:30.172896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:30.172896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:30.172896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:30.173924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:30.173924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:30.173924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:30.173924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:30.173924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:30.173924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:30.173924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:30.173924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:30.173924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:30.173924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:30.173924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:30.173924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:30.173924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:30.173924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:30.173924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:30.173924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:30.173924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:30.174957 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:30.174957 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:30.174957 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:30.174957 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:30.174957 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 499/985] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:30.189034 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26df14-8da7-4713-84e8-5ab1039c8a0e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:30.293860 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26df14-8da7-4713-84e8-5ab1039c8a0e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:30.332718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879e0ce-5d5c-40b6-8631-ad3e8db496b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:30.333427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879e0ce-5d5c-40b6-8631-ad3e8db496b9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:30.333713 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879e0ce-5d5c-40b6-8631-ad3e8db496b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:30.333987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5879e0ce-5d5c-40b6-8631-ad3e8db496b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:30.334714 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879e0ce-5d5c-40b6-8631-ad3e8db496b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:30.335020 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879e0ce-5d5c-40b6-8631-ad3e8db496b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:30.336382 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5879e0ce-5d5c-40b6-8631-ad3e8db496b9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:30.349959 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 487/986] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:30.355606 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde71938-a409-4e69-b363-c4d8f4102062 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:30.387523 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:30.466670 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde71938-a409-4e69-b363-c4d8f4102062 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:30.501634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d5b67-6fe8-44b1-bbc9-6ca1e9a954b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:30.503134 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d5b67-6fe8-44b1-bbc9-6ca1e9a954b9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:30.503571 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d5b67-6fe8-44b1-bbc9-6ca1e9a954b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:30.503998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d5b67-6fe8-44b1-bbc9-6ca1e9a954b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:30.512171 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d5b67-6fe8-44b1-bbc9-6ca1e9a954b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:30.513831 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d5b67-6fe8-44b1-bbc9-6ca1e9a954b9 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:30.528928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-225d5b67-6fe8-44b1-bbc9-6ca1e9a954b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:30.528928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:30.528928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:30.528928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:30.528928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:30.528928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:30.528928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:30.528928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:30.528928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:30.528928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:30.528928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:30.528928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:30.528928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:30:30.528928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:30:30.528928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:30:30.530058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:30:30.530058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:30.530058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:30.530058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:30.530058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:30.530058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:30.530058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:30.530058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:30.530058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:30.530058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:30.530058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:30.530058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:30.530058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:30.530058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:30.530058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:30.530058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:30.530058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:30.531099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:30:30.531099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:30:30.531099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:30:30.531099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:30:30.531099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:30:30.531099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:30:30.531099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:30.531099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:30.533385 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 500/987] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:30:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:30.539510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879e0ce-5d5c-40b6-8631-ad3e8db496b9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:30.585223 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:30.651329 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5879e0ce-5d5c-40b6-8631-ad3e8db496b9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:30.690220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfdf69-e5d7-4a92-8547-4330829eccfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:30.690891 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfdf69-e5d7-4a92-8547-4330829eccfa None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:30.691179 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfdf69-e5d7-4a92-8547-4330829eccfa None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:30.691463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfdf69-e5d7-4a92-8547-4330829eccfa None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:30.692256 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfdf69-e5d7-4a92-8547-4330829eccfa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:30.692569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfdf69-e5d7-4a92-8547-4330829eccfa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:30.694028 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfdf69-e5d7-4a92-8547-4330829eccfa None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:30.707802 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 488/988] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:30:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:30.715086 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d5b67-6fe8-44b1-bbc9-6ca1e9a954b9 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:30.827450 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:30.836578 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d5b67-6fe8-44b1-bbc9-6ca1e9a954b9 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:30.876082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14545f-c516-42b9-85c0-5291aa84c280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:30.876841 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14545f-c516-42b9-85c0-5291aa84c280 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:30.877166 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14545f-c516-42b9-85c0-5291aa84c280 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:30.877442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14545f-c516-42b9-85c0-5291aa84c280 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:30.878276 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14545f-c516-42b9-85c0-5291aa84c280 None admin] RBAC: Adding query filter params (role.id=96360c5874dd4a1f87b4695f1088f5b1, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=ff65e481807b4344897b1499cd450f9d) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:30.878580 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14545f-c516-42b9-85c0-5291aa84c280 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:30.880828 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14545f-c516-42b9-85c0-5291aa84c280 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:30.893092 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 501/989] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:30:30 2022] GET /identity/v3/role_assignments?user.id=ff65e481807b4344897b1499cd450f9d&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=96360c5874dd4a1f87b4695f1088f5b1 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:31.109854 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8d7c1-a54b-4a5d-b08c-42bf0a213344 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:31.110065 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8d7c1-a54b-4a5d-b08c-42bf0a213344 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:31.110385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8d7c1-a54b-4a5d-b08c-42bf0a213344 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:31.111818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 489/990] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:31.116965 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794e1e3-c2c9-4e78-b02f-176d995f479a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:31.117308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794e1e3-c2c9-4e78-b02f-176d995f479a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:31.117591 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794e1e3-c2c9-4e78-b02f-176d995f479a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:31.135646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-1794e1e3-c2c9-4e78-b02f-176d995f479a None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:31.136841 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1794e1e3-c2c9-4e78-b02f-176d995f479a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:31.219325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 502/991] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:31.242320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8d7c1-a54b-4a5d-b08c-42bf0a213344 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:31.346350 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:31.351602 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8d7c1-a54b-4a5d-b08c-42bf0a213344 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:31.388294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc03262-0c68-452b-a483-88ca16cae2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:31.388294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc03262-0c68-452b-a483-88ca16cae2bd None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:31.388294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc03262-0c68-452b-a483-88ca16cae2bd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:31.388627 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc03262-0c68-452b-a483-88ca16cae2bd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:31.389065 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc03262-0c68-452b-a483-88ca16cae2bd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:31.392001 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc03262-0c68-452b-a483-88ca16cae2bd None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:31.405549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-4cc03262-0c68-452b-a483-88ca16cae2bd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:30:31.405549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:31.405549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:30:31.405549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:30:31.405549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:30:31.405549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:30:31.405549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:30:31.405549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:31.405549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:30:31.405549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:31.405549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:31.405549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:31.405549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:31.405549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:31.405549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:31.405549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:31.405549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:31.406646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:31.406646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:31.406646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:31.406646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:31.406646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:31.406646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:31.406646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:30:31.406646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:30:31.406646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:30:31.406646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:30:31.406646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:31.406646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:31.406646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:31.406646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:31.406646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:31.406646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:31.407517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:31.407517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:31.407517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:31.407517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:31.407517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:31.407517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:31.407517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:31.407517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:31.407517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:31.407517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:31.407517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:30:31.407517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:31.407517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 18 16:30:31.407517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:31.408958 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 490/992] 10.222.0.76 () {56 vars in 1126 bytes} [Mon Jul 18 16:30:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:31.412756 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794e1e3-c2c9-4e78-b02f-176d995f479a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:31.492618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d3431-4ceb-47ce-980c-6961a17cdf66 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:31.492904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d3431-4ceb-47ce-980c-6961a17cdf66 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:31.493218 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d3431-4ceb-47ce-980c-6961a17cdf66 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:31.499982 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 491/993] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:30:31.501262 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009527a-26fa-4cda-8863-fbb26e396523 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:31.501555 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009527a-26fa-4cda-8863-fbb26e396523 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:31.501829 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009527a-26fa-4cda-8863-fbb26e396523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:31.507826 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:31.519903 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-7009527a-26fa-4cda-8863-fbb26e396523 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:31.526405 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7009527a-26fa-4cda-8863-fbb26e396523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:31.526541 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794e1e3-c2c9-4e78-b02f-176d995f479a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:31.561883 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c96b92-0234-4725-82bc-8026742dbbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:31.562555 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c96b92-0234-4725-82bc-8026742dbbbf None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:31.562858 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c96b92-0234-4725-82bc-8026742dbbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:31.563133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c96b92-0234-4725-82bc-8026742dbbbf None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:31.563842 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c96b92-0234-4725-82bc-8026742dbbbf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:31.564147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c96b92-0234-4725-82bc-8026742dbbbf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:31.566198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c96b92-0234-4725-82bc-8026742dbbbf None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:31.573398 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 503/994] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Jul 18 16:30:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:31.579180 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c96b92-0234-4725-82bc-8026742dbbbf None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:31.598067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 492/995] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:31.625694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009527a-26fa-4cda-8863-fbb26e396523 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:31.716249 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c96b92-0234-4725-82bc-8026742dbbbf None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:31.739219 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:31.750712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009527a-26fa-4cda-8863-fbb26e396523 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:31.762116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760f65b-2f84-4668-8e84-ad2aabb82b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:31.762805 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760f65b-2f84-4668-8e84-ad2aabb82b5d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:31.763086 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760f65b-2f84-4668-8e84-ad2aabb82b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:31.763363 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760f65b-2f84-4668-8e84-ad2aabb82b5d None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:31.764112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760f65b-2f84-4668-8e84-ad2aabb82b5d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:31.764416 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760f65b-2f84-4668-8e84-ad2aabb82b5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:31.765814 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760f65b-2f84-4668-8e84-ad2aabb82b5d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:31.771936 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 504/996] 10.222.0.76 () {56 vars in 1122 bytes} [Mon Jul 18 16:30:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:31.777612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760f65b-2f84-4668-8e84-ad2aabb82b5d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:31.794824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:31.799133 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d0d7f-d0d3-4f60-ae53-21d3c71b8e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:31.800051 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d0d7f-d0d3-4f60-ae53-21d3c71b8e17 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:31.800359 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d0d7f-d0d3-4f60-ae53-21d3c71b8e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:31.800723 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d0d7f-d0d3-4f60-ae53-21d3c71b8e17 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:31.801368 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d0d7f-d0d3-4f60-ae53-21d3c71b8e17 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:31.802756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9d0d7f-d0d3-4f60-ae53-21d3c71b8e17 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:31.820148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-9b9d0d7f-d0d3-4f60-ae53-21d3c71b8e17 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 16:30:31.820148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:31.820148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:30:31.820148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:30:31.820148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:30:31.820148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:30:31.820148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:30:31.820148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:31.820148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 16:30:31.820148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:31.820148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:31.820148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:31.820148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:31.820148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:31.820148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:31.820148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:31.820148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:31.821423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:31.821423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:31.821423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:31.821423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:31.821423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:31.821423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:31.821423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:30:31.821423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:30:31.821423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:30:31.821423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:30:31.821423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:31.821423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:31.821423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:31.821423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:31.821423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:31.821423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:31.823021 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:31.823021 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:31.823021 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:31.823021 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:31.823021 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:31.823021 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:31.823021 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:31.823021 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:31.823021 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:31.823021 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:31.823021 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:30:31.823021 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:31.823021 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 16:30:31.823021 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:31.823021 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 493/997] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:30:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:31.831597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d0d7f-d0d3-4f60-ae53-21d3c71b8e17 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:31.913770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760f65b-2f84-4668-8e84-ad2aabb82b5d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:31.970044 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9d0d7f-d0d3-4f60-ae53-21d3c71b8e17 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:31.971441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a9351-258b-4cc0-9a25-633392f065a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:31.971669 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a9351-258b-4cc0-9a25-633392f065a6 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:31.971989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a9351-258b-4cc0-9a25-633392f065a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:31.972279 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663a9351-258b-4cc0-9a25-633392f065a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:31.973073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a9351-258b-4cc0-9a25-633392f065a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:31.974500 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663a9351-258b-4cc0-9a25-633392f065a6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:32.020998 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4acb3-b37a-45b1-9f87-6f1df8aa7807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:32.021705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4acb3-b37a-45b1-9f87-6f1df8aa7807 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:32.021989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4acb3-b37a-45b1-9f87-6f1df8aa7807 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:32.022267 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd4acb3-b37a-45b1-9f87-6f1df8aa7807 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:32.022995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4acb3-b37a-45b1-9f87-6f1df8aa7807 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:32.023381 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4acb3-b37a-45b1-9f87-6f1df8aa7807 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:32.024764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd4acb3-b37a-45b1-9f87-6f1df8aa7807 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:32.031119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 494/998] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 16:30:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:32.036866 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4acb3-b37a-45b1-9f87-6f1df8aa7807 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:32.065088 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:32.066528 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 505/999] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Jul 18 16:30:31 2022] POST /identity/v3/endpoints => generated 325 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:30:32.186701 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd4acb3-b37a-45b1-9f87-6f1df8aa7807 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:32.242142 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c77e64-3dfa-40ca-8fa5-5b7821877e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:32.242744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c77e64-3dfa-40ca-8fa5-5b7821877e38 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:32.243303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c77e64-3dfa-40ca-8fa5-5b7821877e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:32.243303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c77e64-3dfa-40ca-8fa5-5b7821877e38 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:32.244886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c77e64-3dfa-40ca-8fa5-5b7821877e38 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:32.245895 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c77e64-3dfa-40ca-8fa5-5b7821877e38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:32.246930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c77e64-3dfa-40ca-8fa5-5b7821877e38 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:32.254226 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 495/1000] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 16:30:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:32.259951 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a9351-258b-4cc0-9a25-633392f065a6 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:32.362281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:32.396767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663a9351-258b-4cc0-9a25-633392f065a6 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:32.434306 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78b606-1fcb-486a-81ba-fbc49b80822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:32.434994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78b606-1fcb-486a-81ba-fbc49b80822d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:32.435279 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78b606-1fcb-486a-81ba-fbc49b80822d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:32.435561 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78b606-1fcb-486a-81ba-fbc49b80822d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:32.436405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78b606-1fcb-486a-81ba-fbc49b80822d None admin] RBAC: Adding query filter params (interface=public, service_id=f9ac7acea047497597d3984485da0189, region_id=RegionOne) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:32.436679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78b606-1fcb-486a-81ba-fbc49b80822d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:32.438106 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78b606-1fcb-486a-81ba-fbc49b80822d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:32.450735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 506/1001] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Jul 18 16:30:32 2022] GET /identity/v3/endpoints?service_id=f9ac7acea047497597d3984485da0189&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:32.450871 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c77e64-3dfa-40ca-8fa5-5b7821877e38 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:32.560933 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:32.589417 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c77e64-3dfa-40ca-8fa5-5b7821877e38 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:32.636056 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a58c1d-7e9d-43ff-ba3a-b9dd31d4efe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:32.637311 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a58c1d-7e9d-43ff-ba3a-b9dd31d4efe8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:32.637311 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a58c1d-7e9d-43ff-ba3a-b9dd31d4efe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:32.637311 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a58c1d-7e9d-43ff-ba3a-b9dd31d4efe8 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:32.637992 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a58c1d-7e9d-43ff-ba3a-b9dd31d4efe8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:32.639384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a58c1d-7e9d-43ff-ba3a-b9dd31d4efe8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:32.646633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 496/1002] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Jul 18 16:30:32 2022] GET /identity/v3/services => generated 1727 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:30:33.020533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931bf73-808a-44d1-8bc3-f6405142fc14 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:33.021081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931bf73-808a-44d1-8bc3-f6405142fc14 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:33.021081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6931bf73-808a-44d1-8bc3-f6405142fc14 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:33.022385 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 507/1003] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:33.028544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68335f-7ff9-4d77-95a8-1fb850359515 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:33.028838 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68335f-7ff9-4d77-95a8-1fb850359515 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:33.029187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa68335f-7ff9-4d77-95a8-1fb850359515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:33.046949 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-aa68335f-7ff9-4d77-95a8-1fb850359515 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:33.048519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-aa68335f-7ff9-4d77-95a8-1fb850359515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:33.155756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 497/1004] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:33 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:33.182514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931bf73-808a-44d1-8bc3-f6405142fc14 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:33.329769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6931bf73-808a-44d1-8bc3-f6405142fc14 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:33.379273 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4dedef-1a9a-4a73-99e3-798ecbfb037c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:33.380088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dedef-1a9a-4a73-99e3-798ecbfb037c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:33.380372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dedef-1a9a-4a73-99e3-798ecbfb037c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:33.380645 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4dedef-1a9a-4a73-99e3-798ecbfb037c None admin] PATH_INFO: `/v3/services/image` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:33.381332 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4dedef-1a9a-4a73-99e3-798ecbfb037c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:33.382898 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4dedef-1a9a-4a73-99e3-798ecbfb037c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:33.396639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-9a4dedef-1a9a-4a73-99e3-798ecbfb037c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 16:30:33.396639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:33.396639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:30:33.396639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:30:33.396639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:30:33.396639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:30:33.396639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:30:33.396639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:33.396639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 16:30:33.396639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:33.396639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:33.396639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:33.396639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:33.396639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:33.396639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:33.396639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:33.396639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:33.397946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:33.397946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:33.397946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:33.397946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:33.397946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:33.397946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:33.397946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:30:33.397946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:30:33.397946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:30:33.397946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:30:33.397946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:33.397946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:33.397946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:33.397946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:33.397946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:33.397946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:33.398943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:33.398943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:33.398943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:33.398943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:33.398943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:33.398943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:33.398943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:33.398943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:33.398943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:33.398943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:33.398943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:30:33.398943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:33.398943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 16:30:33.398943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:33.398943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 508/1005] 10.222.0.76 () {56 vars in 1105 bytes} [Mon Jul 18 16:30:33 2022] GET /identity/v3/services/image => generated 86 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:33.406315 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68335f-7ff9-4d77-95a8-1fb850359515 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:33.487972 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:33.515354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa68335f-7ff9-4d77-95a8-1fb850359515 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:33.555175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70dc48-b52b-4a35-95a9-024b733f985d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:33.555992 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70dc48-b52b-4a35-95a9-024b733f985d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:33.556168 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70dc48-b52b-4a35-95a9-024b733f985d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:33.556490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70dc48-b52b-4a35-95a9-024b733f985d None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:33.558168 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70dc48-b52b-4a35-95a9-024b733f985d None admin] RBAC: Adding query filter params (name=image) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:33.558168 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70dc48-b52b-4a35-95a9-024b733f985d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:33.559059 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af70dc48-b52b-4a35-95a9-024b733f985d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:33.564621 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 498/1006] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:33.570352 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4dedef-1a9a-4a73-99e3-798ecbfb037c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:33.574095 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:33.691294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4dedef-1a9a-4a73-99e3-798ecbfb037c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:33.765757 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5edbb18-f1c2-4a1d-a398-a707fa673009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:33.766457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edbb18-f1c2-4a1d-a398-a707fa673009 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:33.766742 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edbb18-f1c2-4a1d-a398-a707fa673009 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:33.767020 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5edbb18-f1c2-4a1d-a398-a707fa673009 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:33.767751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edbb18-f1c2-4a1d-a398-a707fa673009 None admin] RBAC: Adding query filter params (type=image) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:33.768062 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edbb18-f1c2-4a1d-a398-a707fa673009 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:33.769653 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5edbb18-f1c2-4a1d-a398-a707fa673009 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:33.780465 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 509/1007] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:33 2022] GET /identity/v3/services?type=image => generated 122 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:34.202083 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c767e-9e8a-47ee-b26c-48a02fdeb00f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:34.202342 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c767e-9e8a-47ee-b26c-48a02fdeb00f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:34.202669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c767e-9e8a-47ee-b26c-48a02fdeb00f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:34.204008 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 499/1008] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:34.210248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff77f7-67e2-47b2-aa72-dd4cb5d2a755 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:34.210804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff77f7-67e2-47b2-aa72-dd4cb5d2a755 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:34.210804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ff77f7-67e2-47b2-aa72-dd4cb5d2a755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:34.228751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-10ff77f7-67e2-47b2-aa72-dd4cb5d2a755 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:34.230001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-10ff77f7-67e2-47b2-aa72-dd4cb5d2a755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:34.308746 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:34.318542 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 510/1009] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:34 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:34.344372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c767e-9e8a-47ee-b26c-48a02fdeb00f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:34.474401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c767e-9e8a-47ee-b26c-48a02fdeb00f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:34.530449 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6881d-bc7b-4101-9474-dd16ef4ee28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:34.531598 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6881d-bc7b-4101-9474-dd16ef4ee28b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:34.532149 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6881d-bc7b-4101-9474-dd16ef4ee28b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:34.532510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6881d-bc7b-4101-9474-dd16ef4ee28b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:34.533731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6881d-bc7b-4101-9474-dd16ef4ee28b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:34.535193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6881d-bc7b-4101-9474-dd16ef4ee28b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:34.537004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 500/1010] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:34.543066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff77f7-67e2-47b2-aa72-dd4cb5d2a755 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:34.666554 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ff77f7-67e2-47b2-aa72-dd4cb5d2a755 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:34.708221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768539e2-ea39-4a36-83ac-130423420e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:34.709030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768539e2-ea39-4a36-83ac-130423420e17 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:34.709323 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768539e2-ea39-4a36-83ac-130423420e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:34.709627 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768539e2-ea39-4a36-83ac-130423420e17 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:34.710376 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768539e2-ea39-4a36-83ac-130423420e17 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:34.712372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768539e2-ea39-4a36-83ac-130423420e17 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:34.752625 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44eee7-8c4b-4fc8-a904-f44bb3e5369f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:34.752826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44eee7-8c4b-4fc8-a904-f44bb3e5369f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:34.753137 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44eee7-8c4b-4fc8-a904-f44bb3e5369f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:34.757861 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 501/1011] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:30:34.760648 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b137c9c-c4f8-45a9-a238-31b2f1d89737 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:34.761083 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b137c9c-c4f8-45a9-a238-31b2f1d89737 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:34.761398 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b137c9c-c4f8-45a9-a238-31b2f1d89737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:34.773947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:34.781865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4b137c9c-c4f8-45a9-a238-31b2f1d89737 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:34.783239 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4b137c9c-c4f8-45a9-a238-31b2f1d89737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:34.811847 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 511/1012] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 16:30:34 2022] POST /identity/v3/projects => generated 311 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:30:34.880116 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 502/1013] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:34 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:30:34.905077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768539e2-ea39-4a36-83ac-130423420e17 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:34.985452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:35.057585 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768539e2-ea39-4a36-83ac-130423420e17 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:35.105464 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e445fd-20bc-4047-a600-4e2062b046cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:35.106327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e445fd-20bc-4047-a600-4e2062b046cb None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:35.106640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e445fd-20bc-4047-a600-4e2062b046cb None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:35.106891 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e445fd-20bc-4047-a600-4e2062b046cb None admin] PATH_INFO: `/v3/services/compute` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:35.107551 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e445fd-20bc-4047-a600-4e2062b046cb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:35.109063 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e445fd-20bc-4047-a600-4e2062b046cb None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:35.125833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-42e445fd-20bc-4047-a600-4e2062b046cb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 16:30:35.125833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:35.125833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:30:35.125833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:30:35.125833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:30:35.125833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:30:35.125833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:30:35.125833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:35.125833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 16:30:35.125833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:35.125833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:35.125833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:35.125833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:35.125833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:35.125833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:35.125833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:35.125833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:35.126993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:35.126993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:35.126993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:35.126993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:35.126993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:35.126993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:35.126993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:30:35.126993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:30:35.126993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:30:35.126993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:30:35.126993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:35.126993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:35.126993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:35.126993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:35.126993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:35.126993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:35.127930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:35.127930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:35.127930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:35.127930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:35.127930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:35.127930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:35.127930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:35.127930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:35.127930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:35.127930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:35.127930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:30:35.127930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:35.127930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 18 16:30:35.127930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:35.133238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b137c9c-c4f8-45a9-a238-31b2f1d89737 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:35.135693 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 512/1014] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:30:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:35.258697 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b137c9c-c4f8-45a9-a238-31b2f1d89737 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:35.305189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95dfa3-39df-4c1b-b63c-49bf2d290c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:35.306782 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95dfa3-39df-4c1b-b63c-49bf2d290c25 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:35.307284 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95dfa3-39df-4c1b-b63c-49bf2d290c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:35.307826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95dfa3-39df-4c1b-b63c-49bf2d290c25 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:35.308776 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95dfa3-39df-4c1b-b63c-49bf2d290c25 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:35.309366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95dfa3-39df-4c1b-b63c-49bf2d290c25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:35.310990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95dfa3-39df-4c1b-b63c-49bf2d290c25 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:35.313803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:35.317801 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 503/1015] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 16:30:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:35.324204 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e445fd-20bc-4047-a600-4e2062b046cb None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:35.445375 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e445fd-20bc-4047-a600-4e2062b046cb None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:35.460751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:35.484110 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23208f-17c0-4030-bb84-f975c9c54792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:35.484911 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23208f-17c0-4030-bb84-f975c9c54792 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:35.485290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23208f-17c0-4030-bb84-f975c9c54792 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:35.485670 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23208f-17c0-4030-bb84-f975c9c54792 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:35.486460 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23208f-17c0-4030-bb84-f975c9c54792 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:35.486837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23208f-17c0-4030-bb84-f975c9c54792 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:35.488301 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23208f-17c0-4030-bb84-f975c9c54792 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:35.499833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 513/1016] 10.222.0.76 () {56 vars in 1112 bytes} [Mon Jul 18 16:30:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:35.502643 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95dfa3-39df-4c1b-b63c-49bf2d290c25 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:35.647299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95dfa3-39df-4c1b-b63c-49bf2d290c25 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:35.694121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93333f-009a-4184-b2bb-b22259fc1330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:35.695177 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93333f-009a-4184-b2bb-b22259fc1330 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:35.695565 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93333f-009a-4184-b2bb-b22259fc1330 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:35.695951 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93333f-009a-4184-b2bb-b22259fc1330 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:35.697680 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93333f-009a-4184-b2bb-b22259fc1330 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:35.699311 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93333f-009a-4184-b2bb-b22259fc1330 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:35.797871 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 504/1017] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Jul 18 16:30:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:30:35.920165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c727066-27e1-406b-bf07-b30c60219f08 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:35.920165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c727066-27e1-406b-bf07-b30c60219f08 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:35.920165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c727066-27e1-406b-bf07-b30c60219f08 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:35.921876 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 514/1018] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:35.934687 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc4501-96ff-4d8e-baec-1356ffd369bd None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:35.934687 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc4501-96ff-4d8e-baec-1356ffd369bd None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:35.934687 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc4501-96ff-4d8e-baec-1356ffd369bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:35.954777 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-fffc4501-96ff-4d8e-baec-1356ffd369bd None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:35.957601 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fffc4501-96ff-4d8e-baec-1356ffd369bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:36.032231 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:36.061665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 505/1019] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:35 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:36.086158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c727066-27e1-406b-bf07-b30c60219f08 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:36.252534 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c727066-27e1-406b-bf07-b30c60219f08 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:36.299790 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88bce40-a9a1-48f6-b3f5-bcbebfefce78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:36.300624 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bce40-a9a1-48f6-b3f5-bcbebfefce78 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:36.300947 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bce40-a9a1-48f6-b3f5-bcbebfefce78 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:36.301450 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88bce40-a9a1-48f6-b3f5-bcbebfefce78 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:36.302168 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88bce40-a9a1-48f6-b3f5-bcbebfefce78 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:36.303635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88bce40-a9a1-48f6-b3f5-bcbebfefce78 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:36.408295 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 515/1020] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 16:30:36 2022] POST /identity/v3/services => generated 242 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:30:37.078472 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b5e0a-d277-4156-8d59-55a0392a8a0b None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:37.079035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b5e0a-d277-4156-8d59-55a0392a8a0b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:37.079035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b5e0a-d277-4156-8d59-55a0392a8a0b None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:37.080593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 506/1021] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:37.086076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf25a7-3c3e-43ea-a64c-ecb16bf19163 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:37.086367 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf25a7-3c3e-43ea-a64c-ecb16bf19163 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:37.086653 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf25a7-3c3e-43ea-a64c-ecb16bf19163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:37.105368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-4adf25a7-3c3e-43ea-a64c-ecb16bf19163 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:37.106592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4adf25a7-3c3e-43ea-a64c-ecb16bf19163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:37.140434 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:37.199523 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 516/1022] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:37 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:37.224321 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b5e0a-d277-4156-8d59-55a0392a8a0b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:37.355354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b5e0a-d277-4156-8d59-55a0392a8a0b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:37.396734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d06b7-afeb-4221-917c-061e385789c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:37.397590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d06b7-afeb-4221-917c-061e385789c0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:37.397872 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d06b7-afeb-4221-917c-061e385789c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:37.398152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d06b7-afeb-4221-917c-061e385789c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:37.399869 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d06b7-afeb-4221-917c-061e385789c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:37.401415 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d06b7-afeb-4221-917c-061e385789c0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:37.407804 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 507/1023] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:37.408951 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf25a7-3c3e-43ea-a64c-ecb16bf19163 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:37.544967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf25a7-3c3e-43ea-a64c-ecb16bf19163 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:37.590306 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485a2f0-510c-4155-b133-723dff69ff01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:37.591023 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485a2f0-510c-4155-b133-723dff69ff01 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:37.591309 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485a2f0-510c-4155-b133-723dff69ff01 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:37.591587 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485a2f0-510c-4155-b133-723dff69ff01 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:37.592336 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485a2f0-510c-4155-b133-723dff69ff01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:37.593964 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485a2f0-510c-4155-b133-723dff69ff01 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:37.715098 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 517/1024] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 16:30:37 2022] POST /identity/v3/users => generated 285 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:30:38.101548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae705e7-0dc5-414c-a5c8-0dece0514dfc None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:38.102103 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae705e7-0dc5-414c-a5c8-0dece0514dfc None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:38.102103 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae705e7-0dc5-414c-a5c8-0dece0514dfc None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:38.104137 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 508/1025] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:38.109668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4eaaaa-a04a-4fed-a708-be67ac1e59bb None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:38.109948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4eaaaa-a04a-4fed-a708-be67ac1e59bb None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:38.110257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4eaaaa-a04a-4fed-a708-be67ac1e59bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:38.128917 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-ee4eaaaa-a04a-4fed-a708-be67ac1e59bb None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:38.130223 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ee4eaaaa-a04a-4fed-a708-be67ac1e59bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:38.149067 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:38.225055 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 518/1026] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:38.248750 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae705e7-0dc5-414c-a5c8-0dece0514dfc None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:38.313167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:38.375450 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae705e7-0dc5-414c-a5c8-0dece0514dfc None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:38.417862 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da085cd3-6ef3-40bd-9aa6-f5d1820f32b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:38.419177 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da085cd3-6ef3-40bd-9aa6-f5d1820f32b0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:38.419649 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da085cd3-6ef3-40bd-9aa6-f5d1820f32b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:38.420117 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da085cd3-6ef3-40bd-9aa6-f5d1820f32b0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:38.432755 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da085cd3-6ef3-40bd-9aa6-f5d1820f32b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:30:38.441190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-da085cd3-6ef3-40bd-9aa6-f5d1820f32b0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:30:38.441190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:38.441190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:38.441190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:38.441190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:38.441190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:38.441190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:38.441190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:38.441190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:38.441190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:38.441190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:38.441190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:38.441190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:30:38.441190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:30:38.441190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:30:38.441190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:30:38.444665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:30:38.444665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:30:38.444665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:30:38.444665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:30:38.444665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:38.444665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:38.444665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:38.444665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:38.444665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:38.444665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:38.444665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:38.444665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:38.444665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:38.444665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:38.444665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:38.444665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:38.445694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:38.445694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:38.445694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:38.445694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:38.445694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:30:38.445694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:30:38.445694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:30:38.445694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:30:38.445694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:30:38.445694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:30:38.445694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:30:38.445694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:38.445694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 509/1027] 10.222.0.76 () {56 vars in 1120 bytes} [Mon Jul 18 16:30:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:38.451726 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4eaaaa-a04a-4fed-a708-be67ac1e59bb None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:38.523856 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44b759-097b-42d2-8d6d-f0253b4cd40f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:38.524178 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44b759-097b-42d2-8d6d-f0253b4cd40f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:38.524549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44b759-097b-42d2-8d6d-f0253b4cd40f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:38.525981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 510/1028] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:30:38.531428 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d28d0-f86a-43a8-9544-80f36b52f9a1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:38.531720 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d28d0-f86a-43a8-9544-80f36b52f9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:38.532002 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d28d0-f86a-43a8-9544-80f36b52f9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:38.550341 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-048d28d0-f86a-43a8-9544-80f36b52f9a1 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:38.551549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-048d28d0-f86a-43a8-9544-80f36b52f9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:38.579778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4eaaaa-a04a-4fed-a708-be67ac1e59bb None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:38.629525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8905a-180d-4eaf-b4e5-2239294dd1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:38.630311 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8905a-180d-4eaf-b4e5-2239294dd1d0 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:38.630612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8905a-180d-4eaf-b4e5-2239294dd1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:38.630893 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8905a-180d-4eaf-b4e5-2239294dd1d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:38.631648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8905a-180d-4eaf-b4e5-2239294dd1d0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:38.631958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8905a-180d-4eaf-b4e5-2239294dd1d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:38.633442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8905a-180d-4eaf-b4e5-2239294dd1d0 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:38.641040 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 511/1029] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:30:38.642766 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 519/1030] 10.222.0.76 () {56 vars in 1115 bytes} [Mon Jul 18 16:30:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:38.648316 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d28d0-f86a-43a8-9544-80f36b52f9a1 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:38.667910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8905a-180d-4eaf-b4e5-2239294dd1d0 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:38.686006 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:38.709245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:38.798073 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d28d0-f86a-43a8-9544-80f36b52f9a1 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:38.815440 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8905a-180d-4eaf-b4e5-2239294dd1d0 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:38.844611 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363f677-30d2-4ecb-ab5b-77e2260496aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:38.845446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363f677-30d2-4ecb-ab5b-77e2260496aa None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:38.845734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363f677-30d2-4ecb-ab5b-77e2260496aa None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:38.846013 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363f677-30d2-4ecb-ab5b-77e2260496aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:38.860695 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363f677-30d2-4ecb-ab5b-77e2260496aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:38.862309 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363f677-30d2-4ecb-ab5b-77e2260496aa None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:38.863177 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c22c98-79bf-4276-b05e-57d74d3ff619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:38.864155 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c22c98-79bf-4276-b05e-57d74d3ff619 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:38.864447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c22c98-79bf-4276-b05e-57d74d3ff619 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:38.864721 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c22c98-79bf-4276-b05e-57d74d3ff619 None admin] PATH_INFO: `/v3/services/image` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:38.865739 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c22c98-79bf-4276-b05e-57d74d3ff619 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:38.867088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c22c98-79bf-4276-b05e-57d74d3ff619 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:38.879932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-d0c22c98-79bf-4276-b05e-57d74d3ff619 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 16:30:38.879932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:38.879932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:30:38.879932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:30:38.879932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:30:38.879932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:30:38.879932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:30:38.879932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:38.879932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 16:30:38.879932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:38.879932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:38.879932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:38.879932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:38.879932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:38.879932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:38.879932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:38.879932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:38.880981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:38.880981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:38.880981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:38.880981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:38.880981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:38.880981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:38.880981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:30:38.880981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:30:38.880981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:30:38.880981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:30:38.880981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:38.880981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:38.880981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:38.880981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:38.880981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:38.880981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:38.881878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:38.881878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:38.881878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:38.881878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:38.881878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:38.881878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:38.881878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:38.881878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:38.881878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:38.881878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:38.881878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:30:38.881878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:38.881878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 16:30:38.881878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:38.882718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-c363f677-30d2-4ecb-ab5b-77e2260496aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:38.882718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:38.882718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:38.882718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:38.882718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:38.882718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:38.882718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:38.882718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:38.882718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:38.882718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:38.882718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:38.882718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:38.882718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:38.882718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:38.882718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:38.883548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:38.883548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:38.883548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:38.883548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:38.883548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:38.883548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:38.883548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:38.883548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:38.883548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:38.883548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:38.883548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:38.883548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:38.883548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:38.883548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:38.883548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:38.883548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:38.883548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:38.884804 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:38.884804 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:38.884804 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:38.884804 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:38.886812 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 520/1031] 10.222.0.76 () {56 vars in 1105 bytes} [Mon Jul 18 16:30:38 2022] GET /identity/v3/services/image => generated 86 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:38.889268 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 512/1032] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:38.890298 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c22c98-79bf-4276-b05e-57d74d3ff619 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:38.891534 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363f677-30d2-4ecb-ab5b-77e2260496aa None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:38.984377 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:39.013473 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c22c98-79bf-4276-b05e-57d74d3ff619 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:39.027878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:39.038978 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363f677-30d2-4ecb-ab5b-77e2260496aa None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:39.055024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8a0eb-fd35-4d6f-88a4-5ccc1c87a757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:39.055751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8a0eb-fd35-4d6f-88a4-5ccc1c87a757 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:39.056177 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8a0eb-fd35-4d6f-88a4-5ccc1c87a757 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:39.056467 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b8a0eb-fd35-4d6f-88a4-5ccc1c87a757 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:39.057293 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8a0eb-fd35-4d6f-88a4-5ccc1c87a757 None admin] RBAC: Adding query filter params (name=image) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:39.057602 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8a0eb-fd35-4d6f-88a4-5ccc1c87a757 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:39.058970 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b8a0eb-fd35-4d6f-88a4-5ccc1c87a757 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:39.072288 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 521/1033] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:39.074174 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8a0eb-fd35-4d6f-88a4-5ccc1c87a757 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:39.075284 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327a917-1362-46a5-adfe-8f7be0fd0e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:39.075964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327a917-1362-46a5-adfe-8f7be0fd0e47 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:39.076260 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327a917-1362-46a5-adfe-8f7be0fd0e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:39.076537 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e327a917-1362-46a5-adfe-8f7be0fd0e47 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:39.077310 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327a917-1362-46a5-adfe-8f7be0fd0e47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:39.078629 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327a917-1362-46a5-adfe-8f7be0fd0e47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:39.080538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e327a917-1362-46a5-adfe-8f7be0fd0e47 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:39.094633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 513/1034] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:39.100253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327a917-1362-46a5-adfe-8f7be0fd0e47 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:39.209655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b8a0eb-fd35-4d6f-88a4-5ccc1c87a757 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:39.229402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e327a917-1362-46a5-adfe-8f7be0fd0e47 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:39.255194 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9550de-a410-43e1-8356-1eafebde5745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:39.256153 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9550de-a410-43e1-8356-1eafebde5745 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:39.256592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9550de-a410-43e1-8356-1eafebde5745 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:39.257046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9550de-a410-43e1-8356-1eafebde5745 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:39.257942 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9550de-a410-43e1-8356-1eafebde5745 None admin] RBAC: Adding query filter params (type=image) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:39.258401 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9550de-a410-43e1-8356-1eafebde5745 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:39.259970 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9550de-a410-43e1-8356-1eafebde5745 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:39.265985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 522/1035] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:39.275461 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9550de-a410-43e1-8356-1eafebde5745 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:39.278666 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:39.281196 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805908bd-5900-49ad-8b1d-57293ab98934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:39.282007 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805908bd-5900-49ad-8b1d-57293ab98934 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:39.282292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805908bd-5900-49ad-8b1d-57293ab98934 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:39.282569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805908bd-5900-49ad-8b1d-57293ab98934 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:39.292221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805908bd-5900-49ad-8b1d-57293ab98934 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:39.294451 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805908bd-5900-49ad-8b1d-57293ab98934 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:39.309276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-805908bd-5900-49ad-8b1d-57293ab98934 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:30:39.309276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:39.309276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:39.309276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:39.309276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:39.309276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:39.309276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:39.309276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:39.309276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:39.309276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:39.309276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:39.309276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:39.309276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:30:39.309276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:30:39.309276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:30:39.309276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:30:39.310549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:39.310549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:39.310549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:30:39.310549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:39.310549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:30:39.310549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:39.310549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:39.310549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:39.310549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:39.310549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:39.310549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:39.310549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:39.310549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:39.310549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:39.310549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:39.310549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:39.310549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:39.310549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:39.311676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:39.311676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:39.311676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:30:39.311676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:30:39.311676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:30:39.311676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:30:39.311676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:30:39.311676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:30:39.311676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:30:39.311676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:39.311676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 514/1036] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Jul 18 16:30:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:39.316493 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805908bd-5900-49ad-8b1d-57293ab98934 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:39.335522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:39.400662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9550de-a410-43e1-8356-1eafebde5745 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:39.444352 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887c91a-acad-4831-b163-cec900c4824c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:39.444983 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887c91a-acad-4831-b163-cec900c4824c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:39.445417 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887c91a-acad-4831-b163-cec900c4824c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:39.445711 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887c91a-acad-4831-b163-cec900c4824c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:39.446747 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887c91a-acad-4831-b163-cec900c4824c None admin] RBAC: Adding query filter params (interface=public, service_id=dd06c8d7382f4efeb21df9d1c0010fc7, region_id=RegionOne) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:39.447241 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887c91a-acad-4831-b163-cec900c4824c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:39.447670 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805908bd-5900-49ad-8b1d-57293ab98934 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:39.448624 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887c91a-acad-4831-b163-cec900c4824c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:39.454543 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 523/1037] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Jul 18 16:30:39 2022] GET /identity/v3/endpoints?service_id=dd06c8d7382f4efeb21df9d1c0010fc7&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:39.460094 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887c91a-acad-4831-b163-cec900c4824c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:39.484502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca0958-c4ae-4100-8d01-3239408a8f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:39.485213 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca0958-c4ae-4100-8d01-3239408a8f1f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:39.485502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca0958-c4ae-4100-8d01-3239408a8f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:39.485790 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca0958-c4ae-4100-8d01-3239408a8f1f None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:39.486639 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca0958-c4ae-4100-8d01-3239408a8f1f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:39.486958 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca0958-c4ae-4100-8d01-3239408a8f1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:39.488383 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca0958-c4ae-4100-8d01-3239408a8f1f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:39.507980 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 515/1038] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Jul 18 16:30:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:39.514579 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca0958-c4ae-4100-8d01-3239408a8f1f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:39.546108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:39.600516 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887c91a-acad-4831-b163-cec900c4824c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:39.607785 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:39.641483 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca0958-c4ae-4100-8d01-3239408a8f1f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:39.652321 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ce7e8-901d-4ae7-9601-56f1cd647ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:39.653441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ce7e8-901d-4ae7-9601-56f1cd647ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:39.653797 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ce7e8-901d-4ae7-9601-56f1cd647ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:39.654143 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ce7e8-901d-4ae7-9601-56f1cd647ef1 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:39.655170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ce7e8-901d-4ae7-9601-56f1cd647ef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:39.656351 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ce7e8-901d-4ae7-9601-56f1cd647ef1 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:39.665048 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 524/1039] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Jul 18 16:30:39 2022] GET /identity/v3/services => generated 1957 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:30:39.686012 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c41a04-33dc-4ae9-895d-0417dccf5b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:39.686694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c41a04-33dc-4ae9-895d-0417dccf5b6f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:39.686989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c41a04-33dc-4ae9-895d-0417dccf5b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:39.687274 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c41a04-33dc-4ae9-895d-0417dccf5b6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:39.774784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c41a04-33dc-4ae9-895d-0417dccf5b6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:39.776432 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c41a04-33dc-4ae9-895d-0417dccf5b6f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:39.874768 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:39.894816 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383e3f5-66e6-45fa-84bf-80bb3d5378d5 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:39.895124 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383e3f5-66e6-45fa-84bf-80bb3d5378d5 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:39.895390 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383e3f5-66e6-45fa-84bf-80bb3d5378d5 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:39.896791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 525/1040] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:30:39.902327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9d18b-db83-49f4-b597-b67190cb3e05 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:39.902671 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9d18b-db83-49f4-b597-b67190cb3e05 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:39.902889 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9d18b-db83-49f4-b597-b67190cb3e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:39.917119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 516/1041] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:30:39 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 16:30:39.922795 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c41a04-33dc-4ae9-895d-0417dccf5b6f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:39.923398 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-98d9d18b-db83-49f4-b597-b67190cb3e05 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:39.924744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-98d9d18b-db83-49f4-b597-b67190cb3e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:40.017346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 526/1042] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:30:40.036339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9d18b-db83-49f4-b597-b67190cb3e05 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:40.064811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c41a04-33dc-4ae9-895d-0417dccf5b6f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:40.106227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04997edc-bc33-496d-b7ae-1472d0d56a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:40.107374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04997edc-bc33-496d-b7ae-1472d0d56a1d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:40.107899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04997edc-bc33-496d-b7ae-1472d0d56a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:40.108347 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04997edc-bc33-496d-b7ae-1472d0d56a1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:40.120008 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04997edc-bc33-496d-b7ae-1472d0d56a1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:40.122044 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04997edc-bc33-496d-b7ae-1472d0d56a1d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:40.123867 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:40.143047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-04997edc-bc33-496d-b7ae-1472d0d56a1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:40.143047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:40.143047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:40.143047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:40.143047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:40.143047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:40.143047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:40.143047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:40.143047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:40.143047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:40.143047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:40.143047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:40.143047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:40.143047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:40.143047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:40.148114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:40.148114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:40.148114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:40.148114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:40.148114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:40.148114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:40.148114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:40.148114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:40.148114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:40.148114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:40.148114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:40.148114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:40.148114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:40.148114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:40.148114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:40.148114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:40.148114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:40.149830 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:40.149830 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:40.149830 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:40.149830 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:40.149830 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 517/1043] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:40.150837 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04997edc-bc33-496d-b7ae-1472d0d56a1d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:40.176890 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9d18b-db83-49f4-b597-b67190cb3e05 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:40.182535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:40.222052 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d2210-35ea-418a-8fbc-78b2bf34e605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:40.224241 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d2210-35ea-418a-8fbc-78b2bf34e605 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:40.224642 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d2210-35ea-418a-8fbc-78b2bf34e605 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:40.224921 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d2210-35ea-418a-8fbc-78b2bf34e605 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:40.238672 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5d2210-35ea-418a-8fbc-78b2bf34e605 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:30:40.248056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-0d5d2210-35ea-418a-8fbc-78b2bf34e605 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:30:40.248056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:40.248056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:40.248056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:40.248056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:40.248056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:40.248056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:40.248056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:40.248056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:40.248056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:40.248056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:40.248056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:40.248056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:30:40.248056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:30:40.248056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:30:40.248056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:30:40.249383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:30:40.249383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:30:40.249383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:30:40.249383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:30:40.249383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:40.249383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:40.249383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:40.249383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:40.249383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:40.249383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:40.249383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:40.249383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:40.249383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:40.249383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:40.249383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:40.249383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:40.250457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:40.250457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:40.250457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:40.250457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:40.250457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:30:40.250457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:30:40.250457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:30:40.250457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:30:40.250457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:30:40.250457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:30:40.250457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:30:40.250457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:40.250457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 527/1044] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:30:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:40.255506 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d2210-35ea-418a-8fbc-78b2bf34e605 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:40.273388 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04997edc-bc33-496d-b7ae-1472d0d56a1d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:40.337895 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8fd5a-ebea-45b3-bd91-f7ceeb8c18da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:40.339519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8fd5a-ebea-45b3-bd91-f7ceeb8c18da None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:40.340047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8fd5a-ebea-45b3-bd91-f7ceeb8c18da None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:40.340564 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca8fd5a-ebea-45b3-bd91-f7ceeb8c18da None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:40.341562 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8fd5a-ebea-45b3-bd91-f7ceeb8c18da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:40.341948 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8fd5a-ebea-45b3-bd91-f7ceeb8c18da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:40.343453 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca8fd5a-ebea-45b3-bd91-f7ceeb8c18da None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:40.367912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 518/1045] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:40.369675 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8fd5a-ebea-45b3-bd91-f7ceeb8c18da None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:40.388133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d2210-35ea-418a-8fbc-78b2bf34e605 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:40.417237 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:40.439242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6e11a-1746-459b-9663-f4a96ac74f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:40.440426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6e11a-1746-459b-9663-f4a96ac74f63 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:40.440938 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6e11a-1746-459b-9663-f4a96ac74f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:40.441476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6e11a-1746-459b-9663-f4a96ac74f63 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:40.442829 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6e11a-1746-459b-9663-f4a96ac74f63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:40.443371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6e11a-1746-459b-9663-f4a96ac74f63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:40.445916 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6e11a-1746-459b-9663-f4a96ac74f63 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:40.456735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 528/1046] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:30:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:40.463276 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6e11a-1746-459b-9663-f4a96ac74f63 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:40.467627 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:40.488337 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca8fd5a-ebea-45b3-bd91-f7ceeb8c18da None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:40.535192 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ecdb0-3e72-4706-90f7-06951de8c3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:40.535989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ecdb0-3e72-4706-90f7-06951de8c3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:40.536275 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ecdb0-3e72-4706-90f7-06951de8c3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:40.536554 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ecdb0-3e72-4706-90f7-06951de8c3c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:40.544684 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ecdb0-3e72-4706-90f7-06951de8c3c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:40.546189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ecdb0-3e72-4706-90f7-06951de8c3c3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:40.562886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-1b9ecdb0-3e72-4706-90f7-06951de8c3c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:40.562886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:40.562886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:40.562886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:40.562886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:40.562886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:40.562886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:40.562886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:40.562886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:40.562886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:40.562886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:40.562886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:40.562886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:30:40.562886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:30:40.562886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:30:40.563893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:30:40.563893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:40.563893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:40.563893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:40.563893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:40.563893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:40.563893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:40.563893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:40.563893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:40.563893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:40.563893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:40.563893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:40.563893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:40.563893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:40.563893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:40.563893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:40.563893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:40.564808 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:30:40.564808 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:30:40.564808 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:30:40.564808 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:30:40.564808 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:30:40.564808 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:30:40.564808 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:40.564808 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:40.566077 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 519/1047] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:30:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:40.570551 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ecdb0-3e72-4706-90f7-06951de8c3c3 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:40.591938 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6e11a-1746-459b-9663-f4a96ac74f63 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:40.632260 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e04497-e784-43dd-b0e8-7b829e1c89d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:40.633231 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e04497-e784-43dd-b0e8-7b829e1c89d0 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:40.637924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e04497-e784-43dd-b0e8-7b829e1c89d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:40.637924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e04497-e784-43dd-b0e8-7b829e1c89d0 None admin] PATH_INFO: `/v3/users/eef4a4816aa34d39a4aff7cac3d1fb87` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:40.650318 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e04497-e784-43dd-b0e8-7b829e1c89d0 None admin] RBAC: Authorizing `identity:get_user(user_id=eef4a4816aa34d39a4aff7cac3d1fb87)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:40.651868 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e04497-e784-43dd-b0e8-7b829e1c89d0 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:40.653806 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 529/1048] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:30:40 2022] GET /identity/v3/users/eef4a4816aa34d39a4aff7cac3d1fb87 => generated 285 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:40.659199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e04497-e784-43dd-b0e8-7b829e1c89d0 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:40.681543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ecdb0-3e72-4706-90f7-06951de8c3c3 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:40.706841 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:40.719843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41259f63-3869-4623-8b52-8739341366b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:40.720529 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41259f63-3869-4623-8b52-8739341366b7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:40.720890 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41259f63-3869-4623-8b52-8739341366b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:40.721195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41259f63-3869-4623-8b52-8739341366b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:40.722022 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41259f63-3869-4623-8b52-8739341366b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:40.722333 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41259f63-3869-4623-8b52-8739341366b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:40.723757 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41259f63-3869-4623-8b52-8739341366b7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:40.742191 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 520/1049] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:30:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:40.744650 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41259f63-3869-4623-8b52-8739341366b7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:40.747440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:40.774005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e04497-e784-43dd-b0e8-7b829e1c89d0 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:40.812748 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f45d61-14c0-488a-861d-227890f22121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:40.813463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f45d61-14c0-488a-861d-227890f22121 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:40.813822 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f45d61-14c0-488a-861d-227890f22121 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:40.814226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f45d61-14c0-488a-861d-227890f22121 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:40.864498 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41259f63-3869-4623-8b52-8739341366b7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:40.896542 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f45d61-14c0-488a-861d-227890f22121 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:40.898280 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f45d61-14c0-488a-861d-227890f22121 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:40.903864 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b2f97-1d9a-484d-a007-6fcd619cb636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:40.904536 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b2f97-1d9a-484d-a007-6fcd619cb636 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:40.904829 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b2f97-1d9a-484d-a007-6fcd619cb636 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:40.905139 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3b2f97-1d9a-484d-a007-6fcd619cb636 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:40.905981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b2f97-1d9a-484d-a007-6fcd619cb636 None admin] RBAC: Adding query filter params (role.id=96360c5874dd4a1f87b4695f1088f5b1, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=381cf4381ce64379b285d75e2909813d) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:40.906295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b2f97-1d9a-484d-a007-6fcd619cb636 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:40.907726 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3b2f97-1d9a-484d-a007-6fcd619cb636 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:40.913417 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 521/1050] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:30:40 2022] GET /identity/v3/role_assignments?user.id=381cf4381ce64379b285d75e2909813d&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=96360c5874dd4a1f87b4695f1088f5b1 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:40.953089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:41.021664 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 530/1051] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:30:40 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 16:30:41.028267 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b2f97-1d9a-484d-a007-6fcd619cb636 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:41.103736 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:41.140056 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3b2f97-1d9a-484d-a007-6fcd619cb636 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:41.184168 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505f137-68f7-4cad-93e9-e3ca05beed1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:41.185186 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505f137-68f7-4cad-93e9-e3ca05beed1e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:41.185564 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505f137-68f7-4cad-93e9-e3ca05beed1e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:41.185915 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505f137-68f7-4cad-93e9-e3ca05beed1e None admin] PATH_INFO: `/v3/projects/21ecd411d3994866bf9722e16980b489` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:41.187170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505f137-68f7-4cad-93e9-e3ca05beed1e None admin] RBAC: Authorizing `identity:get_project(project_id=21ecd411d3994866bf9722e16980b489)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:41.188670 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505f137-68f7-4cad-93e9-e3ca05beed1e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:41.193163 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 522/1052] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:30:41 2022] GET /identity/v3/projects/21ecd411d3994866bf9722e16980b489 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:41.197547 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f45d61-14c0-488a-861d-227890f22121 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:41.305605 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f45d61-14c0-488a-861d-227890f22121 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:41.341683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d0895-8028-4904-b860-bb031e21d983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:41.342350 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d0895-8028-4904-b860-bb031e21d983 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:41.342633 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d0895-8028-4904-b860-bb031e21d983 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:41.342908 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d0895-8028-4904-b860-bb031e21d983 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:41.343736 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d0895-8028-4904-b860-bb031e21d983 None admin] RBAC: Adding query filter params (role.id=c2d5d80485df4730903a874937d68aa3, scope.project.id=21ecd411d3994866bf9722e16980b489, user.id=eef4a4816aa34d39a4aff7cac3d1fb87) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:41.344043 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d0895-8028-4904-b860-bb031e21d983 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:41.345511 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d0895-8028-4904-b860-bb031e21d983 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:41.351620 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 531/1053] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:30:41 2022] GET /identity/v3/role_assignments?user.id=eef4a4816aa34d39a4aff7cac3d1fb87&scope.project.id=21ecd411d3994866bf9722e16980b489&role.id=c2d5d80485df4730903a874937d68aa3 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:41.762092 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3950285-e947-4abe-a02c-aef4844bb72f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:41.762684 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3950285-e947-4abe-a02c-aef4844bb72f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:41.762684 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3950285-e947-4abe-a02c-aef4844bb72f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:41.764001 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 523/1054] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:41.769642 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2ac45-d4a5-4406-9b9f-e1b022ab3bff None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:41.770316 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2ac45-d4a5-4406-9b9f-e1b022ab3bff None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:41.770316 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2ac45-d4a5-4406-9b9f-e1b022ab3bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:41.778217 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:41.789306 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-33a2ac45-d4a5-4406-9b9f-e1b022ab3bff None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:41.790670 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-33a2ac45-d4a5-4406-9b9f-e1b022ab3bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:41.867444 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 532/1055] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:41.891095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3950285-e947-4abe-a02c-aef4844bb72f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:42.005299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3950285-e947-4abe-a02c-aef4844bb72f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:42.044983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ece9c-10c7-4e16-940c-e6f462c1459a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:42.046187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ece9c-10c7-4e16-940c-e6f462c1459a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:42.046682 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ece9c-10c7-4e16-940c-e6f462c1459a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:42.047169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ece9c-10c7-4e16-940c-e6f462c1459a None admin] PATH_INFO: `/v3/services/image` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:42.048133 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ece9c-10c7-4e16-940c-e6f462c1459a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:42.050041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ece9c-10c7-4e16-940c-e6f462c1459a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:42.052482 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:42.063669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-c02ece9c-10c7-4e16-940c-e6f462c1459a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 16:30:42.063669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:42.063669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:30:42.063669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:30:42.063669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:30:42.063669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:30:42.063669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:30:42.063669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:42.063669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 16:30:42.063669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:42.063669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:30:42.063669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:42.063669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:42.063669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:42.063669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:42.063669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:42.063669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:42.072842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:42.072842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:42.072842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:42.072842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:42.072842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:42.072842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:42.072842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:30:42.072842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:30:42.072842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:30:42.072842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:30:42.072842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:42.072842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:42.072842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:42.072842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:42.072842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:42.072842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:42.074379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:42.074379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:42.074379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:42.074379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:42.074379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:42.074379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:42.074379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:42.074379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:42.074379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:42.074379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:42.074379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:30:42.074379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:30:42.074379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 18 16:30:42.074379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:42.074379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 524/1056] 10.222.0.76 () {56 vars in 1105 bytes} [Mon Jul 18 16:30:41 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:42.075228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2ac45-d4a5-4406-9b9f-e1b022ab3bff None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:42.178965 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2ac45-d4a5-4406-9b9f-e1b022ab3bff None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:42.214939 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c9fbe-caa6-4d75-88e3-8c525c12fd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:42.215614 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c9fbe-caa6-4d75-88e3-8c525c12fd67 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:42.215906 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c9fbe-caa6-4d75-88e3-8c525c12fd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:42.216183 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4c9fbe-caa6-4d75-88e3-8c525c12fd67 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:42.216898 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c9fbe-caa6-4d75-88e3-8c525c12fd67 None admin] RBAC: Adding query filter params (name=image) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:42.217240 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c9fbe-caa6-4d75-88e3-8c525c12fd67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:42.218610 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4c9fbe-caa6-4d75-88e3-8c525c12fd67 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:42.219754 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:42.224679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 533/1057] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:42.232263 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ece9c-10c7-4e16-940c-e6f462c1459a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:42.338241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ece9c-10c7-4e16-940c-e6f462c1459a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:42.376594 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef663054-8083-4a41-be82-537e6c90ed08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:42.377280 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef663054-8083-4a41-be82-537e6c90ed08 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:42.377624 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef663054-8083-4a41-be82-537e6c90ed08 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:42.377910 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef663054-8083-4a41-be82-537e6c90ed08 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:42.378682 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef663054-8083-4a41-be82-537e6c90ed08 None admin] RBAC: Adding query filter params (type=image) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:42.379002 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef663054-8083-4a41-be82-537e6c90ed08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:42.380379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef663054-8083-4a41-be82-537e6c90ed08 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:42.390654 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 525/1058] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:42.391787 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c9fbe-caa6-4d75-88e3-8c525c12fd67 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:42.505211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4c9fbe-caa6-4d75-88e3-8c525c12fd67 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:42.549522 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5050f-d247-480d-8b52-db7c3608fe94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:42.550193 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5050f-d247-480d-8b52-db7c3608fe94 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:42.550475 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5050f-d247-480d-8b52-db7c3608fe94 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:42.550749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5050f-d247-480d-8b52-db7c3608fe94 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:42.551502 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5050f-d247-480d-8b52-db7c3608fe94 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:42.552869 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5050f-d247-480d-8b52-db7c3608fe94 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:42.661136 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 534/1059] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Jul 18 16:30:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:30:42.967584 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ff9b1-8d58-4ded-94dd-3fc865837388 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:42.968085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ff9b1-8d58-4ded-94dd-3fc865837388 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:42.968085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ff9b1-8d58-4ded-94dd-3fc865837388 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:42.969496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 526/1060] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:42.974774 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f69f86-f6a9-4fcd-84eb-6179415a921c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:42.975197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f69f86-f6a9-4fcd-84eb-6179415a921c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:42.975388 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f69f86-f6a9-4fcd-84eb-6179415a921c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:42.994054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-62f69f86-f6a9-4fcd-84eb-6179415a921c None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:42.995595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-62f69f86-f6a9-4fcd-84eb-6179415a921c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:43.047753 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:43.072857 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 535/1061] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:43.095445 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ff9b1-8d58-4ded-94dd-3fc865837388 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:43.166738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:43.216032 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ff9b1-8d58-4ded-94dd-3fc865837388 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:43.251616 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae901a-21ff-4020-b2a5-f03bc5cb6854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:43.252351 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae901a-21ff-4020-b2a5-f03bc5cb6854 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:43.252640 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae901a-21ff-4020-b2a5-f03bc5cb6854 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:43.252919 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae901a-21ff-4020-b2a5-f03bc5cb6854 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:43.263316 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae901a-21ff-4020-b2a5-f03bc5cb6854 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:30:43.271535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-81ae901a-21ff-4020-b2a5-f03bc5cb6854 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:30:43.271535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:43.271535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:43.271535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:43.271535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:43.271535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:43.271535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:43.271535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:43.271535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:43.271535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:43.271535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:43.271535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:43.271535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:30:43.271535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:30:43.271535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:30:43.271535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:30:43.272480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:30:43.272480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:30:43.272480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:30:43.272480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:30:43.272480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:43.272480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:43.272480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:43.272480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:43.272480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:43.272480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:43.272480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:43.272480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:43.272480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:43.272480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:43.272480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:43.272480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:43.278749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:43.278749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:43.278749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:43.278749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:43.278749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:30:43.278749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:30:43.278749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:30:43.278749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:30:43.278749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:30:43.278749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:30:43.278749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:30:43.278749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:43.278749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 527/1062] 10.222.0.76 () {56 vars in 1120 bytes} [Mon Jul 18 16:30:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:43.282820 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f69f86-f6a9-4fcd-84eb-6179415a921c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:43.393443 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f69f86-f6a9-4fcd-84eb-6179415a921c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:43.420497 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f56f1a-c823-4266-94ba-d5b570242566 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:43.421171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f56f1a-c823-4266-94ba-d5b570242566 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:43.421706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f56f1a-c823-4266-94ba-d5b570242566 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:43.427208 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 528/1063] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:30:43.428730 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867dd971-3562-41bf-8f69-95336ea3c576 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:43.429037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867dd971-3562-41bf-8f69-95336ea3c576 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:43.429332 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867dd971-3562-41bf-8f69-95336ea3c576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:43.437068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c295a4b-528a-4330-93ba-e657fe9d8f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:43.437756 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c295a4b-528a-4330-93ba-e657fe9d8f38 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:43.438039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c295a4b-528a-4330-93ba-e657fe9d8f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:43.438316 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c295a4b-528a-4330-93ba-e657fe9d8f38 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:43.439072 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c295a4b-528a-4330-93ba-e657fe9d8f38 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:43.439397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c295a4b-528a-4330-93ba-e657fe9d8f38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:43.440992 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c295a4b-528a-4330-93ba-e657fe9d8f38 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:43.446618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-867dd971-3562-41bf-8f69-95336ea3c576 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:43.447806 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-867dd971-3562-41bf-8f69-95336ea3c576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:43.453815 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 536/1064] 10.222.0.76 () {56 vars in 1115 bytes} [Mon Jul 18 16:30:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:43.455439 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c295a4b-528a-4330-93ba-e657fe9d8f38 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:43.506843 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:43.522771 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 529/1065] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:43.547117 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867dd971-3562-41bf-8f69-95336ea3c576 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:43.569237 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c295a4b-528a-4330-93ba-e657fe9d8f38 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:43.601823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:43.607073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd153c8-63b6-4634-9ce7-2ea54e8401f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:43.607880 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd153c8-63b6-4634-9ce7-2ea54e8401f7 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:43.608147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd153c8-63b6-4634-9ce7-2ea54e8401f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:43.608576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd153c8-63b6-4634-9ce7-2ea54e8401f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:43.620136 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd153c8-63b6-4634-9ce7-2ea54e8401f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:43.621825 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd153c8-63b6-4634-9ce7-2ea54e8401f7 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:43.639205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-8cd153c8-63b6-4634-9ce7-2ea54e8401f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:43.639205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:43.639205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:43.639205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:43.639205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:43.639205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:43.639205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:43.639205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:43.639205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:43.639205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:43.639205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:43.639205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:43.639205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:43.639205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:43.639205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:43.640408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:43.640408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:43.640408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:43.640408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:43.640408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:43.640408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:43.640408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:43.640408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:43.640408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:43.640408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:43.640408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:43.640408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:43.640408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:43.640408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:43.640408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:43.640408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:43.640408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:43.644887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:43.644887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:43.644887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:43.644887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:43.645236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 537/1066] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:43.647238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd153c8-63b6-4634-9ce7-2ea54e8401f7 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:43.658768 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867dd971-3562-41bf-8f69-95336ea3c576 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:43.698322 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ef85f-7f01-428c-951b-e3137cc21fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:43.699245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ef85f-7f01-428c-951b-e3137cc21fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:43.699530 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ef85f-7f01-428c-951b-e3137cc21fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:43.699811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ef85f-7f01-428c-951b-e3137cc21fe3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:43.710326 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ef85f-7f01-428c-951b-e3137cc21fe3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:30:43.718522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-284ef85f-7f01-428c-951b-e3137cc21fe3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:30:43.718522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:43.718522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:43.718522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:43.718522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:43.718522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:43.718522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:43.718522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:43.718522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:43.718522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:43.718522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:43.718522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:43.718522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:30:43.718522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:30:43.718522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:30:43.718522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:30:43.719543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:30:43.719543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:30:43.719543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:30:43.719543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:30:43.719543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:43.719543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:43.719543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:43.719543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:43.719543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:43.719543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:43.719543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:43.719543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:43.719543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:43.719543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:43.719543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:43.719543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:43.720446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:43.720446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:43.720446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:43.720446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:43.720446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:30:43.720446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:30:43.720446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:30:43.720446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:30:43.720446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:30:43.720446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:30:43.720446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:30:43.720446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:43.725110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 530/1067] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:30:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:43.725807 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ef85f-7f01-428c-951b-e3137cc21fe3 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:43.754903 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:43.765090 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd153c8-63b6-4634-9ce7-2ea54e8401f7 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:43.803113 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ea334-02a0-4c31-9500-d93bbfbd1c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:43.803796 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ea334-02a0-4c31-9500-d93bbfbd1c91 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:43.804078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ea334-02a0-4c31-9500-d93bbfbd1c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:43.804382 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ea334-02a0-4c31-9500-d93bbfbd1c91 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:43.805748 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ea334-02a0-4c31-9500-d93bbfbd1c91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:43.806061 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ea334-02a0-4c31-9500-d93bbfbd1c91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:43.807452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ea334-02a0-4c31-9500-d93bbfbd1c91 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:43.820802 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 538/1068] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:43.826488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ea334-02a0-4c31-9500-d93bbfbd1c91 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:43.842245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ef85f-7f01-428c-951b-e3137cc21fe3 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:43.859833 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:43.882909 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026570a0-dd52-406a-beed-55a6881876bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:43.883622 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026570a0-dd52-406a-beed-55a6881876bf None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:43.884176 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026570a0-dd52-406a-beed-55a6881876bf None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:43.884475 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026570a0-dd52-406a-beed-55a6881876bf None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:43.885256 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026570a0-dd52-406a-beed-55a6881876bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:43.885569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026570a0-dd52-406a-beed-55a6881876bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:43.886948 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026570a0-dd52-406a-beed-55a6881876bf None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:43.899963 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 531/1069] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:30:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:43.902091 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026570a0-dd52-406a-beed-55a6881876bf None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:43.940438 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ea334-02a0-4c31-9500-d93bbfbd1c91 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:43.980565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0da3fe-5b0d-4651-9183-1e536e9718bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:43.981576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0da3fe-5b0d-4651-9183-1e536e9718bf None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:43.982567 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0da3fe-5b0d-4651-9183-1e536e9718bf None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:43.982567 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0da3fe-5b0d-4651-9183-1e536e9718bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:43.989691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0da3fe-5b0d-4651-9183-1e536e9718bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:43.991135 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0da3fe-5b0d-4651-9183-1e536e9718bf None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:44.007228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-5c0da3fe-5b0d-4651-9183-1e536e9718bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:30:44.007228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:44.007228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:44.007228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:44.007228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:44.007228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:44.007228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:44.007228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:44.007228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:44.007228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:44.007228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:44.007228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:44.007228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:30:44.007228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:30:44.007228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:30:44.007228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:30:44.008286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:44.008286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:44.008286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:30:44.008286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:44.008286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:30:44.008286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:44.008286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:44.008286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:44.008286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:44.008286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:44.008286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:44.008286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:44.008286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:44.008286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:44.008286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:44.008286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:44.008286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:44.008286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:44.009452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:44.009452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:44.009452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:30:44.009452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:30:44.009452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:30:44.009452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:30:44.009452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:30:44.009452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:30:44.009452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:30:44.009452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:44.009452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 539/1070] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Jul 18 16:30:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:44.014664 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0da3fe-5b0d-4651-9183-1e536e9718bf None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:44.016743 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026570a0-dd52-406a-beed-55a6881876bf None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:44.031045 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:44.052151 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbda7e-959e-4057-8c7c-48325d7448ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:44.053062 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbda7e-959e-4057-8c7c-48325d7448ee None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:44.053352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbda7e-959e-4057-8c7c-48325d7448ee None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:44.053630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dbda7e-959e-4057-8c7c-48325d7448ee None admin] PATH_INFO: `/v3/users/eef4a4816aa34d39a4aff7cac3d1fb87` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:44.054836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbda7e-959e-4057-8c7c-48325d7448ee None admin] RBAC: Authorizing `identity:get_user(user_id=eef4a4816aa34d39a4aff7cac3d1fb87)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:44.056937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dbda7e-959e-4057-8c7c-48325d7448ee None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:44.058621 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 532/1071] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:30:43 2022] GET /identity/v3/users/eef4a4816aa34d39a4aff7cac3d1fb87 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:44.064479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbda7e-959e-4057-8c7c-48325d7448ee None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:44.111680 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:44.134149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0da3fe-5b0d-4651-9183-1e536e9718bf None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:44.173641 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dbda7e-959e-4057-8c7c-48325d7448ee None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:44.186082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1eb081-43db-4ae9-8f94-6c8c8bfa09f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:44.186783 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1eb081-43db-4ae9-8f94-6c8c8bfa09f5 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:44.187071 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1eb081-43db-4ae9-8f94-6c8c8bfa09f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:44.187353 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1eb081-43db-4ae9-8f94-6c8c8bfa09f5 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:44.188197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1eb081-43db-4ae9-8f94-6c8c8bfa09f5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:44.188511 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1eb081-43db-4ae9-8f94-6c8c8bfa09f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:44.190015 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1eb081-43db-4ae9-8f94-6c8c8bfa09f5 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:44.214758 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 540/1072] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Jul 18 16:30:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:44.215827 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1eb081-43db-4ae9-8f94-6c8c8bfa09f5 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:44.219701 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c3af0-eadc-4bc8-843a-2bdda33ae08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:44.220581 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c3af0-eadc-4bc8-843a-2bdda33ae08e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:44.220872 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c3af0-eadc-4bc8-843a-2bdda33ae08e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:44.221189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c3af0-eadc-4bc8-843a-2bdda33ae08e None admin] PATH_INFO: `/v3/projects/21ecd411d3994866bf9722e16980b489` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:44.222451 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c3af0-eadc-4bc8-843a-2bdda33ae08e None admin] RBAC: Authorizing `identity:get_project(project_id=21ecd411d3994866bf9722e16980b489)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:44.224010 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c3af0-eadc-4bc8-843a-2bdda33ae08e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:44.231064 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 533/1073] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:30:44 2022] GET /identity/v3/projects/21ecd411d3994866bf9722e16980b489 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:44.231895 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c3af0-eadc-4bc8-843a-2bdda33ae08e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:44.309844 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:44.343236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1eb081-43db-4ae9-8f94-6c8c8bfa09f5 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:44.343915 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c3af0-eadc-4bc8-843a-2bdda33ae08e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:44.356528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:44.381564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22deea4-c5fe-43de-90de-2dd837b707df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:44.381821 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c577a-a597-4bc8-9404-f93c6ce12609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:44.382591 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22deea4-c5fe-43de-90de-2dd837b707df None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:44.382705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c577a-a597-4bc8-9404-f93c6ce12609 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:44.382782 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22deea4-c5fe-43de-90de-2dd837b707df None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:44.382984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c577a-a597-4bc8-9404-f93c6ce12609 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:44.383101 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22deea4-c5fe-43de-90de-2dd837b707df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:44.383910 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c577a-a597-4bc8-9404-f93c6ce12609 None admin] PATH_INFO: `/v3/projects/21ecd411d3994866bf9722e16980b489/users/eef4a4816aa34d39a4aff7cac3d1fb87/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:44.385941 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c577a-a597-4bc8-9404-f93c6ce12609 None admin] RBAC: Authorizing `identity:create_grant(project_id=21ecd411d3994866bf9722e16980b489, user_id=eef4a4816aa34d39a4aff7cac3d1fb87, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:44.387389 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c577a-a597-4bc8-9404-f93c6ce12609 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:44.396828 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22deea4-c5fe-43de-90de-2dd837b707df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:44.398383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22deea4-c5fe-43de-90de-2dd837b707df None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:44.416897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-b22deea4-c5fe-43de-90de-2dd837b707df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:44.416897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:44.416897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:44.416897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:44.416897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:44.416897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:44.416897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:44.416897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:44.416897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:44.416897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:44.416897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:44.416897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:44.416897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:44.416897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:44.416897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:44.417887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:44.417887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:44.417887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:44.417887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:44.417887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:44.417887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:44.417887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:44.417887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:44.417887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:44.417887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:44.417887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:44.417887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:44.417887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:44.417887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:44.417887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:44.417887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:44.417887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:44.418801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:44.418801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:44.418801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:44.418801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:44.418801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 541/1074] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:44.423916 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22deea4-c5fe-43de-90de-2dd837b707df None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:44.461295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 534/1075] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:30:44 2022] PUT /identity/v3/projects/21ecd411d3994866bf9722e16980b489/users/eef4a4816aa34d39a4aff7cac3d1fb87/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:30:44.546378 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22deea4-c5fe-43de-90de-2dd837b707df None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:44.574534 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:44.587194 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d521b50d-5598-4b6d-943c-dcc7248642f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:44.594588 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521b50d-5598-4b6d-943c-dcc7248642f0 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:44.594588 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521b50d-5598-4b6d-943c-dcc7248642f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:44.594588 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d521b50d-5598-4b6d-943c-dcc7248642f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:44.594588 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521b50d-5598-4b6d-943c-dcc7248642f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:44.594588 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521b50d-5598-4b6d-943c-dcc7248642f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:44.594588 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d521b50d-5598-4b6d-943c-dcc7248642f0 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:44.604034 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 542/1076] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:44.611546 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c577a-a597-4bc8-9404-f93c6ce12609 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:44.726702 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c577a-a597-4bc8-9404-f93c6ce12609 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:44.735154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ef3a2-a1c2-4425-bd2d-2a4e4fd05250 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:44.735444 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ef3a2-a1c2-4425-bd2d-2a4e4fd05250 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:44.735728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839ef3a2-a1c2-4425-bd2d-2a4e4fd05250 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:44.737393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 543/1077] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:44.742376 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a01f0f-2cd8-4a3d-89f5-d7bd68f12a1e None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:44.742799 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a01f0f-2cd8-4a3d-89f5-d7bd68f12a1e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:44.743332 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a01f0f-2cd8-4a3d-89f5-d7bd68f12a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:44.762131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-36a01f0f-2cd8-4a3d-89f5-d7bd68f12a1e None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:44.763311 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-36a01f0f-2cd8-4a3d-89f5-d7bd68f12a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:44.767384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93daad9-de42-421c-8bd1-3e57ceeeac65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:44.768200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93daad9-de42-421c-8bd1-3e57ceeeac65 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:44.768480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93daad9-de42-421c-8bd1-3e57ceeeac65 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:44.768761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93daad9-de42-421c-8bd1-3e57ceeeac65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:44.777607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93daad9-de42-421c-8bd1-3e57ceeeac65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:44.779642 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93daad9-de42-421c-8bd1-3e57ceeeac65 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:44.795071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-f93daad9-de42-421c-8bd1-3e57ceeeac65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:44.795071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:44.795071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:44.795071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:44.795071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:44.795071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:44.795071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:44.795071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:44.795071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:44.795071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:44.795071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:44.795071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:44.795071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:30:44.795071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:30:44.795071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:30:44.796035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:30:44.796035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:44.796035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:44.796035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:44.796035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:44.796035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:44.796035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:44.796035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:44.796035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:44.796035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:44.796035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:44.796035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:44.796035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:44.796035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:44.796035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:44.796035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:44.796035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:44.797079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:30:44.797079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:30:44.797079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:30:44.797079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:30:44.797079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:30:44.797079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:30:44.797079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:44.797079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:44.798103 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 535/1078] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:30:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:44.802361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93daad9-de42-421c-8bd1-3e57ceeeac65 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:44.846356 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:44.858616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 544/1079] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:30:44.882059 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a01f0f-2cd8-4a3d-89f5-d7bd68f12a1e None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:44.922840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93daad9-de42-421c-8bd1-3e57ceeeac65 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:44.963864 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e212e03-9a36-497c-83be-1adca7b31ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:44.964536 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e212e03-9a36-497c-83be-1adca7b31ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:44.964828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e212e03-9a36-497c-83be-1adca7b31ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:44.965141 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e212e03-9a36-497c-83be-1adca7b31ff4 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:44.965945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e212e03-9a36-497c-83be-1adca7b31ff4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:44.966996 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e212e03-9a36-497c-83be-1adca7b31ff4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:44.967693 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e212e03-9a36-497c-83be-1adca7b31ff4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:44.980282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 536/1080] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:30:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:44.986463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e212e03-9a36-497c-83be-1adca7b31ff4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:45.009949 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a01f0f-2cd8-4a3d-89f5-d7bd68f12a1e None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:45.026572 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:45.049109 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06df37e-8b95-4756-a995-285f4039e5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:45.049790 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06df37e-8b95-4756-a995-285f4039e5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:45.052464 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06df37e-8b95-4756-a995-285f4039e5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:45.052464 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06df37e-8b95-4756-a995-285f4039e5b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:45.095064 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:45.111703 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e212e03-9a36-497c-83be-1adca7b31ff4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:45.132044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06df37e-8b95-4756-a995-285f4039e5b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:45.134601 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06df37e-8b95-4756-a995-285f4039e5b8 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:45.149632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d92ef-ea97-4a76-a87b-e1c0fe55f28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:45.150903 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d92ef-ea97-4a76-a87b-e1c0fe55f28c None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:45.151375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d92ef-ea97-4a76-a87b-e1c0fe55f28c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:45.151663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6d92ef-ea97-4a76-a87b-e1c0fe55f28c None admin] PATH_INFO: `/v3/projects/30a4824228ec47519a01574d82879b25/users/381cf4381ce64379b285d75e2909813d/roles/96360c5874dd4a1f87b4695f1088f5b1` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:45.154202 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d92ef-ea97-4a76-a87b-e1c0fe55f28c None admin] RBAC: Authorizing `identity:create_grant(project_id=30a4824228ec47519a01574d82879b25, user_id=381cf4381ce64379b285d75e2909813d, role_id=96360c5874dd4a1f87b4695f1088f5b1)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:45.155760 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6d92ef-ea97-4a76-a87b-e1c0fe55f28c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:45.240255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 545/1081] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:30:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:30:45.247142 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06df37e-8b95-4756-a995-285f4039e5b8 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:45.263020 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:45.277304 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 537/1082] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:30:44 2022] PUT /identity/v3/projects/30a4824228ec47519a01574d82879b25/users/381cf4381ce64379b285d75e2909813d/roles/96360c5874dd4a1f87b4695f1088f5b1 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:30:45.361407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06df37e-8b95-4756-a995-285f4039e5b8 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:45.402176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305caa8-0973-41ed-a3d6-63351ccad194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:45.402914 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305caa8-0973-41ed-a3d6-63351ccad194 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:45.403195 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305caa8-0973-41ed-a3d6-63351ccad194 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:45.403468 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305caa8-0973-41ed-a3d6-63351ccad194 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:45.415385 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305caa8-0973-41ed-a3d6-63351ccad194 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:45.416917 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e305caa8-0973-41ed-a3d6-63351ccad194 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:45.438380 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-e305caa8-0973-41ed-a3d6-63351ccad194 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:45.438380 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:45.438380 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:45.438380 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:45.438380 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:45.438380 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:45.438380 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:45.438380 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:45.438380 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:45.438380 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:45.438380 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:45.438380 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:45.438380 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:45.438380 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:45.438380 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:45.439365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:45.439365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:45.439365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:45.439365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:45.439365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:45.439365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:45.439365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:45.439365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:45.439365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:45.439365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:45.439365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:45.439365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:45.439365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:45.439365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:45.439365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:45.439365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:45.439365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:45.440617 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:45.440617 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:45.440617 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:45.440617 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:45.440617 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 546/1083] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:45.446366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d92ef-ea97-4a76-a87b-e1c0fe55f28c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:45.557729 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6d92ef-ea97-4a76-a87b-e1c0fe55f28c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:45.598501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebbdc1b-9583-4c03-80d8-7c438c10fccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:45.599515 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbdc1b-9583-4c03-80d8-7c438c10fccd None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:45.599957 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbdc1b-9583-4c03-80d8-7c438c10fccd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:45.600414 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbdc1b-9583-4c03-80d8-7c438c10fccd None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:45.601520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbdc1b-9583-4c03-80d8-7c438c10fccd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:45.602195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbdc1b-9583-4c03-80d8-7c438c10fccd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:45.603941 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebbdc1b-9583-4c03-80d8-7c438c10fccd None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:45.617060 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 538/1084] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:46.517886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ad555-3ffd-4e0f-863e-d3cc3966a68c None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:46.518398 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ad555-3ffd-4e0f-863e-d3cc3966a68c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:46.518492 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ad555-3ffd-4e0f-863e-d3cc3966a68c None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:46.519903 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 547/1085] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:46.525813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8cf83-f6ac-4f84-b241-89ae3237110e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:46.526248 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8cf83-f6ac-4f84-b241-89ae3237110e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:46.526389 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8cf83-f6ac-4f84-b241-89ae3237110e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:46.543956 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-67f8cf83-f6ac-4f84-b241-89ae3237110e None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:46.545179 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-67f8cf83-f6ac-4f84-b241-89ae3237110e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:46.547990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:46.615307 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 539/1086] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:46.639100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ad555-3ffd-4e0f-863e-d3cc3966a68c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:46.707530 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:46.743337 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ad555-3ffd-4e0f-863e-d3cc3966a68c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:46.785404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d832c3-b9c5-45c6-ac13-026133a886fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:46.786174 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d832c3-b9c5-45c6-ac13-026133a886fb None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:46.786455 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d832c3-b9c5-45c6-ac13-026133a886fb None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:46.786730 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d832c3-b9c5-45c6-ac13-026133a886fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:46.797991 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d832c3-b9c5-45c6-ac13-026133a886fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:30:46.806242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-94d832c3-b9c5-45c6-ac13-026133a886fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:30:46.806242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:46.806242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:46.806242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:46.806242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:46.806242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:46.806242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:46.806242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:46.806242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:46.806242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:46.806242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:46.806242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:46.806242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:30:46.806242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:30:46.806242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:30:46.806242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:30:46.807248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:30:46.807248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:30:46.807248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:30:46.807248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:30:46.807248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:46.807248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:46.807248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:46.807248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:46.807248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:46.807248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:46.807248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:46.807248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:46.807248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:46.807248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:46.807248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:46.807248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:46.808291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:46.808291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:46.808291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:46.808291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:46.808291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:30:46.808291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:30:46.808291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:30:46.808291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:30:46.808291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:30:46.808291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:30:46.808291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:30:46.808291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:46.808291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 548/1087] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:30:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:46.813528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8cf83-f6ac-4f84-b241-89ae3237110e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:46.916558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8cf83-f6ac-4f84-b241-89ae3237110e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:46.956434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb071c-7fbe-4098-ac3f-0105d9e38710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:46.957136 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb071c-7fbe-4098-ac3f-0105d9e38710 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:46.957426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb071c-7fbe-4098-ac3f-0105d9e38710 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:46.957705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb071c-7fbe-4098-ac3f-0105d9e38710 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:46.958512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb071c-7fbe-4098-ac3f-0105d9e38710 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:46.958775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb071c-7fbe-4098-ac3f-0105d9e38710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:46.960154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb071c-7fbe-4098-ac3f-0105d9e38710 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:46.969336 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 540/1088] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:30:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:46.975161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d832c3-b9c5-45c6-ac13-026133a886fb None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:47.075696 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d832c3-b9c5-45c6-ac13-026133a886fb None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:47.103345 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:47.112150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d74bb9-892c-4419-84fd-964b904e1639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:47.114440 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d74bb9-892c-4419-84fd-964b904e1639 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:47.114440 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d74bb9-892c-4419-84fd-964b904e1639 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:47.114440 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d74bb9-892c-4419-84fd-964b904e1639 None admin] PATH_INFO: `/v3/users/eef4a4816aa34d39a4aff7cac3d1fb87` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:47.115112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d74bb9-892c-4419-84fd-964b904e1639 None admin] RBAC: Authorizing `identity:get_user(user_id=eef4a4816aa34d39a4aff7cac3d1fb87)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:47.116548 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d74bb9-892c-4419-84fd-964b904e1639 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:47.119248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 549/1089] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:30:46 2022] GET /identity/v3/users/eef4a4816aa34d39a4aff7cac3d1fb87 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:47.125259 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb071c-7fbe-4098-ac3f-0105d9e38710 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:47.128107 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:47.234233 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb071c-7fbe-4098-ac3f-0105d9e38710 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:47.268602 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdee53-3a9e-489a-94b4-6bb0016a476b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:47.269277 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdee53-3a9e-489a-94b4-6bb0016a476b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:47.269562 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdee53-3a9e-489a-94b4-6bb0016a476b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:47.269838 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bdee53-3a9e-489a-94b4-6bb0016a476b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:47.323265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a669f6-0e28-4928-8984-e51851389bf1 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:47.323549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a669f6-0e28-4928-8984-e51851389bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:47.323827 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a669f6-0e28-4928-8984-e51851389bf1 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:47.325229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 550/1090] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:30:47.330209 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f693f-02fe-4571-a8ea-e6f78beecc8c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:47.330476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f693f-02fe-4571-a8ea-e6f78beecc8c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:47.330755 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f693f-02fe-4571-a8ea-e6f78beecc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:47.340769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdee53-3a9e-489a-94b4-6bb0016a476b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:47.342258 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bdee53-3a9e-489a-94b4-6bb0016a476b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:47.344141 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:47.348344 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a19f693f-02fe-4571-a8ea-e6f78beecc8c None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:47.349553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a19f693f-02fe-4571-a8ea-e6f78beecc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:47.418649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 551/1091] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:30:47.441937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f693f-02fe-4571-a8ea-e6f78beecc8c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:47.446994 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 541/1092] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:30:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 16:30:47.453101 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdee53-3a9e-489a-94b4-6bb0016a476b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:47.550478 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f693f-02fe-4571-a8ea-e6f78beecc8c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:47.554412 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bdee53-3a9e-489a-94b4-6bb0016a476b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:47.556822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:47.575572 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:47.586748 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a52bab-3694-443e-b093-7a581e986b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:47.587518 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a52bab-3694-443e-b093-7a581e986b78 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:47.587803 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a52bab-3694-443e-b093-7a581e986b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:47.588082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a52bab-3694-443e-b093-7a581e986b78 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:47.589527 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597d3fe-8d08-4df5-9fa6-9e0cdfb9faee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:47.590382 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597d3fe-8d08-4df5-9fa6-9e0cdfb9faee None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:47.590664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597d3fe-8d08-4df5-9fa6-9e0cdfb9faee None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:47.590935 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597d3fe-8d08-4df5-9fa6-9e0cdfb9faee None admin] PATH_INFO: `/v3/projects/21ecd411d3994866bf9722e16980b489` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:47.592097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597d3fe-8d08-4df5-9fa6-9e0cdfb9faee None admin] RBAC: Authorizing `identity:get_project(project_id=21ecd411d3994866bf9722e16980b489)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:47.593574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597d3fe-8d08-4df5-9fa6-9e0cdfb9faee None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:47.595260 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 542/1093] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:30:47 2022] GET /identity/v3/projects/21ecd411d3994866bf9722e16980b489 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:47.600205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a52bab-3694-443e-b093-7a581e986b78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:30:47.601347 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597d3fe-8d08-4df5-9fa6-9e0cdfb9faee None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:47.609809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-95a52bab-3694-443e-b093-7a581e986b78 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:30:47.609809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:47.609809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:47.609809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:47.609809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:47.609809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:47.609809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:47.609809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:47.609809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:47.609809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:47.609809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:47.609809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:47.609809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:30:47.609809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:30:47.609809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:30:47.609809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:30:47.616722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:30:47.616722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:30:47.616722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:30:47.616722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:30:47.616722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:47.616722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:47.616722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:47.616722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:47.616722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:47.616722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:47.616722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:47.616722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:47.616722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:47.616722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:47.616722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:47.616722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:47.618882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:47.618882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:47.618882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:47.618882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:47.618882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:30:47.618882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:30:47.618882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:30:47.618882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:30:47.618882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:30:47.618882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:30:47.618882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 18 16:30:47.618882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:47.618882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 552/1094] 10.222.0.76 () {56 vars in 1120 bytes} [Mon Jul 18 16:30:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:47.618882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a52bab-3694-443e-b093-7a581e986b78 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:47.703568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597d3fe-8d08-4df5-9fa6-9e0cdfb9faee None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:47.722364 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a52bab-3694-443e-b093-7a581e986b78 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:47.740266 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f0f09-9d49-4690-97f4-30bdb6d5de1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:47.740930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f0f09-9d49-4690-97f4-30bdb6d5de1b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:47.741248 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f0f09-9d49-4690-97f4-30bdb6d5de1b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:47.741529 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9f0f09-9d49-4690-97f4-30bdb6d5de1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:47.743339 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f0f09-9d49-4690-97f4-30bdb6d5de1b None admin] RBAC: Adding query filter params (role.id=c2d5d80485df4730903a874937d68aa3, scope.project.id=21ecd411d3994866bf9722e16980b489, user.id=eef4a4816aa34d39a4aff7cac3d1fb87) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:47.743661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f0f09-9d49-4690-97f4-30bdb6d5de1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:47.745133 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9f0f09-9d49-4690-97f4-30bdb6d5de1b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:47.751109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 543/1095] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:30:47 2022] GET /identity/v3/role_assignments?user.id=eef4a4816aa34d39a4aff7cac3d1fb87&scope.project.id=21ecd411d3994866bf9722e16980b489&role.id=c2d5d80485df4730903a874937d68aa3 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:47.758809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de6f98-be9e-4240-980b-2df457b15611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:47.759524 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de6f98-be9e-4240-980b-2df457b15611 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:47.759812 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de6f98-be9e-4240-980b-2df457b15611 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:47.760094 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de6f98-be9e-4240-980b-2df457b15611 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:47.760874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de6f98-be9e-4240-980b-2df457b15611 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:47.761221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de6f98-be9e-4240-980b-2df457b15611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:47.762651 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de6f98-be9e-4240-980b-2df457b15611 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:47.779047 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 553/1096] 10.222.0.76 () {56 vars in 1115 bytes} [Mon Jul 18 16:30:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:47.780304 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f0f09-9d49-4690-97f4-30bdb6d5de1b None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:47.820495 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:47.894317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9f0f09-9d49-4690-97f4-30bdb6d5de1b None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:47.932289 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997ce51-b4ef-49d1-bd33-ec4c9fc64217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:47.933131 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997ce51-b4ef-49d1-bd33-ec4c9fc64217 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:47.933421 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997ce51-b4ef-49d1-bd33-ec4c9fc64217 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:47.933703 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997ce51-b4ef-49d1-bd33-ec4c9fc64217 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:47.945786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997ce51-b4ef-49d1-bd33-ec4c9fc64217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:47.947366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997ce51-b4ef-49d1-bd33-ec4c9fc64217 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:47.965710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-6997ce51-b4ef-49d1-bd33-ec4c9fc64217 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:47.965710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:47.965710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:47.965710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:47.965710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:47.965710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:47.965710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:47.965710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:47.965710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:47.965710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:47.965710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:47.965710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:47.965710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:47.965710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:47.965710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:47.966844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:47.966844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:47.966844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:47.966844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:47.966844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:47.966844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:47.966844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:47.966844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:47.966844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:47.966844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:47.966844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:47.966844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:47.966844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:47.966844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:47.966844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:47.966844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:47.966844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:47.967913 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:47.967913 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:47.967913 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:47.967913 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:47.967913 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 544/1097] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:47.972900 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de6f98-be9e-4240-980b-2df457b15611 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:48.020510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:48.076284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de6f98-be9e-4240-980b-2df457b15611 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:48.116213 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ae9cd-f9e5-4d37-88c5-6c203f9e474c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:48.116875 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae9cd-f9e5-4d37-88c5-6c203f9e474c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:48.117244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae9cd-f9e5-4d37-88c5-6c203f9e474c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:48.118379 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ae9cd-f9e5-4d37-88c5-6c203f9e474c None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:48.119115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ae9cd-f9e5-4d37-88c5-6c203f9e474c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:48.119422 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ae9cd-f9e5-4d37-88c5-6c203f9e474c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:48.120783 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ae9cd-f9e5-4d37-88c5-6c203f9e474c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:48.133391 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 554/1098] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:48.139087 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997ce51-b4ef-49d1-bd33-ec4c9fc64217 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:48.230916 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:48.246053 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997ce51-b4ef-49d1-bd33-ec4c9fc64217 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:48.281675 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259783d-7b58-4354-872b-b94282901c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:48.282473 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259783d-7b58-4354-872b-b94282901c4e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:48.282755 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259783d-7b58-4354-872b-b94282901c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:48.283030 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6259783d-7b58-4354-872b-b94282901c4e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:48.290331 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259783d-7b58-4354-872b-b94282901c4e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:48.291779 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6259783d-7b58-4354-872b-b94282901c4e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:48.307108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-6259783d-7b58-4354-872b-b94282901c4e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:30:48.307108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:48.307108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:48.307108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:48.307108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:48.307108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:48.307108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:48.307108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:48.307108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:48.307108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:48.307108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:48.307108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:48.307108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:30:48.307108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:30:48.307108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:30:48.307108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:30:48.308334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:48.308334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:48.308334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:30:48.308334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:48.308334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:30:48.308334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:30:48.308334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:48.308334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:48.308334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:48.308334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:48.308334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:48.308334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:48.308334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:48.308334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:48.308334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:48.308334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:48.308334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:48.308334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:48.309346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:48.309346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:48.309346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:30:48.309346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:30:48.309346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:30:48.309346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:30:48.309346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:30:48.309346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:30:48.309346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 18 16:30:48.309346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:30:48.309346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 545/1099] 10.222.0.76 () {56 vars in 1093 bytes} [Mon Jul 18 16:30:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:48.314312 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ae9cd-f9e5-4d37-88c5-6c203f9e474c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:48.418089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ae9cd-f9e5-4d37-88c5-6c203f9e474c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:48.425652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:48.452990 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212cb9c-0bc8-4242-8993-f5a79a842d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:48.453705 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212cb9c-0bc8-4242-8993-f5a79a842d35 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:48.453988 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212cb9c-0bc8-4242-8993-f5a79a842d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:48.454266 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6212cb9c-0bc8-4242-8993-f5a79a842d35 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:48.455160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212cb9c-0bc8-4242-8993-f5a79a842d35 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:48.455493 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212cb9c-0bc8-4242-8993-f5a79a842d35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:48.456924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6212cb9c-0bc8-4242-8993-f5a79a842d35 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:48.476333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 555/1100] 10.222.0.76 () {56 vars in 1133 bytes} [Mon Jul 18 16:30:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:30:48.482618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259783d-7b58-4354-872b-b94282901c4e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:48.591887 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6259783d-7b58-4354-872b-b94282901c4e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:48.626717 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1d18d-9bf0-4ee7-bf68-31a8cd433720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:48.627400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1d18d-9bf0-4ee7-bf68-31a8cd433720 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:48.627729 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1d18d-9bf0-4ee7-bf68-31a8cd433720 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:48.628035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1d18d-9bf0-4ee7-bf68-31a8cd433720 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:48.644303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:48.699008 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1d18d-9bf0-4ee7-bf68-31a8cd433720 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:48.700378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1d18d-9bf0-4ee7-bf68-31a8cd433720 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:48.814828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 546/1101] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:30:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:30:48.820830 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212cb9c-0bc8-4242-8993-f5a79a842d35 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:48.925596 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6212cb9c-0bc8-4242-8993-f5a79a842d35 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:48.962324 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b2947-de56-4f7c-aa69-8f4d2b6fdf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:48.963038 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b2947-de56-4f7c-aa69-8f4d2b6fdf33 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:48.963317 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b2947-de56-4f7c-aa69-8f4d2b6fdf33 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:48.963589 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b2947-de56-4f7c-aa69-8f4d2b6fdf33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:48.973748 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b2947-de56-4f7c-aa69-8f4d2b6fdf33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:48.975185 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b2947-de56-4f7c-aa69-8f4d2b6fdf33 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:48.994985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-8a2b2947-de56-4f7c-aa69-8f4d2b6fdf33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:48.994985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:48.994985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:48.994985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:48.994985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:48.994985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:48.994985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:48.994985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:48.994985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:48.994985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:48.994985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:48.994985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:48.994985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:30:48.994985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:30:48.994985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:30:48.996076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:30:48.996076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:48.996076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:48.996076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:48.996076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:48.996076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:48.996076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:48.996076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:48.996076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:48.996076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:48.996076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:48.996076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:48.996076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:48.996076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:48.996076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:48.996076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:48.996076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:48.997004 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:30:48.997004 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:30:48.997004 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:30:48.997004 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:48.997004 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 556/1102] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:30:49.003130 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1d18d-9bf0-4ee7-bf68-31a8cd433720 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:49.050326 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:49.103583 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1d18d-9bf0-4ee7-bf68-31a8cd433720 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:49.138023 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc63d5-ade0-4ae7-86b8-ca4f79a1e786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:49.138682 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc63d5-ade0-4ae7-86b8-ca4f79a1e786 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:49.138963 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc63d5-ade0-4ae7-86b8-ca4f79a1e786 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:49.139239 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cc63d5-ade0-4ae7-86b8-ca4f79a1e786 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:49.139962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc63d5-ade0-4ae7-86b8-ca4f79a1e786 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:49.140265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc63d5-ade0-4ae7-86b8-ca4f79a1e786 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:49.141663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cc63d5-ade0-4ae7-86b8-ca4f79a1e786 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:49.154820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 547/1103] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:30:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:49.160444 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b2947-de56-4f7c-aa69-8f4d2b6fdf33 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:49.179660 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:49.263372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b2947-de56-4f7c-aa69-8f4d2b6fdf33 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:49.298210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006e0a9-508e-4ca6-8610-aba637514d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:49.299000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006e0a9-508e-4ca6-8610-aba637514d48 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:49.299283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006e0a9-508e-4ca6-8610-aba637514d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:49.299556 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8006e0a9-508e-4ca6-8610-aba637514d48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:49.306487 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006e0a9-508e-4ca6-8610-aba637514d48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:49.307922 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8006e0a9-508e-4ca6-8610-aba637514d48 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:49.322420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-8006e0a9-508e-4ca6-8610-aba637514d48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:49.322420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:30:49.322420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:30:49.322420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:30:49.322420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:30:49.322420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:30:49.322420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:30:49.322420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:30:49.322420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:30:49.322420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:30:49.322420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:30:49.322420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:30:49.322420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:30:49.322420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:30:49.322420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:30:49.323387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:30:49.323387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:30:49.323387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:30:49.323387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:30:49.323387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:30:49.323387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:30:49.323387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:30:49.323387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:30:49.323387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:30:49.323387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:30:49.323387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:30:49.323387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:30:49.323387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:30:49.323387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:30:49.323387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:30:49.323387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:30:49.323387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:30:49.324368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:30:49.324368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:30:49.324368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:30:49.324368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:30:49.324368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:30:49.324368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:30:49.324368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:30:49.324368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:30:49.324368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 557/1104] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:30:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:30:49.329637 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc63d5-ade0-4ae7-86b8-ca4f79a1e786 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:49.432833 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cc63d5-ade0-4ae7-86b8-ca4f79a1e786 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:49.440533 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:49.467225 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a4e56-0fb3-45e7-8d04-9dbc996bd313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:49.467890 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a4e56-0fb3-45e7-8d04-9dbc996bd313 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:49.468178 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a4e56-0fb3-45e7-8d04-9dbc996bd313 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:49.468456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a4e56-0fb3-45e7-8d04-9dbc996bd313 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:49.469273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a4e56-0fb3-45e7-8d04-9dbc996bd313 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:49.469585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a4e56-0fb3-45e7-8d04-9dbc996bd313 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:49.471012 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a4e56-0fb3-45e7-8d04-9dbc996bd313 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:49.482706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 548/1105] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:30:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:49.488946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006e0a9-508e-4ca6-8610-aba637514d48 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:49.575368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:49.597405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8006e0a9-508e-4ca6-8610-aba637514d48 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:49.631221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937166c5-5a6d-4965-834b-b5759fb8439c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:49.631879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937166c5-5a6d-4965-834b-b5759fb8439c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:49.632159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937166c5-5a6d-4965-834b-b5759fb8439c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:49.632434 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937166c5-5a6d-4965-834b-b5759fb8439c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:49.634024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937166c5-5a6d-4965-834b-b5759fb8439c None admin] RBAC: Adding query filter params (role.id=96360c5874dd4a1f87b4695f1088f5b1, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=381cf4381ce64379b285d75e2909813d) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:49.634365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937166c5-5a6d-4965-834b-b5759fb8439c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:49.635848 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937166c5-5a6d-4965-834b-b5759fb8439c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:49.643030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 558/1106] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:30:49 2022] GET /identity/v3/role_assignments?user.id=381cf4381ce64379b285d75e2909813d&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=96360c5874dd4a1f87b4695f1088f5b1 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:49.834055 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce164e47-d5a3-48ce-bcbf-2543535c6d6a None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:49.834544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce164e47-d5a3-48ce-bcbf-2543535c6d6a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:49.834544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce164e47-d5a3-48ce-bcbf-2543535c6d6a None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:49.836532 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 549/1107] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:49.842178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3eb7a-c964-4eed-8cdb-b5870f6358f6 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:49.842623 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3eb7a-c964-4eed-8cdb-b5870f6358f6 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:49.842739 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3eb7a-c964-4eed-8cdb-b5870f6358f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:49.862981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e6f3eb7a-c964-4eed-8cdb-b5870f6358f6 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:49.864276 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e6f3eb7a-c964-4eed-8cdb-b5870f6358f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:49.939029 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 559/1108] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:49.966051 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce164e47-d5a3-48ce-bcbf-2543535c6d6a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:50.075962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce164e47-d5a3-48ce-bcbf-2543535c6d6a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:50.111541 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988f35a-d37a-477a-98a2-c8b9a92941bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:50.112266 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988f35a-d37a-477a-98a2-c8b9a92941bb None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:50.112548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988f35a-d37a-477a-98a2-c8b9a92941bb None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:50.112822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988f35a-d37a-477a-98a2-c8b9a92941bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:50.114057 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988f35a-d37a-477a-98a2-c8b9a92941bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:50.115484 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e988f35a-d37a-477a-98a2-c8b9a92941bb None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:50.118122 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 550/1109] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:30:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:50.124601 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3eb7a-c964-4eed-8cdb-b5870f6358f6 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:50.203895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:50.232447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3eb7a-c964-4eed-8cdb-b5870f6358f6 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:50.271646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24e75b-f481-4590-9700-a1fcf89b16f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:50.272336 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24e75b-f481-4590-9700-a1fcf89b16f1 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:50.272618 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24e75b-f481-4590-9700-a1fcf89b16f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:50.272895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24e75b-f481-4590-9700-a1fcf89b16f1 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:50.273863 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24e75b-f481-4590-9700-a1fcf89b16f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:50.275311 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24e75b-f481-4590-9700-a1fcf89b16f1 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:50.378230 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 560/1110] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 16:30:50 2022] POST /identity/v3/users => generated 286 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:30:52.459306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28a117-ffb6-4f9f-a63c-c76fc7592844 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:52.459803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28a117-ffb6-4f9f-a63c-c76fc7592844 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:52.459907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f28a117-ffb6-4f9f-a63c-c76fc7592844 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:52.461272 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 551/1111] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:52.466750 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad50ce3-b4b1-4b1a-b3bb-84b69101083d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:52.467190 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad50ce3-b4b1-4b1a-b3bb-84b69101083d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:52.467326 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad50ce3-b4b1-4b1a-b3bb-84b69101083d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:52.484644 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-aad50ce3-b4b1-4b1a-b3bb-84b69101083d None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:52.485872 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-aad50ce3-b4b1-4b1a-b3bb-84b69101083d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:52.558622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 561/1112] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:52.584255 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28a117-ffb6-4f9f-a63c-c76fc7592844 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:52.621661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:52.689980 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f28a117-ffb6-4f9f-a63c-c76fc7592844 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:52.726657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5846f1-5448-420f-bf8e-4ea93da14ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:52.727435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5846f1-5448-420f-bf8e-4ea93da14ed3 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:52.727719 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5846f1-5448-420f-bf8e-4ea93da14ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:52.727995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5846f1-5448-420f-bf8e-4ea93da14ed3 None admin] PATH_INFO: `/v3/roles/e92acb6fd9834582bb4fd34409b37f94` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:52.729532 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5846f1-5448-420f-bf8e-4ea93da14ed3 None admin] RBAC: Authorizing `identity:get_role(role_id=e92acb6fd9834582bb4fd34409b37f94)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:52.730958 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5846f1-5448-420f-bf8e-4ea93da14ed3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:52.732695 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 552/1113] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:30:52 2022] GET /identity/v3/roles/e92acb6fd9834582bb4fd34409b37f94 => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:52.738288 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad50ce3-b4b1-4b1a-b3bb-84b69101083d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:52.799287 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:52.846310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad50ce3-b4b1-4b1a-b3bb-84b69101083d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:52.883090 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afb5b3-c2ca-41f6-91a2-0b798c330975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:52.883989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afb5b3-c2ca-41f6-91a2-0b798c330975 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:52.884278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afb5b3-c2ca-41f6-91a2-0b798c330975 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:52.884559 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afb5b3-c2ca-41f6-91a2-0b798c330975 None admin] PATH_INFO: `/v3/users/61888ed97cae4bbea04f188f70764627` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:52.898205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afb5b3-c2ca-41f6-91a2-0b798c330975 None admin] RBAC: Authorizing `identity:get_user(user_id=61888ed97cae4bbea04f188f70764627)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:52.899686 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afb5b3-c2ca-41f6-91a2-0b798c330975 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:52.901680 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 562/1114] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:30:52 2022] GET /identity/v3/users/61888ed97cae4bbea04f188f70764627 => generated 286 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:52.907499 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5846f1-5448-420f-bf8e-4ea93da14ed3 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:53.013585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5846f1-5448-420f-bf8e-4ea93da14ed3 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:53.015706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:53.050500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a82235-c6b7-4272-a2e8-1c9cc911c872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:53.051451 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a82235-c6b7-4272-a2e8-1c9cc911c872 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:53.051734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a82235-c6b7-4272-a2e8-1c9cc911c872 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:53.052011 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a82235-c6b7-4272-a2e8-1c9cc911c872 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:53.129284 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a82235-c6b7-4272-a2e8-1c9cc911c872 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:53.130744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a82235-c6b7-4272-a2e8-1c9cc911c872 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:53.236112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 553/1115] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:30:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:30:53.242118 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afb5b3-c2ca-41f6-91a2-0b798c330975 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:53.348215 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afb5b3-c2ca-41f6-91a2-0b798c330975 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:53.365410 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:53.392425 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa9a17-07bf-40c7-8976-1c8e8f092d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:53.393390 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa9a17-07bf-40c7-8976-1c8e8f092d66 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:53.393676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa9a17-07bf-40c7-8976-1c8e8f092d66 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:53.393958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa9a17-07bf-40c7-8976-1c8e8f092d66 None admin] PATH_INFO: `/v3/projects/21ecd411d3994866bf9722e16980b489` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:53.395149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa9a17-07bf-40c7-8976-1c8e8f092d66 None admin] RBAC: Authorizing `identity:get_project(project_id=21ecd411d3994866bf9722e16980b489)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:53.396598 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa9a17-07bf-40c7-8976-1c8e8f092d66 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:53.400307 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 563/1116] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:30:53 2022] GET /identity/v3/projects/21ecd411d3994866bf9722e16980b489 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:53.405398 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a82235-c6b7-4272-a2e8-1c9cc911c872 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:53.407580 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:53.511707 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a82235-c6b7-4272-a2e8-1c9cc911c872 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:53.547174 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6491d-ab12-433b-9d0e-4c0f2ba63716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:53.547931 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6491d-ab12-433b-9d0e-4c0f2ba63716 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:53.548268 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6491d-ab12-433b-9d0e-4c0f2ba63716 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:53.548596 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6491d-ab12-433b-9d0e-4c0f2ba63716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:53.549523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6491d-ab12-433b-9d0e-4c0f2ba63716 None admin] RBAC: Adding query filter params (role.id=e92acb6fd9834582bb4fd34409b37f94, scope.project.id=21ecd411d3994866bf9722e16980b489, user.id=61888ed97cae4bbea04f188f70764627) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:53.549838 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6491d-ab12-433b-9d0e-4c0f2ba63716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:53.551272 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6491d-ab12-433b-9d0e-4c0f2ba63716 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:53.556996 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 554/1117] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:30:53 2022] GET /identity/v3/role_assignments?user.id=61888ed97cae4bbea04f188f70764627&scope.project.id=21ecd411d3994866bf9722e16980b489&role.id=e92acb6fd9834582bb4fd34409b37f94 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:55.713401 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce0fbe-ad0a-4ebe-8813-9b5bb7f6f182 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:55.713922 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce0fbe-ad0a-4ebe-8813-9b5bb7f6f182 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:55.714010 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce0fbe-ad0a-4ebe-8813-9b5bb7f6f182 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:55.715421 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 564/1118] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:55.721155 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20115bca-358d-449a-935d-c61d85148e60 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:55.722194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20115bca-358d-449a-935d-c61d85148e60 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:55.722551 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20115bca-358d-449a-935d-c61d85148e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:55.740356 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-20115bca-358d-449a-935d-c61d85148e60 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:55.742592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-20115bca-358d-449a-935d-c61d85148e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:55.809326 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:55.817213 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 555/1119] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:55.839418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce0fbe-ad0a-4ebe-8813-9b5bb7f6f182 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:55.945855 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce0fbe-ad0a-4ebe-8813-9b5bb7f6f182 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:55.981592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358faa59-2667-4e5a-98d6-a7a12457c125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:55.982435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358faa59-2667-4e5a-98d6-a7a12457c125 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:55.982713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358faa59-2667-4e5a-98d6-a7a12457c125 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:55.982985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358faa59-2667-4e5a-98d6-a7a12457c125 None admin] PATH_INFO: `/v3/roles/e92acb6fd9834582bb4fd34409b37f94` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:55.984450 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358faa59-2667-4e5a-98d6-a7a12457c125 None admin] RBAC: Authorizing `identity:get_role(role_id=e92acb6fd9834582bb4fd34409b37f94)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:55.985877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358faa59-2667-4e5a-98d6-a7a12457c125 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:55.987284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 565/1120] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:30:55 2022] GET /identity/v3/roles/e92acb6fd9834582bb4fd34409b37f94 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:55.994318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20115bca-358d-449a-935d-c61d85148e60 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:56.099078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20115bca-358d-449a-935d-c61d85148e60 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:56.134793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee70f64-1586-4185-8075-6e2dd2c299d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:56.135740 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee70f64-1586-4185-8075-6e2dd2c299d1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:56.136033 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee70f64-1586-4185-8075-6e2dd2c299d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:56.136313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee70f64-1586-4185-8075-6e2dd2c299d1 None admin] PATH_INFO: `/v3/users/61888ed97cae4bbea04f188f70764627` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:56.137553 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee70f64-1586-4185-8075-6e2dd2c299d1 None admin] RBAC: Authorizing `identity:get_user(user_id=61888ed97cae4bbea04f188f70764627)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:56.139100 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee70f64-1586-4185-8075-6e2dd2c299d1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:56.140749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 556/1121] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:30:55 2022] GET /identity/v3/users/61888ed97cae4bbea04f188f70764627 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:56.146859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358faa59-2667-4e5a-98d6-a7a12457c125 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:56.200866 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:56.252660 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358faa59-2667-4e5a-98d6-a7a12457c125 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:56.287887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a3572-ca25-434f-8d22-16e39a4ff6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:56.289400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a3572-ca25-434f-8d22-16e39a4ff6db None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:56.291137 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a3572-ca25-434f-8d22-16e39a4ff6db None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:56.291137 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a3572-ca25-434f-8d22-16e39a4ff6db None admin] PATH_INFO: `/v3/projects/21ecd411d3994866bf9722e16980b489` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:56.291370 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a3572-ca25-434f-8d22-16e39a4ff6db None admin] RBAC: Authorizing `identity:get_project(project_id=21ecd411d3994866bf9722e16980b489)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:56.292775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a3572-ca25-434f-8d22-16e39a4ff6db None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:56.294600 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 566/1122] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:30:56 2022] GET /identity/v3/projects/21ecd411d3994866bf9722e16980b489 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:56.300759 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee70f64-1586-4185-8075-6e2dd2c299d1 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:56.366040 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:56.404197 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee70f64-1586-4185-8075-6e2dd2c299d1 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:56.439289 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ceb8bf-1b6d-4504-b9c2-7352c3bb56ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:56.440189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ceb8bf-1b6d-4504-b9c2-7352c3bb56ab None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:56.440476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ceb8bf-1b6d-4504-b9c2-7352c3bb56ab None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:56.440757 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ceb8bf-1b6d-4504-b9c2-7352c3bb56ab None admin] PATH_INFO: `/v3/projects/21ecd411d3994866bf9722e16980b489/users/61888ed97cae4bbea04f188f70764627/roles/e92acb6fd9834582bb4fd34409b37f94` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:56.443026 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ceb8bf-1b6d-4504-b9c2-7352c3bb56ab None admin] RBAC: Authorizing `identity:create_grant(project_id=21ecd411d3994866bf9722e16980b489, user_id=61888ed97cae4bbea04f188f70764627, role_id=e92acb6fd9834582bb4fd34409b37f94)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:56.444581 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ceb8bf-1b6d-4504-b9c2-7352c3bb56ab None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:56.532286 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 557/1123] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:30:56 2022] PUT /identity/v3/projects/21ecd411d3994866bf9722e16980b489/users/61888ed97cae4bbea04f188f70764627/roles/e92acb6fd9834582bb4fd34409b37f94 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:30:58.558118 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51e1ad-8607-48b5-b417-80c4ad34ce5a None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:58.558642 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51e1ad-8607-48b5-b417-80c4ad34ce5a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:58.558734 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec51e1ad-8607-48b5-b417-80c4ad34ce5a None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:58.560065 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 567/1124] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:30:58.565444 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3b9de-09bd-4de4-be8a-b144c4f2ed05 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:58.565867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3b9de-09bd-4de4-be8a-b144c4f2ed05 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:58.566055 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af3b9de-09bd-4de4-be8a-b144c4f2ed05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:58.583282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9af3b9de-09bd-4de4-be8a-b144c4f2ed05 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:30:58.584477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9af3b9de-09bd-4de4-be8a-b144c4f2ed05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:30:58.651058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 558/1125] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:30:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:30:58.673757 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51e1ad-8607-48b5-b417-80c4ad34ce5a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:58.778623 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec51e1ad-8607-48b5-b417-80c4ad34ce5a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:58.797068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:58.814810 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bd2c2-c505-4abe-b30f-28af22ee2b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:58.815688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bd2c2-c505-4abe-b30f-28af22ee2b15 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:58.815977 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bd2c2-c505-4abe-b30f-28af22ee2b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:58.816259 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bd2c2-c505-4abe-b30f-28af22ee2b15 None admin] PATH_INFO: `/v3/roles/e92acb6fd9834582bb4fd34409b37f94` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:58.817783 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bd2c2-c505-4abe-b30f-28af22ee2b15 None admin] RBAC: Authorizing `identity:get_role(role_id=e92acb6fd9834582bb4fd34409b37f94)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:58.819162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bd2c2-c505-4abe-b30f-28af22ee2b15 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:58.820868 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 568/1126] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:30:58 2022] GET /identity/v3/roles/e92acb6fd9834582bb4fd34409b37f94 => generated 223 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:58.827066 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3b9de-09bd-4de4-be8a-b144c4f2ed05 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:58.881185 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:58.924429 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af3b9de-09bd-4de4-be8a-b144c4f2ed05 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:58.958635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8726a7-53e6-41ae-ac20-499d93adb12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:58.959506 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8726a7-53e6-41ae-ac20-499d93adb12e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:58.959790 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8726a7-53e6-41ae-ac20-499d93adb12e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:58.960108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8726a7-53e6-41ae-ac20-499d93adb12e None admin] PATH_INFO: `/v3/users/61888ed97cae4bbea04f188f70764627` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:58.961320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8726a7-53e6-41ae-ac20-499d93adb12e None admin] RBAC: Authorizing `identity:get_user(user_id=61888ed97cae4bbea04f188f70764627)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:58.962754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8726a7-53e6-41ae-ac20-499d93adb12e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:58.964373 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 559/1127] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:30:58 2022] GET /identity/v3/users/61888ed97cae4bbea04f188f70764627 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:58.970352 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bd2c2-c505-4abe-b30f-28af22ee2b15 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:59.069653 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bd2c2-c505-4abe-b30f-28af22ee2b15 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:59.103808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b3960-3884-484c-9185-01f60f11c5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:59.104463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b3960-3884-484c-9185-01f60f11c5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:59.104752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b3960-3884-484c-9185-01f60f11c5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:59.105055 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44b3960-3884-484c-9185-01f60f11c5e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:59.162592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:59.176319 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b3960-3884-484c-9185-01f60f11c5e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:59.177817 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44b3960-3884-484c-9185-01f60f11c5e4 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:59.277073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 569/1128] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:30:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 16:30:59.283173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8726a7-53e6-41ae-ac20-499d93adb12e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:59.383189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8726a7-53e6-41ae-ac20-499d93adb12e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:59.405938 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:59.417882 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b70dbf9-5d3f-4aa6-8cf1-10532a72aa08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:59.418745 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70dbf9-5d3f-4aa6-8cf1-10532a72aa08 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:59.419030 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70dbf9-5d3f-4aa6-8cf1-10532a72aa08 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:59.422589 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b70dbf9-5d3f-4aa6-8cf1-10532a72aa08 None admin] PATH_INFO: `/v3/projects/21ecd411d3994866bf9722e16980b489` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:59.422589 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70dbf9-5d3f-4aa6-8cf1-10532a72aa08 None admin] RBAC: Authorizing `identity:get_project(project_id=21ecd411d3994866bf9722e16980b489)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:59.422589 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b70dbf9-5d3f-4aa6-8cf1-10532a72aa08 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:59.423637 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 560/1129] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:30:59 2022] GET /identity/v3/projects/21ecd411d3994866bf9722e16980b489 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:30:59.430123 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b3960-3884-484c-9185-01f60f11c5e4 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:30:59.513663 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:30:59.528841 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44b3960-3884-484c-9185-01f60f11c5e4 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:30:59.562861 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9274ef1-a798-4728-b615-b26eb1ec47be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:30:59.563521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9274ef1-a798-4728-b615-b26eb1ec47be None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:30:59.563833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9274ef1-a798-4728-b615-b26eb1ec47be None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:30:59.564111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9274ef1-a798-4728-b615-b26eb1ec47be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:30:59.564943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9274ef1-a798-4728-b615-b26eb1ec47be None admin] RBAC: Adding query filter params (role.id=e92acb6fd9834582bb4fd34409b37f94, scope.project.id=21ecd411d3994866bf9722e16980b489, user.id=61888ed97cae4bbea04f188f70764627) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:30:59.565284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9274ef1-a798-4728-b615-b26eb1ec47be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:30:59.566717 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9274ef1-a798-4728-b615-b26eb1ec47be None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:30:59.573180 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 570/1130] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:30:59 2022] GET /identity/v3/role_assignments?user.id=61888ed97cae4bbea04f188f70764627&scope.project.id=21ecd411d3994866bf9722e16980b489&role.id=e92acb6fd9834582bb4fd34409b37f94 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:31:01.603819 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8640223-8bad-475e-9ebe-1744747f8cec None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:01.604348 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8640223-8bad-475e-9ebe-1744747f8cec None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:01.604437 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8640223-8bad-475e-9ebe-1744747f8cec None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:01.605831 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 561/1131] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:31:01.610996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612a4fc-f4ce-4f42-add9-f3e9a3c78f0a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:01.611449 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612a4fc-f4ce-4f42-add9-f3e9a3c78f0a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:01.611545 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612a4fc-f4ce-4f42-add9-f3e9a3c78f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:01.628436 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-6612a4fc-f4ce-4f42-add9-f3e9a3c78f0a None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:31:01.629671 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6612a4fc-f4ce-4f42-add9-f3e9a3c78f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:31:01.696535 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 571/1132] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:31:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:31:01.720174 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8640223-8bad-475e-9ebe-1744747f8cec None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:01.822627 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8640223-8bad-475e-9ebe-1744747f8cec None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:01.857058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79902ce0-a622-4f94-8bae-62eb1cc3a6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:01.857772 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79902ce0-a622-4f94-8bae-62eb1cc3a6cc None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:01.858053 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79902ce0-a622-4f94-8bae-62eb1cc3a6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:01.858324 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79902ce0-a622-4f94-8bae-62eb1cc3a6cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:01.859477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79902ce0-a622-4f94-8bae-62eb1cc3a6cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:01.860903 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79902ce0-a622-4f94-8bae-62eb1cc3a6cc None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:01.862515 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 562/1133] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:31:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:01.869326 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612a4fc-f4ce-4f42-add9-f3e9a3c78f0a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:01.956749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:01.976740 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612a4fc-f4ce-4f42-add9-f3e9a3c78f0a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:02.011024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb64c87-206e-4afb-a3d6-a193f9759cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:02.011687 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb64c87-206e-4afb-a3d6-a193f9759cde None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:02.011975 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb64c87-206e-4afb-a3d6-a193f9759cde None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:02.012252 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb64c87-206e-4afb-a3d6-a193f9759cde None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:02.012974 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb64c87-206e-4afb-a3d6-a193f9759cde None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:02.014436 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb64c87-206e-4afb-a3d6-a193f9759cde None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:02.138751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 572/1134] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 16:31:01 2022] POST /identity/v3/projects => generated 311 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:31:04.192707 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf741c14-4b1f-4f29-a1e3-8b0c6b369e67 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:04.193247 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf741c14-4b1f-4f29-a1e3-8b0c6b369e67 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:04.193349 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf741c14-4b1f-4f29-a1e3-8b0c6b369e67 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:04.194731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 563/1135] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:31:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:31:04.200066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dde895-d7d2-4390-aa97-c34f0681fc3c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:04.200479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dde895-d7d2-4390-aa97-c34f0681fc3c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:04.200623 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dde895-d7d2-4390-aa97-c34f0681fc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:04.217449 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-93dde895-d7d2-4390-aa97-c34f0681fc3c None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:31:04.218677 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-93dde895-d7d2-4390-aa97-c34f0681fc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:31:04.286388 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 573/1136] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:31:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:31:04.312716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf741c14-4b1f-4f29-a1e3-8b0c6b369e67 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:04.382843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:04.424062 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf741c14-4b1f-4f29-a1e3-8b0c6b369e67 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:04.459055 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8caf73a-cd1f-4bef-a501-d3cd7ebccdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:04.459888 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8caf73a-cd1f-4bef-a501-d3cd7ebccdc8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:04.460172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8caf73a-cd1f-4bef-a501-d3cd7ebccdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:04.460444 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8caf73a-cd1f-4bef-a501-d3cd7ebccdc8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:04.461637 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8caf73a-cd1f-4bef-a501-d3cd7ebccdc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:04.463072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8caf73a-cd1f-4bef-a501-d3cd7ebccdc8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:04.464681 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 564/1137] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:31:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:04.470868 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dde895-d7d2-4390-aa97-c34f0681fc3c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:04.531150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:04.569934 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dde895-d7d2-4390-aa97-c34f0681fc3c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:04.605795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1661c78-0d1e-4f72-aaa1-2c98613ec63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:04.606472 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1661c78-0d1e-4f72-aaa1-2c98613ec63d None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:04.606758 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1661c78-0d1e-4f72-aaa1-2c98613ec63d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:04.607034 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1661c78-0d1e-4f72-aaa1-2c98613ec63d None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:04.607743 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1661c78-0d1e-4f72-aaa1-2c98613ec63d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:04.609318 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1661c78-0d1e-4f72-aaa1-2c98613ec63d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:04.725780 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 574/1138] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 16:31:04 2022] POST /identity/v3/users => generated 286 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:31:06.818063 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2df23f-d0e4-456f-8c0c-a8b4cd33d813 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:06.818664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2df23f-d0e4-456f-8c0c-a8b4cd33d813 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:06.818664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2df23f-d0e4-456f-8c0c-a8b4cd33d813 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:06.820700 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 565/1139] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:31:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:31:06.825994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3f16b-eea6-4eeb-ae1e-181b6215f537 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:06.826430 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3f16b-eea6-4eeb-ae1e-181b6215f537 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:06.826561 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3f16b-eea6-4eeb-ae1e-181b6215f537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:06.844036 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-84f3f16b-eea6-4eeb-ae1e-181b6215f537 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:31:06.845273 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-84f3f16b-eea6-4eeb-ae1e-181b6215f537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:31:06.912796 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 575/1140] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:31:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:31:06.936279 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2df23f-d0e4-456f-8c0c-a8b4cd33d813 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:07.036937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2df23f-d0e4-456f-8c0c-a8b4cd33d813 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:07.063047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:07.075962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32799a6-b41f-4f24-9955-58416a2adc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:07.075962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32799a6-b41f-4f24-9955-58416a2adc55 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:07.075962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32799a6-b41f-4f24-9955-58416a2adc55 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:07.075962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32799a6-b41f-4f24-9955-58416a2adc55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:07.083764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32799a6-b41f-4f24-9955-58416a2adc55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:31:07.092150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-e32799a6-b41f-4f24-9955-58416a2adc55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:31:07.092150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:07.092150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:07.092150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:07.092150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:07.092150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:07.092150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:07.092150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:07.092150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:07.092150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:07.092150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:07.092150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:07.092150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:31:07.092150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:31:07.092150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:31:07.092150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:31:07.093510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:31:07.093510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:31:07.093510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:31:07.093510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:31:07.093510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:07.093510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:07.093510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:07.093510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:07.093510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:07.093510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:07.093510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:07.093510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:07.093510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:07.093510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:07.093510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:07.093510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:07.094778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:07.094778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:07.094778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:07.094778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:07.094778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:31:07.094778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:31:07.094778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:31:07.094778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:31:07.094778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:31:07.094778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:31:07.094778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:31:07.094778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:31:07.094778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 566/1141] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:31:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:07.099494 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3f16b-eea6-4eeb-ae1e-181b6215f537 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:07.149677 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:07.200227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3f16b-eea6-4eeb-ae1e-181b6215f537 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:07.235341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f025f04-3cdc-49d7-8659-42ec3753a698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:07.239046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f025f04-3cdc-49d7-8659-42ec3753a698 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:07.239559 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f025f04-3cdc-49d7-8659-42ec3753a698 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:07.239901 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f025f04-3cdc-49d7-8659-42ec3753a698 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:07.241244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f025f04-3cdc-49d7-8659-42ec3753a698 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:07.241567 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f025f04-3cdc-49d7-8659-42ec3753a698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:07.243224 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f025f04-3cdc-49d7-8659-42ec3753a698 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:07.252006 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 576/1142] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:31:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:07.258299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32799a6-b41f-4f24-9955-58416a2adc55 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:07.361438 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32799a6-b41f-4f24-9955-58416a2adc55 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:07.395720 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f8b87-a2e3-4a69-a513-75cbd779c2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:07.396607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f8b87-a2e3-4a69-a513-75cbd779c2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:07.397050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f8b87-a2e3-4a69-a513-75cbd779c2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:07.397343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20f8b87-a2e3-4a69-a513-75cbd779c2b6 None admin] PATH_INFO: `/v3/users/2d39e5f0ba9b4786bb0d7c128d8ac6a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:07.410358 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f8b87-a2e3-4a69-a513-75cbd779c2b6 None admin] RBAC: Authorizing `identity:get_user(user_id=2d39e5f0ba9b4786bb0d7c128d8ac6a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:07.411808 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20f8b87-a2e3-4a69-a513-75cbd779c2b6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:07.413595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 567/1143] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:31:07 2022] GET /identity/v3/users/2d39e5f0ba9b4786bb0d7c128d8ac6a8 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:07.419421 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f025f04-3cdc-49d7-8659-42ec3753a698 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:07.519698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f025f04-3cdc-49d7-8659-42ec3753a698 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:07.530291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:07.552895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05d816-867f-4ddd-a8af-70a6cf53a761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:07.554169 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05d816-867f-4ddd-a8af-70a6cf53a761 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:07.554453 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05d816-867f-4ddd-a8af-70a6cf53a761 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:07.554731 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05d816-867f-4ddd-a8af-70a6cf53a761 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:07.621750 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05d816-867f-4ddd-a8af-70a6cf53a761 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:07.623105 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05d816-867f-4ddd-a8af-70a6cf53a761 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:07.719229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 577/1144] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:31:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:31:07.725861 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f8b87-a2e3-4a69-a513-75cbd779c2b6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:07.771963 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:07.826744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20f8b87-a2e3-4a69-a513-75cbd779c2b6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:07.860994 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289823f0-3fde-4638-8e2f-a8b20aa0d72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:07.861887 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289823f0-3fde-4638-8e2f-a8b20aa0d72e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:07.862170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289823f0-3fde-4638-8e2f-a8b20aa0d72e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:07.862466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289823f0-3fde-4638-8e2f-a8b20aa0d72e None admin] PATH_INFO: `/v3/projects/1bf77f811590430a94e4fdcbdb85adbc` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:07.863617 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289823f0-3fde-4638-8e2f-a8b20aa0d72e None admin] RBAC: Authorizing `identity:get_project(project_id=1bf77f811590430a94e4fdcbdb85adbc)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:07.865075 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289823f0-3fde-4638-8e2f-a8b20aa0d72e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:07.867711 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 568/1145] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:31:07 2022] GET /identity/v3/projects/1bf77f811590430a94e4fdcbdb85adbc => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:07.874099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05d816-867f-4ddd-a8af-70a6cf53a761 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:07.885503 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:07.972186 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05d816-867f-4ddd-a8af-70a6cf53a761 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:08.008926 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fae82-31d4-4e7e-9902-13b4b149e54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:08.009628 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fae82-31d4-4e7e-9902-13b4b149e54c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:08.009915 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fae82-31d4-4e7e-9902-13b4b149e54c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:08.010194 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fae82-31d4-4e7e-9902-13b4b149e54c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:08.011024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fae82-31d4-4e7e-9902-13b4b149e54c None admin] RBAC: Adding query filter params (role.id=c2d5d80485df4730903a874937d68aa3, scope.project.id=1bf77f811590430a94e4fdcbdb85adbc, user.id=2d39e5f0ba9b4786bb0d7c128d8ac6a8) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:08.011339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fae82-31d4-4e7e-9902-13b4b149e54c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:08.012780 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fae82-31d4-4e7e-9902-13b4b149e54c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:08.018221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 578/1146] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:31:07 2022] GET /identity/v3/role_assignments?user.id=2d39e5f0ba9b4786bb0d7c128d8ac6a8&scope.project.id=1bf77f811590430a94e4fdcbdb85adbc&role.id=c2d5d80485df4730903a874937d68aa3 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:10.009313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7c0a7-835d-431b-bc69-8b2ad67b9501 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:10.009871 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7c0a7-835d-431b-bc69-8b2ad67b9501 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:10.009871 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a7c0a7-835d-431b-bc69-8b2ad67b9501 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:10.011250 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 569/1147] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:31:10.016448 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e4922-9e0c-49cc-bd40-5475ecb6ff09 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:10.016907 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e4922-9e0c-49cc-bd40-5475ecb6ff09 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:10.017044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e4922-9e0c-49cc-bd40-5475ecb6ff09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:10.034619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-9a5e4922-9e0c-49cc-bd40-5475ecb6ff09 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:31:10.035948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9a5e4922-9e0c-49cc-bd40-5475ecb6ff09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:31:10.103286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 579/1148] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:31:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:31:10.126546 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7c0a7-835d-431b-bc69-8b2ad67b9501 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:10.235585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a7c0a7-835d-431b-bc69-8b2ad67b9501 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:10.249805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:10.270614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16d8c5-c16f-484e-8332-89294d22d20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:10.271519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16d8c5-c16f-484e-8332-89294d22d20a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:10.272090 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16d8c5-c16f-484e-8332-89294d22d20a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:10.272090 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd16d8c5-c16f-484e-8332-89294d22d20a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:10.282015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd16d8c5-c16f-484e-8332-89294d22d20a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:31:10.290742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-dd16d8c5-c16f-484e-8332-89294d22d20a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:31:10.290742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:10.290742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:10.290742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:10.290742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:10.290742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:10.290742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:10.290742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:10.290742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:10.290742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:10.290742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:10.290742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:10.290742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:31:10.290742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:31:10.290742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:31:10.290742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:31:10.291969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:31:10.291969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:31:10.291969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:31:10.291969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:31:10.291969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:10.291969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:10.291969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:10.291969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:10.291969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:10.291969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:10.291969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:10.291969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:10.291969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:10.291969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:10.291969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:10.291969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:10.293079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:10.293079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:10.293079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:10.293079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:10.293079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:31:10.293079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:31:10.293079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:31:10.293079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:31:10.293079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:31:10.293079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:31:10.293079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:31:10.293079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:31:10.293079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 570/1149] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:31:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:10.298201 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e4922-9e0c-49cc-bd40-5475ecb6ff09 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:10.301271 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:10.398305 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e4922-9e0c-49cc-bd40-5475ecb6ff09 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:10.432822 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa7639-d70f-475e-989d-eab7a64b0a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:10.433517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa7639-d70f-475e-989d-eab7a64b0a99 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:10.433795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa7639-d70f-475e-989d-eab7a64b0a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:10.434066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aa7639-d70f-475e-989d-eab7a64b0a99 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:10.434806 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa7639-d70f-475e-989d-eab7a64b0a99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:10.435107 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa7639-d70f-475e-989d-eab7a64b0a99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:10.436467 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aa7639-d70f-475e-989d-eab7a64b0a99 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:10.445218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 580/1150] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:31:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:10.451212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16d8c5-c16f-484e-8332-89294d22d20a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:10.562558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd16d8c5-c16f-484e-8332-89294d22d20a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:10.595853 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed248f18-780b-492a-94b9-ef6893ede1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:10.596906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed248f18-780b-492a-94b9-ef6893ede1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:10.597295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed248f18-780b-492a-94b9-ef6893ede1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:10.597579 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed248f18-780b-492a-94b9-ef6893ede1a6 None admin] PATH_INFO: `/v3/users/2d39e5f0ba9b4786bb0d7c128d8ac6a8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:10.598808 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed248f18-780b-492a-94b9-ef6893ede1a6 None admin] RBAC: Authorizing `identity:get_user(user_id=2d39e5f0ba9b4786bb0d7c128d8ac6a8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:10.601195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed248f18-780b-492a-94b9-ef6893ede1a6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:10.602814 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 571/1151] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:31:10 2022] GET /identity/v3/users/2d39e5f0ba9b4786bb0d7c128d8ac6a8 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:10.608814 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa7639-d70f-475e-989d-eab7a64b0a99 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:10.674617 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:10.711636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aa7639-d70f-475e-989d-eab7a64b0a99 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:10.745557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644d73a-4063-4b84-a074-1c5099dd07ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:10.746420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644d73a-4063-4b84-a074-1c5099dd07ff None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:10.746705 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644d73a-4063-4b84-a074-1c5099dd07ff None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:10.746980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644d73a-4063-4b84-a074-1c5099dd07ff None admin] PATH_INFO: `/v3/projects/1bf77f811590430a94e4fdcbdb85adbc` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:10.748151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644d73a-4063-4b84-a074-1c5099dd07ff None admin] RBAC: Authorizing `identity:get_project(project_id=1bf77f811590430a94e4fdcbdb85adbc)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:10.749632 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644d73a-4063-4b84-a074-1c5099dd07ff None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:10.751333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 581/1152] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:31:10 2022] GET /identity/v3/projects/1bf77f811590430a94e4fdcbdb85adbc => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:10.759074 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed248f18-780b-492a-94b9-ef6893ede1a6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:10.802989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:10.862620 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed248f18-780b-492a-94b9-ef6893ede1a6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:10.896409 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ccf853-a2b9-4115-8c17-13ca5dabcbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:10.897866 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccf853-a2b9-4115-8c17-13ca5dabcbcc None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:10.898143 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccf853-a2b9-4115-8c17-13ca5dabcbcc None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:10.898417 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ccf853-a2b9-4115-8c17-13ca5dabcbcc None admin] PATH_INFO: `/v3/projects/1bf77f811590430a94e4fdcbdb85adbc/users/2d39e5f0ba9b4786bb0d7c128d8ac6a8/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:10.900373 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccf853-a2b9-4115-8c17-13ca5dabcbcc None admin] RBAC: Authorizing `identity:create_grant(project_id=1bf77f811590430a94e4fdcbdb85adbc, user_id=2d39e5f0ba9b4786bb0d7c128d8ac6a8, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:10.901845 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ccf853-a2b9-4115-8c17-13ca5dabcbcc None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:11.015802 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 572/1153] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:31:10 2022] PUT /identity/v3/projects/1bf77f811590430a94e4fdcbdb85adbc/users/2d39e5f0ba9b4786bb0d7c128d8ac6a8/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:31:13.020286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6d81b-f746-4d92-9e94-42eb7b8ba15b None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:13.020850 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6d81b-f746-4d92-9e94-42eb7b8ba15b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:13.020850 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa6d81b-f746-4d92-9e94-42eb7b8ba15b None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:13.022599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 582/1154] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:31:13.027981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ad8aa-8500-494c-95c9-eedf35c20705 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:13.028357 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ad8aa-8500-494c-95c9-eedf35c20705 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:13.028539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ad8aa-8500-494c-95c9-eedf35c20705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:13.045725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e24ad8aa-8500-494c-95c9-eedf35c20705 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:31:13.046922 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e24ad8aa-8500-494c-95c9-eedf35c20705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:31:13.112592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 573/1155] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:31:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:31:13.136470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6d81b-f746-4d92-9e94-42eb7b8ba15b None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:13.239705 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa6d81b-f746-4d92-9e94-42eb7b8ba15b None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:13.273972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84f3a3-678e-4581-a7e8-363fc8f088cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:13.275051 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84f3a3-678e-4581-a7e8-363fc8f088cc None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:13.275509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84f3a3-678e-4581-a7e8-363fc8f088cc None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:13.275986 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84f3a3-678e-4581-a7e8-363fc8f088cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:13.278510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:13.288697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84f3a3-678e-4581-a7e8-363fc8f088cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:31:13.296377 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-ec84f3a3-678e-4581-a7e8-363fc8f088cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:31:13.296377 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:13.296377 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:13.296377 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:13.296377 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:13.296377 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:13.296377 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:13.296377 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:13.296377 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:13.296377 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:13.296377 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:13.296377 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:13.296377 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:31:13.296377 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:31:13.296377 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:31:13.296377 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:31:13.297525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:31:13.297525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:31:13.297525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:31:13.297525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:31:13.297525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:13.297525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:13.297525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:13.297525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:13.297525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:13.297525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:13.297525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:13.297525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:13.297525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:13.297525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:13.297525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:13.297525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:13.298454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:13.298454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:13.298454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:13.298454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:13.298454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:31:13.298454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:31:13.298454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:31:13.298454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:31:13.298454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:31:13.298454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:31:13.298454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:31:13.298454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:31:13.298454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 583/1156] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:31:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:13.304421 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ad8aa-8500-494c-95c9-eedf35c20705 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:13.333403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:13.405033 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ad8aa-8500-494c-95c9-eedf35c20705 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:13.439637 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25046231-1da8-497b-ad7c-5b32118a38f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:13.440306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25046231-1da8-497b-ad7c-5b32118a38f6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:13.440596 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25046231-1da8-497b-ad7c-5b32118a38f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:13.440877 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25046231-1da8-497b-ad7c-5b32118a38f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:13.441654 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25046231-1da8-497b-ad7c-5b32118a38f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:13.441968 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25046231-1da8-497b-ad7c-5b32118a38f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:13.444342 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25046231-1da8-497b-ad7c-5b32118a38f6 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:13.452397 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 574/1157] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:31:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:13.458296 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84f3a3-678e-4581-a7e8-363fc8f088cc None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:13.558966 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84f3a3-678e-4581-a7e8-363fc8f088cc None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:13.592740 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2524811-e3ef-44e9-9b59-4f888eba5750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:13.593641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2524811-e3ef-44e9-9b59-4f888eba5750 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:13.593926 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2524811-e3ef-44e9-9b59-4f888eba5750 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:13.594200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2524811-e3ef-44e9-9b59-4f888eba5750 None admin] PATH_INFO: `/v3/users/2d39e5f0ba9b4786bb0d7c128d8ac6a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:13.595378 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2524811-e3ef-44e9-9b59-4f888eba5750 None admin] RBAC: Authorizing `identity:get_user(user_id=2d39e5f0ba9b4786bb0d7c128d8ac6a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:13.596825 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2524811-e3ef-44e9-9b59-4f888eba5750 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:13.598494 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 584/1158] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:31:13 2022] GET /identity/v3/users/2d39e5f0ba9b4786bb0d7c128d8ac6a8 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:13.605322 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25046231-1da8-497b-ad7c-5b32118a38f6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:13.695780 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:13.704518 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25046231-1da8-497b-ad7c-5b32118a38f6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:13.740820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca571fbd-4852-4b7a-ac51-87deaeb6c5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:13.742072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca571fbd-4852-4b7a-ac51-87deaeb6c5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:13.742495 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca571fbd-4852-4b7a-ac51-87deaeb6c5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:13.742922 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca571fbd-4852-4b7a-ac51-87deaeb6c5f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:13.811160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca571fbd-4852-4b7a-ac51-87deaeb6c5f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:13.812558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca571fbd-4852-4b7a-ac51-87deaeb6c5f4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:13.902686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:13.911683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 575/1159] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:31:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:31:13.918580 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2524811-e3ef-44e9-9b59-4f888eba5750 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:13.979318 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:14.017698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2524811-e3ef-44e9-9b59-4f888eba5750 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:14.051648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2e7c28-0385-4a17-bb86-c61199dea0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:14.052517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e7c28-0385-4a17-bb86-c61199dea0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:14.052795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e7c28-0385-4a17-bb86-c61199dea0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:14.053247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2e7c28-0385-4a17-bb86-c61199dea0e7 None admin] PATH_INFO: `/v3/projects/1bf77f811590430a94e4fdcbdb85adbc` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:14.054440 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e7c28-0385-4a17-bb86-c61199dea0e7 None admin] RBAC: Authorizing `identity:get_project(project_id=1bf77f811590430a94e4fdcbdb85adbc)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:14.055870 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2e7c28-0385-4a17-bb86-c61199dea0e7 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:14.057600 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 585/1160] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:31:13 2022] GET /identity/v3/projects/1bf77f811590430a94e4fdcbdb85adbc => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:14.063866 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca571fbd-4852-4b7a-ac51-87deaeb6c5f4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:14.162312 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca571fbd-4852-4b7a-ac51-87deaeb6c5f4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:14.197473 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ea679-d050-4474-b71e-afd35018d2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:14.198128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ea679-d050-4474-b71e-afd35018d2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:14.198410 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ea679-d050-4474-b71e-afd35018d2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:14.198684 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ea679-d050-4474-b71e-afd35018d2e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:14.199515 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ea679-d050-4474-b71e-afd35018d2e4 None admin] RBAC: Adding query filter params (role.id=c2d5d80485df4730903a874937d68aa3, scope.project.id=1bf77f811590430a94e4fdcbdb85adbc, user.id=2d39e5f0ba9b4786bb0d7c128d8ac6a8) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:14.199831 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ea679-d050-4474-b71e-afd35018d2e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:14.201281 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ea679-d050-4474-b71e-afd35018d2e4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:14.206915 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 576/1161] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:31:14 2022] GET /identity/v3/role_assignments?user.id=2d39e5f0ba9b4786bb0d7c128d8ac6a8&scope.project.id=1bf77f811590430a94e4fdcbdb85adbc&role.id=c2d5d80485df4730903a874937d68aa3 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:16.259541 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157f3c0-8dde-4ceb-b230-7a0416783e98 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:16.260130 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157f3c0-8dde-4ceb-b230-7a0416783e98 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:16.260130 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8157f3c0-8dde-4ceb-b230-7a0416783e98 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:16.261520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 586/1162] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:31:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:31:16.267120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5782d6c-01f4-4bfc-821f-05bb860e22ff None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:16.267592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5782d6c-01f4-4bfc-821f-05bb860e22ff None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:16.267689 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5782d6c-01f4-4bfc-821f-05bb860e22ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:16.284215 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d5782d6c-01f4-4bfc-821f-05bb860e22ff None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:31:16.285459 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d5782d6c-01f4-4bfc-821f-05bb860e22ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:31:16.336147 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:16.354143 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 577/1163] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:31:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:31:16.377150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157f3c0-8dde-4ceb-b230-7a0416783e98 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:16.479184 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8157f3c0-8dde-4ceb-b230-7a0416783e98 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:16.507673 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:16.513549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c24d36-39a2-49b5-abea-34c9f6925799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:16.514199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c24d36-39a2-49b5-abea-34c9f6925799 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:16.514483 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c24d36-39a2-49b5-abea-34c9f6925799 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:16.514759 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c24d36-39a2-49b5-abea-34c9f6925799 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:16.583004 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c24d36-39a2-49b5-abea-34c9f6925799 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:16.585118 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c24d36-39a2-49b5-abea-34c9f6925799 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:16.682350 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 587/1164] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:31:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:31:16.688527 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5782d6c-01f4-4bfc-821f-05bb860e22ff None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:16.792617 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5782d6c-01f4-4bfc-821f-05bb860e22ff None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:16.827045 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b0257-f84b-460d-a250-4c8f1db1f18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:16.827843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b0257-f84b-460d-a250-4c8f1db1f18e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:16.828127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b0257-f84b-460d-a250-4c8f1db1f18e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:16.828405 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b0257-f84b-460d-a250-4c8f1db1f18e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:16.835338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b0257-f84b-460d-a250-4c8f1db1f18e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:16.836871 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b0257-f84b-460d-a250-4c8f1db1f18e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:16.851744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-211b0257-f84b-460d-a250-4c8f1db1f18e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 18 16:31:16.851744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:16.851744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 18 16:31:16.851744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 18 16:31:16.851744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:31:16.851744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:31:16.851744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:31:16.851744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:31:16.851744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 18 16:31:16.851744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:31:16.851744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:31:16.851744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:31:16.851744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:16.851744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:16.851744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:16.851744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:16.851744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:16.852977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:16.852977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:16.852977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:16.852977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:16.852977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:16.852977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:16.852977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:31:16.852977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:31:16.852977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:31:16.852977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:31:16.852977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:16.852977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:16.852977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:16.852977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:16.852977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:16.852977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:16.854072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:16.854072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:16.854072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:16.854072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:16.854072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:16.854072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:16.854072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:16.854072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:16.854072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:16.854072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:16.854072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 18 16:31:16.854072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:31:16.854072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 18 16:31:16.854072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:31:16.854072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 578/1165] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Jul 18 16:31:16 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:16.860006 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c24d36-39a2-49b5-abea-34c9f6925799 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:16.890901 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:16.960062 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c24d36-39a2-49b5-abea-34c9f6925799 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:16.994020 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c094d7-a06b-45c8-961f-c6038963cf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:16.994690 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c094d7-a06b-45c8-961f-c6038963cf5f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:16.994970 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c094d7-a06b-45c8-961f-c6038963cf5f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:16.995247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c094d7-a06b-45c8-961f-c6038963cf5f None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:16.995997 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c094d7-a06b-45c8-961f-c6038963cf5f None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:16.996271 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c094d7-a06b-45c8-961f-c6038963cf5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:16.997671 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c094d7-a06b-45c8-961f-c6038963cf5f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:17.004739 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 588/1166] 10.222.0.76 () {56 vars in 1115 bytes} [Mon Jul 18 16:31:16 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:18.998715 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b2125-f70e-4b2a-a23b-c3aa4c18e1ea None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:18.999273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b2125-f70e-4b2a-a23b-c3aa4c18e1ea None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:18.999273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b2125-f70e-4b2a-a23b-c3aa4c18e1ea None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:19.000644 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 579/1167] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:31:19.006543 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0e7ff-8dd6-4eca-b55a-8d7e12607ccd None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:19.006956 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0e7ff-8dd6-4eca-b55a-8d7e12607ccd None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:19.007102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d0e7ff-8dd6-4eca-b55a-8d7e12607ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:19.024089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-40d0e7ff-8dd6-4eca-b55a-8d7e12607ccd None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:31:19.025309 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-40d0e7ff-8dd6-4eca-b55a-8d7e12607ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:31:19.090250 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 589/1168] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:31:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:31:19.112939 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b2125-f70e-4b2a-a23b-c3aa4c18e1ea None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:19.161274 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:19.216830 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b2125-f70e-4b2a-a23b-c3aa4c18e1ea None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:19.250872 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db8371-9a84-474a-904b-6d9c643be105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:19.251461 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db8371-9a84-474a-904b-6d9c643be105 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:19.251748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db8371-9a84-474a-904b-6d9c643be105 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:19.252026 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db8371-9a84-474a-904b-6d9c643be105 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:19.252790 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db8371-9a84-474a-904b-6d9c643be105 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:19.254204 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2db8371-9a84-474a-904b-6d9c643be105 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:19.354637 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 580/1169] 10.222.0.76 () {60 vars in 1138 bytes} [Mon Jul 18 16:31:19 2022] POST /identity/v3/domains => generated 267 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:31:21.392893 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e09de-490c-4802-99ce-b631447e9cdf None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:21.393451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e09de-490c-4802-99ce-b631447e9cdf None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:21.393570 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5e09de-490c-4802-99ce-b631447e9cdf None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:21.394927 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 590/1170] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:31:21.401234 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fcee6-cdc6-458f-a3fa-5e0c36bd05b2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:21.401725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fcee6-cdc6-458f-a3fa-5e0c36bd05b2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:21.401870 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fcee6-cdc6-458f-a3fa-5e0c36bd05b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:21.419363 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-981fcee6-cdc6-458f-a3fa-5e0c36bd05b2 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:31:21.420604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-981fcee6-cdc6-458f-a3fa-5e0c36bd05b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:31:21.488641 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 581/1171] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:31:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:31:21.512322 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e09de-490c-4802-99ce-b631447e9cdf None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:21.537938 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:21.612936 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5e09de-490c-4802-99ce-b631447e9cdf None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:21.648653 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32f952-2964-4046-bbfc-421e20cad1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:21.649579 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32f952-2964-4046-bbfc-421e20cad1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:21.649875 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32f952-2964-4046-bbfc-421e20cad1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:21.650150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32f952-2964-4046-bbfc-421e20cad1b3 None admin] PATH_INFO: `/v3/domains/f26302d732e349f0b96b0a985405cbe6` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:21.660617 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32f952-2964-4046-bbfc-421e20cad1b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f26302d732e349f0b96b0a985405cbe6)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:21.662190 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32f952-2964-4046-bbfc-421e20cad1b3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:21.663823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 591/1172] 10.222.0.76 () {56 vars in 1183 bytes} [Mon Jul 18 16:31:21 2022] GET /identity/v3/domains/f26302d732e349f0b96b0a985405cbe6 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:21.669893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fcee6-cdc6-458f-a3fa-5e0c36bd05b2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:21.704906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:21.769523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fcee6-cdc6-458f-a3fa-5e0c36bd05b2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:21.804952 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ad30a-c827-4fb0-8a68-906a9ac6937a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:21.805649 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ad30a-c827-4fb0-8a68-906a9ac6937a None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:21.805936 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ad30a-c827-4fb0-8a68-906a9ac6937a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:21.806213 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ad30a-c827-4fb0-8a68-906a9ac6937a None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:21.806960 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ad30a-c827-4fb0-8a68-906a9ac6937a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:21.808528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ad30a-c827-4fb0-8a68-906a9ac6937a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:21.908399 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 582/1173] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 16:31:21 2022] POST /identity/v3/projects => generated 361 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:31:23.943257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18f250-ace6-4988-a72b-7b62fe51d0d6 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:23.943791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18f250-ace6-4988-a72b-7b62fe51d0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:23.943917 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18f250-ace6-4988-a72b-7b62fe51d0d6 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:23.945291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 592/1174] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:31:23.950795 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc840ab-34c6-477c-af70-65000c399681 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:23.951197 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc840ab-34c6-477c-af70-65000c399681 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:23.951358 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc840ab-34c6-477c-af70-65000c399681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:23.968530 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-afc840ab-34c6-477c-af70-65000c399681 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:31:23.969750 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-afc840ab-34c6-477c-af70-65000c399681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:31:24.035157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 583/1175] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:31:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:31:24.059987 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18f250-ace6-4988-a72b-7b62fe51d0d6 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:24.144242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:24.161503 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18f250-ace6-4988-a72b-7b62fe51d0d6 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:24.197352 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71045142-ae70-4e80-b3e4-3ff2cf6be8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:24.198159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71045142-ae70-4e80-b3e4-3ff2cf6be8ea None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:24.198447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71045142-ae70-4e80-b3e4-3ff2cf6be8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:24.198728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71045142-ae70-4e80-b3e4-3ff2cf6be8ea None admin] PATH_INFO: `/v3/domains/f26302d732e349f0b96b0a985405cbe6` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:24.199919 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71045142-ae70-4e80-b3e4-3ff2cf6be8ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=f26302d732e349f0b96b0a985405cbe6)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:24.201384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71045142-ae70-4e80-b3e4-3ff2cf6be8ea None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:24.203030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 593/1176] 10.222.0.76 () {56 vars in 1183 bytes} [Mon Jul 18 16:31:24 2022] GET /identity/v3/domains/f26302d732e349f0b96b0a985405cbe6 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:24.210023 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc840ab-34c6-477c-af70-65000c399681 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:24.228410 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:24.312601 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc840ab-34c6-477c-af70-65000c399681 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:24.347623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3300e-63ce-4723-9e38-663ed6559a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:24.348296 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3300e-63ce-4723-9e38-663ed6559a5d None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:24.348586 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3300e-63ce-4723-9e38-663ed6559a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:24.348867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3300e-63ce-4723-9e38-663ed6559a5d None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:24.349689 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3300e-63ce-4723-9e38-663ed6559a5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:24.351205 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3300e-63ce-4723-9e38-663ed6559a5d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:24.455150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 584/1177] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 16:31:24 2022] POST /identity/v3/users => generated 311 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:31:26.519112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e8e65-63f8-4189-b332-3003265f9258 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:26.519656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e8e65-63f8-4189-b332-3003265f9258 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:26.519656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e8e65-63f8-4189-b332-3003265f9258 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:26.521066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 594/1178] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:31:26.526460 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e4107-0666-48ce-98c1-b5e392e344df None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:26.526902 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e4107-0666-48ce-98c1-b5e392e344df None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:26.527009 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e4107-0666-48ce-98c1-b5e392e344df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:26.544830 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-7e5e4107-0666-48ce-98c1-b5e392e344df None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:31:26.546059 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7e5e4107-0666-48ce-98c1-b5e392e344df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:31:26.614378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 585/1179] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:31:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:31:26.637755 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e8e65-63f8-4189-b332-3003265f9258 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:26.741880 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e8e65-63f8-4189-b332-3003265f9258 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:26.778241 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7118f-ae2f-4c99-9da8-2d4d1b6486b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:26.778957 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7118f-ae2f-4c99-9da8-2d4d1b6486b6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:26.779316 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7118f-ae2f-4c99-9da8-2d4d1b6486b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:26.779593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7118f-ae2f-4c99-9da8-2d4d1b6486b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:26.790639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7118f-ae2f-4c99-9da8-2d4d1b6486b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:31:26.798210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-b0e7118f-ae2f-4c99-9da8-2d4d1b6486b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:31:26.798210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:26.798210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:26.798210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:26.798210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:26.798210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:26.798210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:26.798210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:26.798210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:26.798210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:26.798210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:26.798210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:26.798210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:31:26.798210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:31:26.798210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:31:26.798210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:31:26.799426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:31:26.799426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:31:26.799426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:31:26.799426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:31:26.799426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:26.799426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:26.799426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:26.799426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:26.799426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:26.799426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:26.799426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:26.799426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:26.799426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:26.799426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:26.799426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:26.799426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:26.800616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:26.800616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:26.800616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:26.800616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:26.800616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:31:26.800616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:31:26.800616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:31:26.800616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:31:26.800616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:31:26.800616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:31:26.800616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:31:26.800616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:31:26.800616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 595/1180] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:31:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:26.806232 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e4107-0666-48ce-98c1-b5e392e344df None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:26.809347 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:26.904280 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5e4107-0666-48ce-98c1-b5e392e344df None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:26.938129 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1341d8-3d07-4bf8-84d6-49a8b4ac162a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:26.938799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1341d8-3d07-4bf8-84d6-49a8b4ac162a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:26.939085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1341d8-3d07-4bf8-84d6-49a8b4ac162a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:26.939363 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1341d8-3d07-4bf8-84d6-49a8b4ac162a None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:26.940110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1341d8-3d07-4bf8-84d6-49a8b4ac162a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:26.940420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1341d8-3d07-4bf8-84d6-49a8b4ac162a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:26.941866 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1341d8-3d07-4bf8-84d6-49a8b4ac162a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:26.950430 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 586/1181] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:31:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:26.957128 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7118f-ae2f-4c99-9da8-2d4d1b6486b6 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:26.972763 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:27.058179 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7118f-ae2f-4c99-9da8-2d4d1b6486b6 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:27.091654 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cfd81-8d49-4f03-b32b-6c552b5b4077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:27.092526 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cfd81-8d49-4f03-b32b-6c552b5b4077 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:27.092809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cfd81-8d49-4f03-b32b-6c552b5b4077 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:27.093114 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61cfd81-8d49-4f03-b32b-6c552b5b4077 None admin] PATH_INFO: `/v3/users/0249b3d5b6824f04b3070461a171d64c` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:27.106553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61cfd81-8d49-4f03-b32b-6c552b5b4077 None admin] RBAC: Authorizing `identity:get_user(user_id=0249b3d5b6824f04b3070461a171d64c)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:27.107989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61cfd81-8d49-4f03-b32b-6c552b5b4077 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:27.109684 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 596/1182] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:31:26 2022] GET /identity/v3/users/0249b3d5b6824f04b3070461a171d64c => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:27.115505 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1341d8-3d07-4bf8-84d6-49a8b4ac162a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:27.182834 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:27.217641 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1341d8-3d07-4bf8-84d6-49a8b4ac162a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:27.250687 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46732f-f2ae-4a4a-bc6c-317209f4f199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:27.251339 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46732f-f2ae-4a4a-bc6c-317209f4f199 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:27.251621 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46732f-f2ae-4a4a-bc6c-317209f4f199 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:27.251896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46732f-f2ae-4a4a-bc6c-317209f4f199 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:27.319970 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46732f-f2ae-4a4a-bc6c-317209f4f199 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:27.321361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46732f-f2ae-4a4a-bc6c-317209f4f199 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:27.384651 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:27.418905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 587/1183] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:31:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:31:27.424885 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cfd81-8d49-4f03-b32b-6c552b5b4077 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:27.498562 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:27.533947 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61cfd81-8d49-4f03-b32b-6c552b5b4077 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:27.569528 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f233c363-2804-460e-9565-fdc247fcadca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:27.570438 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233c363-2804-460e-9565-fdc247fcadca None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:27.570670 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233c363-2804-460e-9565-fdc247fcadca None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:27.570945 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f233c363-2804-460e-9565-fdc247fcadca None admin] PATH_INFO: `/v3/projects/6bdcc6a821df4a6f97f674d0f08f9133` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:27.572109 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233c363-2804-460e-9565-fdc247fcadca None admin] RBAC: Authorizing `identity:get_project(project_id=6bdcc6a821df4a6f97f674d0f08f9133)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:27.573619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f233c363-2804-460e-9565-fdc247fcadca None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:27.575301 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 597/1184] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:31:27 2022] GET /identity/v3/projects/6bdcc6a821df4a6f97f674d0f08f9133 => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:27.581430 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46732f-f2ae-4a4a-bc6c-317209f4f199 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:27.678824 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46732f-f2ae-4a4a-bc6c-317209f4f199 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:27.712170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f15af-d3c7-4bb2-80d5-d6ed2be63734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:27.712817 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f15af-d3c7-4bb2-80d5-d6ed2be63734 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:27.713133 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f15af-d3c7-4bb2-80d5-d6ed2be63734 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:27.713416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f15af-d3c7-4bb2-80d5-d6ed2be63734 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:27.714243 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f15af-d3c7-4bb2-80d5-d6ed2be63734 None admin] RBAC: Adding query filter params (role.id=c2d5d80485df4730903a874937d68aa3, scope.project.id=6bdcc6a821df4a6f97f674d0f08f9133, user.id=0249b3d5b6824f04b3070461a171d64c) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:27.714554 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f15af-d3c7-4bb2-80d5-d6ed2be63734 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:27.715978 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f15af-d3c7-4bb2-80d5-d6ed2be63734 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:27.721335 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 588/1185] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:31:27 2022] GET /identity/v3/role_assignments?user.id=0249b3d5b6824f04b3070461a171d64c&scope.project.id=6bdcc6a821df4a6f97f674d0f08f9133&role.id=c2d5d80485df4730903a874937d68aa3 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:31:29.735564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad14be1-6777-47f9-9d7c-86a012e7e047 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:29.736096 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad14be1-6777-47f9-9d7c-86a012e7e047 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:29.736185 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad14be1-6777-47f9-9d7c-86a012e7e047 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:29.737553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 598/1186] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:31:29.743229 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc657a96-cfd5-4187-aac2-96017c89693d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:29.743607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc657a96-cfd5-4187-aac2-96017c89693d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:29.743796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc657a96-cfd5-4187-aac2-96017c89693d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:29.760861 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-bc657a96-cfd5-4187-aac2-96017c89693d None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:31:29.762077 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bc657a96-cfd5-4187-aac2-96017c89693d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:31:29.786137 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:29.829639 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 589/1187] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:31:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:31:29.852741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad14be1-6777-47f9-9d7c-86a012e7e047 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:29.955038 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad14be1-6777-47f9-9d7c-86a012e7e047 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:29.988255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80c762-2e1e-41e6-9fac-a1a44db79545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:29.988980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80c762-2e1e-41e6-9fac-a1a44db79545 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:29.989296 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80c762-2e1e-41e6-9fac-a1a44db79545 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:29.990112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c80c762-2e1e-41e6-9fac-a1a44db79545 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:29.998003 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:30.001774 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c80c762-2e1e-41e6-9fac-a1a44db79545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:31:30.010429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-4c80c762-2e1e-41e6-9fac-a1a44db79545 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:31:30.010429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:30.010429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:30.010429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:30.010429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:30.010429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:30.010429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:30.010429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:30.010429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:30.010429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:30.010429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:30.010429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:30.010429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:31:30.010429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:31:30.010429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:31:30.010429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:31:30.011533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:31:30.011533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:31:30.011533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:31:30.011533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:31:30.011533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:30.011533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:30.011533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:30.011533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:30.011533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:30.011533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:30.011533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:30.011533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:30.011533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:30.011533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:30.011533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:30.011533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:30.012902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:30.012902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:30.012902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:30.012902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:30.012902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:31:30.012902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:31:30.012902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:31:30.012902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:31:30.012902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:31:30.012902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:31:30.012902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:31:30.012902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:31:30.012902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 599/1188] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:31:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:31:30.019642 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc657a96-cfd5-4187-aac2-96017c89693d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:30.119681 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc657a96-cfd5-4187-aac2-96017c89693d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:30.153554 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93611801-7ecd-49d5-9ae8-18e0361a35ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:30.154231 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93611801-7ecd-49d5-9ae8-18e0361a35ef None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:30.154516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93611801-7ecd-49d5-9ae8-18e0361a35ef None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:30.154794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93611801-7ecd-49d5-9ae8-18e0361a35ef None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:30.155545 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93611801-7ecd-49d5-9ae8-18e0361a35ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:30.155852 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93611801-7ecd-49d5-9ae8-18e0361a35ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:30.157251 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93611801-7ecd-49d5-9ae8-18e0361a35ef None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:30.165654 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 590/1189] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:31:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:30.172110 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80c762-2e1e-41e6-9fac-a1a44db79545 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:30.272447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c80c762-2e1e-41e6-9fac-a1a44db79545 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:30.308006 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae9f1d-aeeb-4b5a-9f80-b0352069a4f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:30.308884 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae9f1d-aeeb-4b5a-9f80-b0352069a4f8 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:30.309202 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae9f1d-aeeb-4b5a-9f80-b0352069a4f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:30.309483 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae9f1d-aeeb-4b5a-9f80-b0352069a4f8 None admin] PATH_INFO: `/v3/users/0249b3d5b6824f04b3070461a171d64c` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:30.310681 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae9f1d-aeeb-4b5a-9f80-b0352069a4f8 None admin] RBAC: Authorizing `identity:get_user(user_id=0249b3d5b6824f04b3070461a171d64c)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:30.312104 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ae9f1d-aeeb-4b5a-9f80-b0352069a4f8 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:30.313779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 600/1190] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:31:30 2022] GET /identity/v3/users/0249b3d5b6824f04b3070461a171d64c => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:30.319879 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93611801-7ecd-49d5-9ae8-18e0361a35ef None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:30.344414 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:30.420546 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93611801-7ecd-49d5-9ae8-18e0361a35ef None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:30.459760 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7a36b6-9b59-4877-bb28-2b9990dbbe17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:30.460627 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a36b6-9b59-4877-bb28-2b9990dbbe17 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:30.460911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a36b6-9b59-4877-bb28-2b9990dbbe17 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:30.461222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7a36b6-9b59-4877-bb28-2b9990dbbe17 None admin] PATH_INFO: `/v3/projects/6bdcc6a821df4a6f97f674d0f08f9133` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:30.462406 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a36b6-9b59-4877-bb28-2b9990dbbe17 None admin] RBAC: Authorizing `identity:get_project(project_id=6bdcc6a821df4a6f97f674d0f08f9133)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:30.463850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7a36b6-9b59-4877-bb28-2b9990dbbe17 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:30.465588 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 591/1191] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:31:30 2022] GET /identity/v3/projects/6bdcc6a821df4a6f97f674d0f08f9133 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:30.471964 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae9f1d-aeeb-4b5a-9f80-b0352069a4f8 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:30.537639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:30.572978 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae9f1d-aeeb-4b5a-9f80-b0352069a4f8 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:30.607716 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a1e090-67a6-4cc7-895b-aa35584173f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:30.608599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1e090-67a6-4cc7-895b-aa35584173f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:30.608879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1e090-67a6-4cc7-895b-aa35584173f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:30.609186 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a1e090-67a6-4cc7-895b-aa35584173f2 None admin] PATH_INFO: `/v3/projects/6bdcc6a821df4a6f97f674d0f08f9133/users/0249b3d5b6824f04b3070461a171d64c/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:30.611106 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1e090-67a6-4cc7-895b-aa35584173f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=6bdcc6a821df4a6f97f674d0f08f9133, user_id=0249b3d5b6824f04b3070461a171d64c, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:30.612525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a1e090-67a6-4cc7-895b-aa35584173f2 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:30.752303 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 601/1192] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:31:30 2022] PUT /identity/v3/projects/6bdcc6a821df4a6f97f674d0f08f9133/users/0249b3d5b6824f04b3070461a171d64c/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:31:32.780359 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362ae66-82fd-4cc8-a408-db4824ec6cb4 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:32.780932 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362ae66-82fd-4cc8-a408-db4824ec6cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:32.780932 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362ae66-82fd-4cc8-a408-db4824ec6cb4 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:32.782326 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 592/1193] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:31:32.787898 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c79c26-29a3-4869-977d-528df423e468 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:32.788288 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c79c26-29a3-4869-977d-528df423e468 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:32.788479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c79c26-29a3-4869-977d-528df423e468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:32.804954 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-31c79c26-29a3-4869-977d-528df423e468 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:31:32.806159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-31c79c26-29a3-4869-977d-528df423e468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:31:32.873172 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 602/1194] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:31:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:31:32.896918 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362ae66-82fd-4cc8-a408-db4824ec6cb4 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:32.987365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:32.998815 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362ae66-82fd-4cc8-a408-db4824ec6cb4 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:33.032534 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8d1dd-f5b2-4fa6-8709-4204d762b017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:33.033284 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8d1dd-f5b2-4fa6-8709-4204d762b017 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:33.033569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8d1dd-f5b2-4fa6-8709-4204d762b017 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:33.033844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8d1dd-f5b2-4fa6-8709-4204d762b017 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:33.043963 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8d1dd-f5b2-4fa6-8709-4204d762b017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:31:33.051539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-9cc8d1dd-f5b2-4fa6-8709-4204d762b017 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:31:33.051539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:31:33.051539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:31:33.051539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:31:33.051539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:31:33.051539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:31:33.051539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:31:33.051539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:31:33.051539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:31:33.051539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:31:33.051539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:31:33.051539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:31:33.051539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:31:33.051539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:31:33.051539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:31:33.051539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:31:33.053334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:31:33.053334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:31:33.053334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:31:33.053334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:31:33.053334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:31:33.053334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:31:33.053334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:31:33.053334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:31:33.053334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:31:33.053334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:31:33.053334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:31:33.053334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:31:33.053334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:31:33.053334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:31:33.053334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:31:33.053334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:31:33.054340 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:31:33.054340 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:31:33.054340 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:31:33.054340 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:31:33.054340 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:31:33.054340 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:31:33.054340 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:31:33.054340 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:31:33.054340 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:31:33.054340 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:31:33.054340 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:31:33.054340 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:31:33.054340 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 593/1195] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:31:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:31:33.059957 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c79c26-29a3-4869-977d-528df423e468 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:33.114786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:33.158181 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c79c26-29a3-4869-977d-528df423e468 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:33.194678 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7551402-5326-42ab-9485-bebc2ae57ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:33.195374 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7551402-5326-42ab-9485-bebc2ae57ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:33.195675 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7551402-5326-42ab-9485-bebc2ae57ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:33.195951 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7551402-5326-42ab-9485-bebc2ae57ed8 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:33.196692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7551402-5326-42ab-9485-bebc2ae57ed8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:33.196994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7551402-5326-42ab-9485-bebc2ae57ed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:33.198458 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7551402-5326-42ab-9485-bebc2ae57ed8 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:33.206503 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 603/1196] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:31:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:33.212832 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8d1dd-f5b2-4fa6-8709-4204d762b017 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:33.311767 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8d1dd-f5b2-4fa6-8709-4204d762b017 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:33.344006 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838cb5e2-905c-42f1-8601-5cec8921809e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:33.344864 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cb5e2-905c-42f1-8601-5cec8921809e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:33.345370 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cb5e2-905c-42f1-8601-5cec8921809e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:33.345680 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cb5e2-905c-42f1-8601-5cec8921809e None admin] PATH_INFO: `/v3/users/0249b3d5b6824f04b3070461a171d64c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:33.346630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838cb5e2-905c-42f1-8601-5cec8921809e None admin] RBAC: Authorizing `identity:get_user(user_id=0249b3d5b6824f04b3070461a171d64c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:33.348068 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838cb5e2-905c-42f1-8601-5cec8921809e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:33.350256 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 594/1197] 10.222.0.76 () {56 vars in 1177 bytes} [Mon Jul 18 16:31:33 2022] GET /identity/v3/users/0249b3d5b6824f04b3070461a171d64c => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:33.356229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7551402-5326-42ab-9485-bebc2ae57ed8 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:33.459401 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7551402-5326-42ab-9485-bebc2ae57ed8 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:33.476354 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:33.493574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b18a33-9674-4e42-a6eb-7a65bfe17dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:33.494227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b18a33-9674-4e42-a6eb-7a65bfe17dcc None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:33.494511 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b18a33-9674-4e42-a6eb-7a65bfe17dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:33.494788 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b18a33-9674-4e42-a6eb-7a65bfe17dcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:33.562348 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b18a33-9674-4e42-a6eb-7a65bfe17dcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:33.563713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b18a33-9674-4e42-a6eb-7a65bfe17dcc None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:33.664640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 604/1198] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:31:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 16:31:33.670691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838cb5e2-905c-42f1-8601-5cec8921809e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:33.690885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:33.776195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838cb5e2-905c-42f1-8601-5cec8921809e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:33.811086 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f27ed5-9e79-4a65-84ce-e9a47e9d112b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:33.811938 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f27ed5-9e79-4a65-84ce-e9a47e9d112b None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:33.812222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f27ed5-9e79-4a65-84ce-e9a47e9d112b None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:33.812551 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f27ed5-9e79-4a65-84ce-e9a47e9d112b None admin] PATH_INFO: `/v3/projects/6bdcc6a821df4a6f97f674d0f08f9133` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:33.813682 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f27ed5-9e79-4a65-84ce-e9a47e9d112b None admin] RBAC: Authorizing `identity:get_project(project_id=6bdcc6a821df4a6f97f674d0f08f9133)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:33.815112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f27ed5-9e79-4a65-84ce-e9a47e9d112b None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:33.816790 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 595/1199] 10.222.0.76 () {56 vars in 1186 bytes} [Mon Jul 18 16:31:33 2022] GET /identity/v3/projects/6bdcc6a821df4a6f97f674d0f08f9133 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:33.823899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b18a33-9674-4e42-a6eb-7a65bfe17dcc None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:31:33.842359 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:33.922332 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b18a33-9674-4e42-a6eb-7a65bfe17dcc None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:31:33.957426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cbca82-4869-457f-90c5-7e730a451b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:31:33.958528 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbca82-4869-457f-90c5-7e730a451b51 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:31:33.958528 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbca82-4869-457f-90c5-7e730a451b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:31:33.958753 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cbca82-4869-457f-90c5-7e730a451b51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:31:33.959581 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbca82-4869-457f-90c5-7e730a451b51 None admin] RBAC: Adding query filter params (role.id=c2d5d80485df4730903a874937d68aa3, scope.project.id=6bdcc6a821df4a6f97f674d0f08f9133, user.id=0249b3d5b6824f04b3070461a171d64c) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:31:33.959895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbca82-4869-457f-90c5-7e730a451b51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:31:33.961441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cbca82-4869-457f-90c5-7e730a451b51 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:31:33.967392 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 605/1200] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:31:33 2022] GET /identity/v3/role_assignments?user.id=0249b3d5b6824f04b3070461a171d64c&scope.project.id=6bdcc6a821df4a6f97f674d0f08f9133&role.id=c2d5d80485df4730903a874937d68aa3 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:31:43.806958 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=57 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:31:43.964634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=59 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:32:56.822759 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4a354-a364-4e9f-aef8-d8728906211e None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:32:56.823383 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4a354-a364-4e9f-aef8-d8728906211e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:32:56.823383 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4a354-a364-4e9f-aef8-d8728906211e None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:32:56.824918 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 596/1201] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:32:56.830373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f4ea1-09b6-4e85-bdb9-2d81f906c406 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:32:56.830827 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f4ea1-09b6-4e85-bdb9-2d81f906c406 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:32:56.830929 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f4ea1-09b6-4e85-bdb9-2d81f906c406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:32:56.848464 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e53f4ea1-09b6-4e85-bdb9-2d81f906c406 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:32:56.851652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e53f4ea1-09b6-4e85-bdb9-2d81f906c406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:32:56.920700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 606/1202] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:32:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:32:56.945978 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4a354-a364-4e9f-aef8-d8728906211e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:32:57.050535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4a354-a364-4e9f-aef8-d8728906211e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:32:57.084110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1556c0-42ca-4351-bdf3-b7740a7816d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:32:57.084826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1556c0-42ca-4351-bdf3-b7740a7816d1 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:32:57.085145 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1556c0-42ca-4351-bdf3-b7740a7816d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:32:57.085429 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1556c0-42ca-4351-bdf3-b7740a7816d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:32:57.096947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1556c0-42ca-4351-bdf3-b7740a7816d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:32:57.098819 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1556c0-42ca-4351-bdf3-b7740a7816d1 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:32:57.121188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-6c1556c0-42ca-4351-bdf3-b7740a7816d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:32:57.121188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:32:57.121188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:32:57.121188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:32:57.121188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:32:57.121188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:32:57.121188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:32:57.121188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:32:57.121188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:32:57.121188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:32:57.121188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:32:57.121188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:32:57.121188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:32:57.121188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:32:57.121188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:32:57.122238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:32:57.122238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:32:57.122238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:32:57.122238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:32:57.122238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:32:57.122238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:32:57.122238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:32:57.122238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:32:57.122238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:32:57.122238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:32:57.122238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:32:57.122238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:32:57.122238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:32:57.122238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:32:57.122238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:32:57.122238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:32:57.122238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:32:57.124755 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:32:57.124755 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:32:57.124755 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:32:57.124755 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:32:57.124755 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 597/1203] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:32:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:32:57.128535 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f4ea1-09b6-4e85-bdb9-2d81f906c406 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:32:57.229166 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f4ea1-09b6-4e85-bdb9-2d81f906c406 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:32:57.257749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:32:57.270217 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ceeb01-de11-4cf9-9c61-4b692ae9bbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:32:57.270217 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ceeb01-de11-4cf9-9c61-4b692ae9bbdf None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:32:57.270217 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ceeb01-de11-4cf9-9c61-4b692ae9bbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:32:57.270217 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ceeb01-de11-4cf9-9c61-4b692ae9bbdf None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:32:57.270741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ceeb01-de11-4cf9-9c61-4b692ae9bbdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:32:57.270741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ceeb01-de11-4cf9-9c61-4b692ae9bbdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:32:57.270741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ceeb01-de11-4cf9-9c61-4b692ae9bbdf None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:32:57.279183 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 607/1204] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:32:57.284873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1556c0-42ca-4351-bdf3-b7740a7816d1 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:32:57.339228 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:32:57.384751 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1556c0-42ca-4351-bdf3-b7740a7816d1 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:32:57.421769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b456992-7d62-43f7-882f-5ff707c83ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:32:57.422449 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b456992-7d62-43f7-882f-5ff707c83ab3 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:32:57.422739 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b456992-7d62-43f7-882f-5ff707c83ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:32:57.423024 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b456992-7d62-43f7-882f-5ff707c83ab3 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:32:57.423744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b456992-7d62-43f7-882f-5ff707c83ab3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:32:57.425251 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b456992-7d62-43f7-882f-5ff707c83ab3 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:32:57.707245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 598/1205] 10.222.0.76 () {60 vars in 1132 bytes} [Mon Jul 18 16:32:57 2022] POST /identity/v3/users => generated 251 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:32:59.749165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb272c06-89d8-4c65-b612-36af7d094320 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:32:59.749721 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb272c06-89d8-4c65-b612-36af7d094320 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:32:59.749721 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb272c06-89d8-4c65-b612-36af7d094320 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:32:59.751092 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 608/1206] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:32:59.756498 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74b490-b9bb-4d41-8866-fa16a7b602e3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:32:59.756947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74b490-b9bb-4d41-8866-fa16a7b602e3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:32:59.757085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74b490-b9bb-4d41-8866-fa16a7b602e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:32:59.775659 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1c74b490-b9bb-4d41-8866-fa16a7b602e3 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:32:59.780306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1c74b490-b9bb-4d41-8866-fa16a7b602e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:32:59.845324 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 599/1207] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:32:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:32:59.869944 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb272c06-89d8-4c65-b612-36af7d094320 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:32:59.974910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb272c06-89d8-4c65-b612-36af7d094320 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:00.009799 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7d021-efa9-49e9-a5e3-814afe634847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:00.010520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7d021-efa9-49e9-a5e3-814afe634847 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:00.010800 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7d021-efa9-49e9-a5e3-814afe634847 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:00.011136 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc7d021-efa9-49e9-a5e3-814afe634847 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:00.021706 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc7d021-efa9-49e9-a5e3-814afe634847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:33:00.030373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-2dc7d021-efa9-49e9-a5e3-814afe634847 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:33:00.030373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:00.030373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:00.030373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:00.030373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:00.030373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:00.030373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:00.030373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:00.030373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:00.030373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:00.030373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:00.030373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:00.030373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:33:00.030373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:33:00.030373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:33:00.030373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:33:00.031537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:33:00.031537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:33:00.031537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:33:00.031537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:33:00.031537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:00.031537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:00.031537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:00.031537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:00.031537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:00.031537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:00.031537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:00.031537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:00.031537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:00.031537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:00.031537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:00.031537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:00.032549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:00.032549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:00.032549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:00.032549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:00.032549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:33:00.032549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:33:00.032549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:33:00.032549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:33:00.032549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:33:00.032549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:33:00.032549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:33:00.032549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:00.032549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 609/1208] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:32:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:00.037734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74b490-b9bb-4d41-8866-fa16a7b602e3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:00.077619 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:00.139311 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74b490-b9bb-4d41-8866-fa16a7b602e3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:00.188657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e453b7-4bd7-4952-9aea-f0dee60c9a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:00.189451 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e453b7-4bd7-4952-9aea-f0dee60c9a2e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:00.189746 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e453b7-4bd7-4952-9aea-f0dee60c9a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:00.190028 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e453b7-4bd7-4952-9aea-f0dee60c9a2e None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:00.190804 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e453b7-4bd7-4952-9aea-f0dee60c9a2e None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:00.191097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e453b7-4bd7-4952-9aea-f0dee60c9a2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:00.192497 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e453b7-4bd7-4952-9aea-f0dee60c9a2e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:00.200569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 600/1209] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 16:33:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:00.206447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7d021-efa9-49e9-a5e3-814afe634847 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:00.258119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:00.307627 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc7d021-efa9-49e9-a5e3-814afe634847 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:00.342458 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03a3e5-e62e-4921-b43a-277109a8958d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:00.343269 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03a3e5-e62e-4921-b43a-277109a8958d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:00.343549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03a3e5-e62e-4921-b43a-277109a8958d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:00.343821 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a03a3e5-e62e-4921-b43a-277109a8958d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:00.353805 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03a3e5-e62e-4921-b43a-277109a8958d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:00.356260 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a03a3e5-e62e-4921-b43a-277109a8958d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:00.375328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-7a03a3e5-e62e-4921-b43a-277109a8958d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:00.375328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:00.375328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:00.375328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:00.375328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:00.375328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:00.375328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:00.375328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:00.375328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:00.375328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:00.375328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:00.375328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:00.375328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:33:00.375328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:33:00.375328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:33:00.376428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:33:00.376428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:00.376428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:00.376428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:00.376428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:00.376428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:00.376428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:00.376428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:00.376428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:00.376428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:00.376428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:00.376428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:00.376428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:00.376428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:00.376428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:00.376428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:00.376428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:00.382321 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:33:00.382321 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:33:00.382321 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:00.382321 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:00.382321 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 610/1210] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:33:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:00.382668 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e453b7-4bd7-4952-9aea-f0dee60c9a2e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:00.483629 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e453b7-4bd7-4952-9aea-f0dee60c9a2e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:00.517418 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a433b-323f-47fc-b13b-4cbe35089485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:00.518091 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a433b-323f-47fc-b13b-4cbe35089485 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:00.518375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a433b-323f-47fc-b13b-4cbe35089485 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:00.518654 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0a433b-323f-47fc-b13b-4cbe35089485 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:00.519387 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a433b-323f-47fc-b13b-4cbe35089485 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:00.519694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a433b-323f-47fc-b13b-4cbe35089485 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:00.521116 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0a433b-323f-47fc-b13b-4cbe35089485 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:00.532923 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 601/1211] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:00.538754 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03a3e5-e62e-4921-b43a-277109a8958d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:00.642293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:00.642655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a03a3e5-e62e-4921-b43a-277109a8958d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:00.644330 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:00.677302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cbd72-ed71-4090-a11a-6681672a0346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:00.678145 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cbd72-ed71-4090-a11a-6681672a0346 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:00.678437 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cbd72-ed71-4090-a11a-6681672a0346 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:00.678717 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0cbd72-ed71-4090-a11a-6681672a0346 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:00.686880 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cbd72-ed71-4090-a11a-6681672a0346 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:00.688318 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0cbd72-ed71-4090-a11a-6681672a0346 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:00.704565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-3f0cbd72-ed71-4090-a11a-6681672a0346 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:33:00.704565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:00.704565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:00.704565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:00.704565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:00.704565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:00.704565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:00.704565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:00.704565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:00.704565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:00.704565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:00.704565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:00.704565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:33:00.704565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:33:00.704565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:33:00.704565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:33:00.705612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:00.705612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:00.705612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:33:00.705612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:33:00.705612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:33:00.705612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:33:00.705612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:00.705612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:00.705612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:00.705612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:00.705612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:00.705612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:00.705612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:00.705612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:00.705612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:00.705612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:00.705612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:00.705612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:00.706641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:00.706641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:00.706641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:33:00.706641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:33:00.706641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:33:00.706641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:33:00.706641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:33:00.706641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:33:00.706641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:33:00.706641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:00.706641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 611/1212] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:33:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:00.711654 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a433b-323f-47fc-b13b-4cbe35089485 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:00.812554 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0a433b-323f-47fc-b13b-4cbe35089485 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:00.846156 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34ee4c-8e6e-4381-b587-a56cdf68535c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:00.846820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34ee4c-8e6e-4381-b587-a56cdf68535c None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:00.847108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34ee4c-8e6e-4381-b587-a56cdf68535c None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:00.847386 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34ee4c-8e6e-4381-b587-a56cdf68535c None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:00.848218 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34ee4c-8e6e-4381-b587-a56cdf68535c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:00.848528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34ee4c-8e6e-4381-b587-a56cdf68535c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:00.849990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34ee4c-8e6e-4381-b587-a56cdf68535c None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:00.869556 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 602/1213] 10.222.0.76 () {56 vars in 1143 bytes} [Mon Jul 18 16:33:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:00.875754 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cbd72-ed71-4090-a11a-6681672a0346 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:00.975597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0cbd72-ed71-4090-a11a-6681672a0346 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:01.010033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf50a1a-b093-4e94-b15a-43747ed6971f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:01.010690 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf50a1a-b093-4e94-b15a-43747ed6971f None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:01.011031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf50a1a-b093-4e94-b15a-43747ed6971f None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:01.011456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf50a1a-b093-4e94-b15a-43747ed6971f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:01.045503 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:01.082850 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf50a1a-b093-4e94-b15a-43747ed6971f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:01.084298 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf50a1a-b093-4e94-b15a-43747ed6971f None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:01.181589 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 612/1214] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:33:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:33:01.187970 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34ee4c-8e6e-4381-b587-a56cdf68535c None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:01.207511 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:01.301587 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34ee4c-8e6e-4381-b587-a56cdf68535c None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:01.338984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3dfb2-db58-4952-9e67-9490d78ae421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:01.340530 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3dfb2-db58-4952-9e67-9490d78ae421 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:01.340800 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3dfb2-db58-4952-9e67-9490d78ae421 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:01.341119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa3dfb2-db58-4952-9e67-9490d78ae421 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:01.351962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3dfb2-db58-4952-9e67-9490d78ae421 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:01.353486 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa3dfb2-db58-4952-9e67-9490d78ae421 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:01.378295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-3aa3dfb2-db58-4952-9e67-9490d78ae421 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:01.378295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:01.378295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:01.378295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:01.378295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:01.378295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:01.378295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:01.378295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:01.378295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:01.378295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:01.378295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:01.378295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:01.378295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:33:01.378295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:33:01.378295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:33:01.379490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:33:01.379490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:01.379490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:01.379490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:01.379490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:01.379490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:01.379490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:01.379490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:01.379490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:01.379490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:01.379490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:01.379490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:01.379490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:01.379490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:01.379490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:01.379490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:01.379490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:01.380455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:33:01.380455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:33:01.380455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:01.380455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:33:01.380455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 603/1215] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:33:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:01.385507 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf50a1a-b093-4e94-b15a-43747ed6971f None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:01.452194 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:01.493807 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf50a1a-b093-4e94-b15a-43747ed6971f None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:01.529274 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175d7b2-ed6b-4f68-8040-da47d3718df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:01.529953 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175d7b2-ed6b-4f68-8040-da47d3718df3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:01.530238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175d7b2-ed6b-4f68-8040-da47d3718df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:01.530517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0175d7b2-ed6b-4f68-8040-da47d3718df3 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:01.531249 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175d7b2-ed6b-4f68-8040-da47d3718df3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:01.531559 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175d7b2-ed6b-4f68-8040-da47d3718df3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:01.532934 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0175d7b2-ed6b-4f68-8040-da47d3718df3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:01.546396 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 613/1216] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:01.552186 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3dfb2-db58-4952-9e67-9490d78ae421 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:01.623607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:01.654967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa3dfb2-db58-4952-9e67-9490d78ae421 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:01.689345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550c6d9-5642-4432-93bd-d2e65e06505d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:01.690138 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550c6d9-5642-4432-93bd-d2e65e06505d None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:01.690424 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550c6d9-5642-4432-93bd-d2e65e06505d None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:01.690702 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1550c6d9-5642-4432-93bd-d2e65e06505d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:01.697564 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1550c6d9-5642-4432-93bd-d2e65e06505d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:01.699050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1550c6d9-5642-4432-93bd-d2e65e06505d None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:01.712567 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-1550c6d9-5642-4432-93bd-d2e65e06505d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:33:01.712567 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:01.712567 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:01.712567 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:01.712567 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:01.712567 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:01.712567 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:01.712567 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:01.712567 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:01.712567 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:01.712567 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:01.712567 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:01.712567 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:33:01.712567 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:33:01.712567 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:33:01.714691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:33:01.714691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:01.714691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:01.714691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:01.714691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:01.714691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:01.714691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:01.714691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:01.714691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:01.714691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:01.714691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:01.714691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:01.714691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:01.714691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:01.714691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:01.714691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:01.714691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:01.715749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:33:01.715749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:33:01.715749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:33:01.715749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:33:01.715749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:33:01.715749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:33:01.715749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:33:01.715749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:33:01.715749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 604/1217] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:33:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:01.720234 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175d7b2-ed6b-4f68-8040-da47d3718df3 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:01.820921 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0175d7b2-ed6b-4f68-8040-da47d3718df3 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:01.843850 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:01.855057 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d829c-a580-4502-a5da-5563ee1df677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:01.861551 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d829c-a580-4502-a5da-5563ee1df677 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:01.861551 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d829c-a580-4502-a5da-5563ee1df677 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:01.861551 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d829c-a580-4502-a5da-5563ee1df677 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:01.861551 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d829c-a580-4502-a5da-5563ee1df677 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:01.861551 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d829c-a580-4502-a5da-5563ee1df677 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:01.861551 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d829c-a580-4502-a5da-5563ee1df677 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:01.870879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 614/1218] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:33:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:01.877067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550c6d9-5642-4432-93bd-d2e65e06505d None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:01.978131 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1550c6d9-5642-4432-93bd-d2e65e06505d None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:02.005940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:02.012846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7e39a3-ca85-4d74-8664-266871efb1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:02.013545 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e39a3-ca85-4d74-8664-266871efb1bf None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:02.013831 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e39a3-ca85-4d74-8664-266871efb1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:02.014356 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7e39a3-ca85-4d74-8664-266871efb1bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:02.014943 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e39a3-ca85-4d74-8664-266871efb1bf None admin] RBAC: Adding query filter params (role.id=ce6bff4fd8b6468b94dc4af858dde77b, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=9c8d6afb4ccd41a5972e3241a3eebc7e) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:02.015256 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e39a3-ca85-4d74-8664-266871efb1bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:02.016707 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7e39a3-ca85-4d74-8664-266871efb1bf None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:02.022428 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 605/1219] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:33:01 2022] GET /identity/v3/role_assignments?user.id=9c8d6afb4ccd41a5972e3241a3eebc7e&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=ce6bff4fd8b6468b94dc4af858dde77b => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:04.075268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e54dc7-1efd-4d84-9521-2c869608912e None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:04.075819 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e54dc7-1efd-4d84-9521-2c869608912e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:04.075819 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e54dc7-1efd-4d84-9521-2c869608912e None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:04.077286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 615/1220] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:33:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:33:04.083222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da48ff-5653-4709-84dc-8db32b8e0b83 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:04.083721 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da48ff-5653-4709-84dc-8db32b8e0b83 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:04.083814 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da48ff-5653-4709-84dc-8db32b8e0b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:04.101814 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-13da48ff-5653-4709-84dc-8db32b8e0b83 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:33:04.103125 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-13da48ff-5653-4709-84dc-8db32b8e0b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:33:04.182874 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 606/1221] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:33:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:33:04.205830 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e54dc7-1efd-4d84-9521-2c869608912e None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:04.315205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e54dc7-1efd-4d84-9521-2c869608912e None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:04.352672 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccf10b-b8b2-4eec-a265-21a0289295a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:04.353428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccf10b-b8b2-4eec-a265-21a0289295a2 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:04.353726 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccf10b-b8b2-4eec-a265-21a0289295a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:04.353986 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ccf10b-b8b2-4eec-a265-21a0289295a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:04.365236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ccf10b-b8b2-4eec-a265-21a0289295a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:33:04.373283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-f8ccf10b-b8b2-4eec-a265-21a0289295a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:33:04.373283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:04.373283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:04.373283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:04.373283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:04.373283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:04.373283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:04.373283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:04.373283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:04.373283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:04.373283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:04.373283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:04.373283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:33:04.373283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:33:04.373283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:33:04.373283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:33:04.374538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:33:04.374538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:33:04.374538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:33:04.374538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:33:04.374538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:04.374538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:04.374538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:04.374538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:04.374538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:04.374538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:04.374538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:04.374538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:04.374538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:04.374538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:04.374538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:04.374538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:04.375593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:04.375593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:04.375593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:04.375593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:04.375593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:33:04.375593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:33:04.375593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:33:04.375593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:33:04.375593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:33:04.375593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:33:04.375593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:33:04.375593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:04.375593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 616/1222] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:33:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:04.380773 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da48ff-5653-4709-84dc-8db32b8e0b83 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:04.486645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da48ff-5653-4709-84dc-8db32b8e0b83 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:04.511027 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:04.522442 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf488db-8e14-4ece-9124-e39a463dd56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:04.523123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf488db-8e14-4ece-9124-e39a463dd56a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:04.523406 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf488db-8e14-4ece-9124-e39a463dd56a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:04.523682 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf488db-8e14-4ece-9124-e39a463dd56a None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:04.524435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf488db-8e14-4ece-9124-e39a463dd56a None admin] RBAC: Adding query filter params (name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:04.524741 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf488db-8e14-4ece-9124-e39a463dd56a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:04.526154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf488db-8e14-4ece-9124-e39a463dd56a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:04.535448 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 607/1223] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 16:33:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:04.541333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccf10b-b8b2-4eec-a265-21a0289295a2 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:04.588499 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:04.652696 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ccf10b-b8b2-4eec-a265-21a0289295a2 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:04.687367 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85411ed6-ed4a-43c7-b667-83a7973e43da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:04.688179 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85411ed6-ed4a-43c7-b667-83a7973e43da None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:04.688463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85411ed6-ed4a-43c7-b667-83a7973e43da None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:04.688746 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85411ed6-ed4a-43c7-b667-83a7973e43da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:04.700723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85411ed6-ed4a-43c7-b667-83a7973e43da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:04.702229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85411ed6-ed4a-43c7-b667-83a7973e43da None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:04.719874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-85411ed6-ed4a-43c7-b667-83a7973e43da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:04.719874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:04.719874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:04.719874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:04.719874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:04.719874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:04.719874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:04.719874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:04.719874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:04.719874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:04.719874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:04.719874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:04.719874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:33:04.719874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:33:04.719874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:33:04.721646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:33:04.721646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:04.721646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:04.721646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:04.721646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:04.721646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:04.721646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:04.721646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:04.721646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:04.721646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:04.721646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:04.721646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:04.721646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:04.721646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:04.721646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:04.721646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:04.721646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:04.724122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:33:04.724122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:33:04.724122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:04.724122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:04.724122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 617/1224] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:33:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:04.728914 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf488db-8e14-4ece-9124-e39a463dd56a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:04.836154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf488db-8e14-4ece-9124-e39a463dd56a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:04.875052 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fbeaf-86a4-4db1-9f6d-392c70ad7c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:04.875734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fbeaf-86a4-4db1-9f6d-392c70ad7c86 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:04.880623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fbeaf-86a4-4db1-9f6d-392c70ad7c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:04.880623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fbeaf-86a4-4db1-9f6d-392c70ad7c86 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:04.880623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8fbeaf-86a4-4db1-9f6d-392c70ad7c86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:04.880623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8fbeaf-86a4-4db1-9f6d-392c70ad7c86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:04.880623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8fbeaf-86a4-4db1-9f6d-392c70ad7c86 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:04.891677 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 608/1225] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:04.897899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85411ed6-ed4a-43c7-b667-83a7973e43da None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:05.001779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:05.008546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85411ed6-ed4a-43c7-b667-83a7973e43da None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:05.042980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd381468-be56-4fb7-9c21-9b8b444fd163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:05.043796 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd381468-be56-4fb7-9c21-9b8b444fd163 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:05.044086 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd381468-be56-4fb7-9c21-9b8b444fd163 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:05.044368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd381468-be56-4fb7-9c21-9b8b444fd163 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:05.052321 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd381468-be56-4fb7-9c21-9b8b444fd163 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:05.053760 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd381468-be56-4fb7-9c21-9b8b444fd163 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:05.069488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-cd381468-be56-4fb7-9c21-9b8b444fd163 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:33:05.069488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:05.069488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:05.069488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:05.069488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:05.069488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:05.069488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:05.069488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:05.069488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:05.069488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:05.069488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:05.069488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:05.069488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:33:05.069488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:33:05.069488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:33:05.069488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:33:05.071282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:05.071282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:05.071282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:33:05.071282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:33:05.071282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:33:05.071282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:33:05.071282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:05.071282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:05.071282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:05.071282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:05.071282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:05.071282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:05.071282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:05.071282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:05.071282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:05.071282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:05.071282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:05.071282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:05.072662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:05.072662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:05.072662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:33:05.072662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:33:05.072662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:33:05.072662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:33:05.072662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:33:05.072662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:33:05.072662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:33:05.072662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:05.072662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 618/1226] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:33:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:05.077904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fbeaf-86a4-4db1-9f6d-392c70ad7c86 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:05.130510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:05.193659 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fbeaf-86a4-4db1-9f6d-392c70ad7c86 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:05.244339 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2acbfa-c6f4-45ae-9318-a508b11fdcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:05.245072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2acbfa-c6f4-45ae-9318-a508b11fdcc8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:05.245876 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2acbfa-c6f4-45ae-9318-a508b11fdcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:05.246149 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2acbfa-c6f4-45ae-9318-a508b11fdcc8 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:05.247086 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2acbfa-c6f4-45ae-9318-a508b11fdcc8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:05.247393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2acbfa-c6f4-45ae-9318-a508b11fdcc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:05.248820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2acbfa-c6f4-45ae-9318-a508b11fdcc8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:05.267295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 609/1227] 10.222.0.76 () {56 vars in 1143 bytes} [Mon Jul 18 16:33:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:05.273474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd381468-be56-4fb7-9c21-9b8b444fd163 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:05.382321 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd381468-be56-4fb7-9c21-9b8b444fd163 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:05.425282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3395a-0ae3-49ab-b027-7a8e58dae3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:05.426129 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3395a-0ae3-49ab-b027-7a8e58dae3cf None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:05.426423 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3395a-0ae3-49ab-b027-7a8e58dae3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:05.426709 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b3395a-0ae3-49ab-b027-7a8e58dae3cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:05.439858 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3395a-0ae3-49ab-b027-7a8e58dae3cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:05.442183 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b3395a-0ae3-49ab-b027-7a8e58dae3cf None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:05.464451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-b9b3395a-0ae3-49ab-b027-7a8e58dae3cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:05.464451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:05.464451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:05.464451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:05.464451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:05.464451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:05.464451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:05.464451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:05.464451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:05.464451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:05.464451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:05.464451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:05.464451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:33:05.464451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:33:05.464451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:33:05.466281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:33:05.466281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:05.466281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:05.466281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:05.466281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:05.466281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:05.466281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:05.466281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:05.466281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:05.466281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:05.466281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:05.466281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:05.466281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:05.466281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:05.466281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:05.466281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:05.466281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:05.467979 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:33:05.467979 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:33:05.467979 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:05.467979 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:05.467979 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 619/1228] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:33:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:05.472234 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2acbfa-c6f4-45ae-9318-a508b11fdcc8 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:05.580741 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2acbfa-c6f4-45ae-9318-a508b11fdcc8 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:05.583274 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:05.616739 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548018a2-805f-4491-bac8-1107f655c8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:05.617453 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548018a2-805f-4491-bac8-1107f655c8ee None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:05.617771 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548018a2-805f-4491-bac8-1107f655c8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:05.618048 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548018a2-805f-4491-bac8-1107f655c8ee None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:05.618820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548018a2-805f-4491-bac8-1107f655c8ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:05.619133 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548018a2-805f-4491-bac8-1107f655c8ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:05.621165 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548018a2-805f-4491-bac8-1107f655c8ee None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:05.634402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 610/1229] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:05.641615 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3395a-0ae3-49ab-b027-7a8e58dae3cf None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:05.655519 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:05.755714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b3395a-0ae3-49ab-b027-7a8e58dae3cf None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:05.792731 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1da15-b26b-4d05-ae48-263203a5a7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:05.793591 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1da15-b26b-4d05-ae48-263203a5a7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:05.793874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1da15-b26b-4d05-ae48-263203a5a7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:05.794159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f1da15-b26b-4d05-ae48-263203a5a7c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:05.801706 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1da15-b26b-4d05-ae48-263203a5a7c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:05.803161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f1da15-b26b-4d05-ae48-263203a5a7c8 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:05.819435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-14f1da15-b26b-4d05-ae48-263203a5a7c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:33:05.819435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:05.819435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:05.819435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:05.819435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:05.819435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:05.819435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:05.819435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:05.819435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:05.819435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:05.819435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:05.819435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:05.819435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:33:05.819435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:33:05.819435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:33:05.820433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:33:05.820433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:05.820433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:05.820433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:05.820433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:05.820433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:05.820433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:05.820433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:05.820433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:05.820433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:05.820433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:05.820433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:05.820433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:05.820433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:05.820433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:05.820433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:05.820433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:05.821395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:33:05.821395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:33:05.821395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:33:05.821395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:33:05.821395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:33:05.821395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:33:05.821395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:33:05.821395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:05.821395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 620/1230] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:33:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:05.828290 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548018a2-805f-4491-bac8-1107f655c8ee None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:05.931643 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548018a2-805f-4491-bac8-1107f655c8ee None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:05.968093 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72656046-4b7d-45bd-b3ec-10fbfceedf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:05.968771 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72656046-4b7d-45bd-b3ec-10fbfceedf7a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:05.970983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72656046-4b7d-45bd-b3ec-10fbfceedf7a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:05.970983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72656046-4b7d-45bd-b3ec-10fbfceedf7a None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:05.970983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72656046-4b7d-45bd-b3ec-10fbfceedf7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:05.970983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72656046-4b7d-45bd-b3ec-10fbfceedf7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:05.971965 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72656046-4b7d-45bd-b3ec-10fbfceedf7a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:05.985324 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 611/1231] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:33:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:05.991846 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1da15-b26b-4d05-ae48-263203a5a7c8 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:06.060167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:06.096734 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f1da15-b26b-4d05-ae48-263203a5a7c8 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:06.135749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb74ec6-5d3d-4afe-8cd5-ac4492c05cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:06.136928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb74ec6-5d3d-4afe-8cd5-ac4492c05cbf None admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:06.137938 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb74ec6-5d3d-4afe-8cd5-ac4492c05cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:06.142245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb74ec6-5d3d-4afe-8cd5-ac4492c05cbf None admin] PATH_INFO: `/v3/projects/30a4824228ec47519a01574d82879b25/users/9c8d6afb4ccd41a5972e3241a3eebc7e/roles/ce6bff4fd8b6468b94dc4af858dde77b` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:06.156805 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb74ec6-5d3d-4afe-8cd5-ac4492c05cbf None admin] RBAC: Authorizing `identity:create_grant(project_id=30a4824228ec47519a01574d82879b25, user_id=9c8d6afb4ccd41a5972e3241a3eebc7e, role_id=ce6bff4fd8b6468b94dc4af858dde77b)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:06.158303 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb74ec6-5d3d-4afe-8cd5-ac4492c05cbf None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:06.260602 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 621/1232] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:33:05 2022] PUT /identity/v3/projects/30a4824228ec47519a01574d82879b25/users/9c8d6afb4ccd41a5972e3241a3eebc7e/roles/ce6bff4fd8b6468b94dc4af858dde77b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:33:08.419618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d8fe1-71b7-44ff-8b7e-03aeb76ab675 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:08.420238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d8fe1-71b7-44ff-8b7e-03aeb76ab675 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:08.420238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d8fe1-71b7-44ff-8b7e-03aeb76ab675 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:08.421597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 612/1233] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:33:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:33:08.427779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da269ad-c4b1-41d0-b83b-11da77cf6a2b None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:08.428550 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da269ad-c4b1-41d0-b83b-11da77cf6a2b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:08.428706 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da269ad-c4b1-41d0-b83b-11da77cf6a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:08.446776 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-4da269ad-c4b1-41d0-b83b-11da77cf6a2b None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:33:08.448001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4da269ad-c4b1-41d0-b83b-11da77cf6a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:33:08.521944 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 622/1234] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:33:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:33:08.551006 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d8fe1-71b7-44ff-8b7e-03aeb76ab675 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:08.573108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:08.653472 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d8fe1-71b7-44ff-8b7e-03aeb76ab675 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:08.689432 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe181d7-de31-417f-b6cf-a7f369db3ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:08.690154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe181d7-de31-417f-b6cf-a7f369db3ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:08.690436 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe181d7-de31-417f-b6cf-a7f369db3ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:08.690707 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe181d7-de31-417f-b6cf-a7f369db3ea5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:08.704035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe181d7-de31-417f-b6cf-a7f369db3ea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:33:08.712878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-ffe181d7-de31-417f-b6cf-a7f369db3ea5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:33:08.712878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:08.712878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:08.712878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:08.712878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:08.712878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:08.712878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:08.712878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:08.712878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:08.712878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:08.712878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:08.712878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:08.712878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:33:08.712878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:33:08.712878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:33:08.712878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:33:08.714112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:33:08.714112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:33:08.714112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:33:08.714112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:33:08.714112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:08.714112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:08.714112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:08.714112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:08.714112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:08.714112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:08.714112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:08.714112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:08.714112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:08.714112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:08.714112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:08.714112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:08.715716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:08.715716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:08.715716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:08.715716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:08.715716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:33:08.715716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:33:08.715716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:33:08.715716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:33:08.715716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:33:08.715716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:33:08.715716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 18 16:33:08.715716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:33:08.715716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 613/1235] 10.222.0.76 () {56 vars in 1102 bytes} [Mon Jul 18 16:33:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:08.720936 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da269ad-c4b1-41d0-b83b-11da77cf6a2b None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:08.770318 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:08.827700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da269ad-c4b1-41d0-b83b-11da77cf6a2b None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:08.863777 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb172cc-8833-4c5e-80ef-3004e68623d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:08.864452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb172cc-8833-4c5e-80ef-3004e68623d3 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:08.864733 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb172cc-8833-4c5e-80ef-3004e68623d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:08.865036 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb172cc-8833-4c5e-80ef-3004e68623d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:08.865789 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb172cc-8833-4c5e-80ef-3004e68623d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:08.866088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb172cc-8833-4c5e-80ef-3004e68623d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:08.867453 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb172cc-8833-4c5e-80ef-3004e68623d3 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:08.876595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 623/1236] 10.222.0.76 () {56 vars in 1103 bytes} [Mon Jul 18 16:33:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:08.882508 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe181d7-de31-417f-b6cf-a7f369db3ea5 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:08.969825 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:08.984822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe181d7-de31-417f-b6cf-a7f369db3ea5 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:09.019050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af972a-e4e3-430a-a854-87feecac07d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:09.019828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af972a-e4e3-430a-a854-87feecac07d4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:09.020114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af972a-e4e3-430a-a854-87feecac07d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:09.020392 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1af972a-e4e3-430a-a854-87feecac07d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:09.030091 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af972a-e4e3-430a-a854-87feecac07d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:09.031528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1af972a-e4e3-430a-a854-87feecac07d4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:09.049000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-e1af972a-e4e3-430a-a854-87feecac07d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:09.049000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:09.049000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:09.049000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:09.049000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:09.049000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:09.049000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:09.049000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:09.049000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:09.049000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:09.049000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:09.049000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:09.049000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:33:09.049000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:33:09.049000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:33:09.052818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:33:09.052818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:09.052818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:09.052818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:09.052818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:09.052818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:09.052818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:09.052818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:09.052818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:09.052818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:09.052818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:09.052818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:09.052818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:09.052818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:09.052818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:09.052818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:09.052818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:09.053974 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:33:09.053974 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:33:09.053974 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:09.053974 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:33:09.053974 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 614/1237] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:33:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:09.056204 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb172cc-8833-4c5e-80ef-3004e68623d3 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:09.159190 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb172cc-8833-4c5e-80ef-3004e68623d3 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:09.168845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:09.194476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc9879-fed9-4879-9366-3e2dfbf1ce00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:09.195149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc9879-fed9-4879-9366-3e2dfbf1ce00 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:09.195440 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc9879-fed9-4879-9366-3e2dfbf1ce00 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:09.195720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc9879-fed9-4879-9366-3e2dfbf1ce00 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:09.196445 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc9879-fed9-4879-9366-3e2dfbf1ce00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:09.196752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc9879-fed9-4879-9366-3e2dfbf1ce00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:09.198165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc9879-fed9-4879-9366-3e2dfbf1ce00 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:09.210310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 624/1238] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:09.216160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af972a-e4e3-430a-a854-87feecac07d4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:09.316915 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1af972a-e4e3-430a-a854-87feecac07d4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:09.355839 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549cab5-b19f-4eb7-8435-ed7baa31684a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:09.363306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549cab5-b19f-4eb7-8435-ed7baa31684a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:09.363306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549cab5-b19f-4eb7-8435-ed7baa31684a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:09.363306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549cab5-b19f-4eb7-8435-ed7baa31684a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:09.363306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:09.366117 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549cab5-b19f-4eb7-8435-ed7baa31684a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:09.367569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6549cab5-b19f-4eb7-8435-ed7baa31684a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:09.382928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-6549cab5-b19f-4eb7-8435-ed7baa31684a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:33:09.382928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:09.382928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:09.382928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:09.382928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:09.382928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:09.382928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:09.382928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:09.382928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:09.382928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:09.382928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:09.382928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:09.382928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:33:09.382928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:33:09.382928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:33:09.382928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:33:09.384118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:09.384118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:09.384118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:33:09.384118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:33:09.384118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:33:09.384118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:33:09.384118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:09.384118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:09.384118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:09.384118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:09.384118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:09.384118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:09.384118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:09.384118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:09.384118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:09.384118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:09.384118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:09.384118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:09.385299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:09.385299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:09.385299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:33:09.385299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:33:09.385299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:33:09.385299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:33:09.385299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:33:09.385299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:33:09.385299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:33:09.385299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:33:09.385299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 615/1239] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:33:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:09.390589 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc9879-fed9-4879-9366-3e2dfbf1ce00 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:09.493479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc9879-fed9-4879-9366-3e2dfbf1ce00 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:09.528538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea01b73-d2fb-4c89-b681-98bb0e335673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:09.529239 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea01b73-d2fb-4c89-b681-98bb0e335673 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:09.529523 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea01b73-d2fb-4c89-b681-98bb0e335673 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:09.529799 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea01b73-d2fb-4c89-b681-98bb0e335673 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:09.530636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea01b73-d2fb-4c89-b681-98bb0e335673 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:09.530942 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea01b73-d2fb-4c89-b681-98bb0e335673 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:09.532366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea01b73-d2fb-4c89-b681-98bb0e335673 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:09.551153 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 625/1240] 10.222.0.76 () {56 vars in 1143 bytes} [Mon Jul 18 16:33:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:09.557069 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549cab5-b19f-4eb7-8435-ed7baa31684a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:09.658452 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549cab5-b19f-4eb7-8435-ed7baa31684a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:09.692600 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efe98e-0db5-47a1-b18f-216b1ae3b477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:09.693272 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efe98e-0db5-47a1-b18f-216b1ae3b477 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:09.693567 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efe98e-0db5-47a1-b18f-216b1ae3b477 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:09.693841 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11efe98e-0db5-47a1-b18f-216b1ae3b477 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:09.758979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:09.765971 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efe98e-0db5-47a1-b18f-216b1ae3b477 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:09.767545 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11efe98e-0db5-47a1-b18f-216b1ae3b477 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:09.864714 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 616/1241] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:33:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:33:09.870770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea01b73-d2fb-4c89-b681-98bb0e335673 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:09.898908 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:09.973438 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea01b73-d2fb-4c89-b681-98bb0e335673 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:10.006930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191dd9a-514a-400d-a769-cd8ca1c58422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:10.010639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191dd9a-514a-400d-a769-cd8ca1c58422 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:10.010639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191dd9a-514a-400d-a769-cd8ca1c58422 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:10.010639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4191dd9a-514a-400d-a769-cd8ca1c58422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:10.018336 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191dd9a-514a-400d-a769-cd8ca1c58422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:10.019785 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4191dd9a-514a-400d-a769-cd8ca1c58422 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:10.037773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-4191dd9a-514a-400d-a769-cd8ca1c58422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:10.037773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:10.037773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:10.037773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:10.037773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:10.037773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:10.037773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:10.037773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:10.037773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:10.037773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:10.037773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:10.037773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:10.037773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:33:10.037773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:33:10.037773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:33:10.038948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:33:10.038948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:10.038948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:10.038948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:10.038948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:10.038948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:10.038948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:10.038948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:10.038948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:10.038948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:10.038948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:10.038948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:10.038948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:10.038948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:10.038948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:10.038948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:10.038948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:10.039996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:33:10.039996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:33:10.039996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:10.039996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:10.039996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 626/1242] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:33:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:10.046314 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efe98e-0db5-47a1-b18f-216b1ae3b477 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:10.143694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:10.149696 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11efe98e-0db5-47a1-b18f-216b1ae3b477 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:10.184504 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b03aa3-103c-4307-96a5-d042dac22e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:10.186979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b03aa3-103c-4307-96a5-d042dac22e17 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:10.186979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b03aa3-103c-4307-96a5-d042dac22e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:10.186979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b03aa3-103c-4307-96a5-d042dac22e17 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:10.186979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b03aa3-103c-4307-96a5-d042dac22e17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:10.186979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b03aa3-103c-4307-96a5-d042dac22e17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:10.188195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b03aa3-103c-4307-96a5-d042dac22e17 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:10.200102 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 617/1243] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:10.205834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191dd9a-514a-400d-a769-cd8ca1c58422 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:10.285508 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:10.306321 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4191dd9a-514a-400d-a769-cd8ca1c58422 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:10.341430 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f4246-31b3-40d9-a942-bc66a5d89099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:10.342234 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f4246-31b3-40d9-a942-bc66a5d89099 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:10.342516 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f4246-31b3-40d9-a942-bc66a5d89099 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:10.342794 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f4246-31b3-40d9-a942-bc66a5d89099 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:10.349623 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f4246-31b3-40d9-a942-bc66a5d89099 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:10.351136 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f4246-31b3-40d9-a942-bc66a5d89099 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:10.364845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-647f4246-31b3-40d9-a942-bc66a5d89099 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:33:10.364845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:10.364845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:10.364845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:10.364845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:10.364845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:10.364845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:10.364845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:10.364845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:10.364845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:10.364845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:10.364845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:10.364845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:33:10.364845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:33:10.364845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:33:10.366005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:33:10.366005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:10.366005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:10.366005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:10.366005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:10.366005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:10.366005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:10.366005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:10.366005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:10.366005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:10.366005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:10.366005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:10.366005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:10.366005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:10.366005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:10.366005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:10.366005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:10.367310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:33:10.367310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:33:10.367310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:33:10.367310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:33:10.367310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:33:10.367310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:33:10.367310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:33:10.367310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:10.367310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 627/1244] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:33:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:10.372055 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b03aa3-103c-4307-96a5-d042dac22e17 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:10.474700 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b03aa3-103c-4307-96a5-d042dac22e17 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:10.509274 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c439502b-cd7a-4185-9993-fe6099660136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:10.509983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439502b-cd7a-4185-9993-fe6099660136 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:10.510294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439502b-cd7a-4185-9993-fe6099660136 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:10.510572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c439502b-cd7a-4185-9993-fe6099660136 None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:10.512106 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439502b-cd7a-4185-9993-fe6099660136 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:10.512463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439502b-cd7a-4185-9993-fe6099660136 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:10.514018 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c439502b-cd7a-4185-9993-fe6099660136 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:10.529056 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 618/1245] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:33:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:33:10.535275 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f4246-31b3-40d9-a942-bc66a5d89099 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:10.638123 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f4246-31b3-40d9-a942-bc66a5d89099 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:10.674644 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa76750f-0223-44f4-81d3-510a3537b13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:10.675304 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76750f-0223-44f4-81d3-510a3537b13c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:10.675586 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76750f-0223-44f4-81d3-510a3537b13c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:10.675862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa76750f-0223-44f4-81d3-510a3537b13c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:10.676693 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76750f-0223-44f4-81d3-510a3537b13c None admin] RBAC: Adding query filter params (role.id=ce6bff4fd8b6468b94dc4af858dde77b, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=9c8d6afb4ccd41a5972e3241a3eebc7e) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:10.677032 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76750f-0223-44f4-81d3-510a3537b13c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:10.678464 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa76750f-0223-44f4-81d3-510a3537b13c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:10.685025 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 628/1246] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:33:10 2022] GET /identity/v3/role_assignments?user.id=9c8d6afb4ccd41a5972e3241a3eebc7e&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=ce6bff4fd8b6468b94dc4af858dde77b => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:12.771341 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbcd84-6cc6-41dd-b922-35cfa35727c9 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:12.771915 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbcd84-6cc6-41dd-b922-35cfa35727c9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:12.771915 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bbcd84-6cc6-41dd-b922-35cfa35727c9 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:12.773386 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 619/1247] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:33:12.779333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668a7a2-f901-4ad8-9936-c9d34a31afec None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:12.787184 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668a7a2-f901-4ad8-9936-c9d34a31afec None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:12.787184 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5668a7a2-f901-4ad8-9936-c9d34a31afec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:12.787184 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:12.797764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-5668a7a2-f901-4ad8-9936-c9d34a31afec None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:33:12.798950 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5668a7a2-f901-4ad8-9936-c9d34a31afec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:33:12.864420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 629/1248] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:33:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:33:12.887847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbcd84-6cc6-41dd-b922-35cfa35727c9 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:12.906779 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:12.991570 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bbcd84-6cc6-41dd-b922-35cfa35727c9 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:13.024714 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0f3e0-c026-4591-9ee2-792adec1b6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:13.025461 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0f3e0-c026-4591-9ee2-792adec1b6cb None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:13.025749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0f3e0-c026-4591-9ee2-792adec1b6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:13.026024 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0f3e0-c026-4591-9ee2-792adec1b6cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:13.037212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0f3e0-c026-4591-9ee2-792adec1b6cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:33:13.046655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-08a0f3e0-c026-4591-9ee2-792adec1b6cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:33:13.046655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:13.046655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:13.046655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:13.046655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:13.046655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:13.046655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:13.046655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:13.046655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:13.046655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:13.046655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:13.046655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:13.046655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:33:13.046655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:33:13.046655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:33:13.046655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:33:13.051568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:33:13.051568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:33:13.051568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:33:13.051568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:33:13.051568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:13.051568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:13.051568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:13.051568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:13.051568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:13.051568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:13.051568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:13.051568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:13.051568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:13.051568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:13.051568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:13.051568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:13.052645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:13.052645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:13.052645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:13.052645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:13.052645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:33:13.052645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:33:13.052645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:33:13.052645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:33:13.052645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:33:13.052645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:33:13.052645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:33:13.052645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:33:13.052645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 620/1249] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:33:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:13.055397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668a7a2-f901-4ad8-9936-c9d34a31afec None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:13.162110 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5668a7a2-f901-4ad8-9936-c9d34a31afec None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:13.191310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:13.196138 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a39072-5b71-46f8-b3e6-16d1e774633c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:13.196805 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a39072-5b71-46f8-b3e6-16d1e774633c None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:13.197127 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a39072-5b71-46f8-b3e6-16d1e774633c None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:13.197391 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a39072-5b71-46f8-b3e6-16d1e774633c None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:13.198125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a39072-5b71-46f8-b3e6-16d1e774633c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:13.198429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a39072-5b71-46f8-b3e6-16d1e774633c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:13.200319 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a39072-5b71-46f8-b3e6-16d1e774633c None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:13.208372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 630/1250] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:33:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:13.214356 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0f3e0-c026-4591-9ee2-792adec1b6cb None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:13.292726 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:13.321246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0f3e0-c026-4591-9ee2-792adec1b6cb None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:13.356125 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299cd314-06f0-4e56-b165-4b8166c6ea55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:13.356922 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cd314-06f0-4e56-b165-4b8166c6ea55 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:13.357234 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cd314-06f0-4e56-b165-4b8166c6ea55 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:13.357512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299cd314-06f0-4e56-b165-4b8166c6ea55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:13.368028 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299cd314-06f0-4e56-b165-4b8166c6ea55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:13.369512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299cd314-06f0-4e56-b165-4b8166c6ea55 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:13.387164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-299cd314-06f0-4e56-b165-4b8166c6ea55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:13.387164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:13.387164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:13.387164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:13.387164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:13.387164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:13.387164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:13.387164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:13.387164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:13.387164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:13.387164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:13.387164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:13.387164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:33:13.387164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:33:13.387164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:33:13.388078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:33:13.388078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:13.388078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:13.388078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:13.388078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:13.388078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:13.388078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:13.388078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:13.388078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:13.388078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:13.388078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:13.388078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:13.388078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:13.388078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:13.388078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:13.388078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:13.388078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:13.389002 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:33:13.389002 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:33:13.389002 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:13.389002 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:33:13.389002 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 621/1251] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:33:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:13.394692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a39072-5b71-46f8-b3e6-16d1e774633c None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:13.498725 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a39072-5b71-46f8-b3e6-16d1e774633c None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:13.533297 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca6722-74fe-4d3a-810f-1f542b4a7f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:13.533967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca6722-74fe-4d3a-810f-1f542b4a7f0d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:13.534252 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca6722-74fe-4d3a-810f-1f542b4a7f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:13.534530 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca6722-74fe-4d3a-810f-1f542b4a7f0d None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:13.535249 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca6722-74fe-4d3a-810f-1f542b4a7f0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:13.535554 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca6722-74fe-4d3a-810f-1f542b4a7f0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:13.536919 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca6722-74fe-4d3a-810f-1f542b4a7f0d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:13.548981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 631/1252] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:33:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:13.554702 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299cd314-06f0-4e56-b165-4b8166c6ea55 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:13.657673 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299cd314-06f0-4e56-b165-4b8166c6ea55 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:13.684492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:13.693272 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44aeeac-849b-441f-97f0-7a3a39c062c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:13.694078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44aeeac-849b-441f-97f0-7a3a39c062c7 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:13.694407 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44aeeac-849b-441f-97f0-7a3a39c062c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:13.694651 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44aeeac-849b-441f-97f0-7a3a39c062c7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:13.703060 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44aeeac-849b-441f-97f0-7a3a39c062c7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:13.704508 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44aeeac-849b-441f-97f0-7a3a39c062c7 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:13.718765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-f44aeeac-849b-441f-97f0-7a3a39c062c7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:33:13.718765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:13.718765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:13.718765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:13.718765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:13.718765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:13.718765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:13.718765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:13.718765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:13.718765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:13.718765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:13.718765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:13.718765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:33:13.718765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:33:13.718765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:33:13.718765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:33:13.719988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:13.719988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:13.719988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:33:13.719988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:33:13.719988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:33:13.719988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:33:13.719988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:13.719988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:13.719988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:13.719988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:13.719988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:13.719988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:13.719988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:13.719988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:13.719988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:13.719988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:13.719988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:13.719988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:13.720986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:13.720986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:13.720986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:33:13.720986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:33:13.720986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:33:13.720986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:33:13.720986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:33:13.720986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:33:13.720986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:33:13.720986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:33:13.720986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 622/1253] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:33:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:33:13.725937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca6722-74fe-4d3a-810f-1f542b4a7f0d None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:13.784387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:13.828667 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca6722-74fe-4d3a-810f-1f542b4a7f0d None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:13.862405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab0c54-018a-4d45-a4d9-8cc19837103b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:13.863084 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab0c54-018a-4d45-a4d9-8cc19837103b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:13.863370 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab0c54-018a-4d45-a4d9-8cc19837103b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:13.863655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab0c54-018a-4d45-a4d9-8cc19837103b None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:13.864484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab0c54-018a-4d45-a4d9-8cc19837103b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:13.864787 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab0c54-018a-4d45-a4d9-8cc19837103b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:13.866258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab0c54-018a-4d45-a4d9-8cc19837103b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:13.883705 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 632/1254] 10.222.0.76 () {56 vars in 1143 bytes} [Mon Jul 18 16:33:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:13.889812 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44aeeac-849b-441f-97f0-7a3a39c062c7 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:13.991755 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44aeeac-849b-441f-97f0-7a3a39c062c7 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:14.025405 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8a1ed-49fa-4a0f-b8c6-637c7eb7b8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:14.026066 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8a1ed-49fa-4a0f-b8c6-637c7eb7b8ab None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:14.026345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8a1ed-49fa-4a0f-b8c6-637c7eb7b8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:14.026636 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8a1ed-49fa-4a0f-b8c6-637c7eb7b8ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:14.086730 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:14.101024 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8a1ed-49fa-4a0f-b8c6-637c7eb7b8ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:14.102498 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8a1ed-49fa-4a0f-b8c6-637c7eb7b8ab None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:14.204402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 623/1255] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:33:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 18 16:33:14.210282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab0c54-018a-4d45-a4d9-8cc19837103b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:14.312557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab0c54-018a-4d45-a4d9-8cc19837103b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:14.325837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:14.346787 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be1827-5e10-4def-a369-408fc5dbc6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:14.347531 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be1827-5e10-4def-a369-408fc5dbc6ff None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:14.347815 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be1827-5e10-4def-a369-408fc5dbc6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:14.348092 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be1827-5e10-4def-a369-408fc5dbc6ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:14.358993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be1827-5e10-4def-a369-408fc5dbc6ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:14.360429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85be1827-5e10-4def-a369-408fc5dbc6ff None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:14.378546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-85be1827-5e10-4def-a369-408fc5dbc6ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:14.378546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:14.378546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:14.378546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:14.378546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:14.378546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:14.378546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:14.378546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:14.378546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:14.378546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:14.378546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:14.378546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:14.378546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:33:14.378546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:33:14.378546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:33:14.379668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:33:14.379668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:14.379668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:14.379668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:14.379668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:14.379668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:14.379668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:14.379668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:14.379668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:14.379668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:14.379668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:14.379668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:14.379668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:14.379668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:14.379668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:14.379668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:14.379668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:14.380804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:33:14.380804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:33:14.380804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:14.380804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:14.380804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 633/1256] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:33:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:14.385696 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8a1ed-49fa-4a0f-b8c6-637c7eb7b8ab None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:14.473702 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:14.486026 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8a1ed-49fa-4a0f-b8c6-637c7eb7b8ab None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:14.519702 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427526b-f974-4305-b06f-8ac7686f4ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:14.520369 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427526b-f974-4305-b06f-8ac7686f4ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:14.520657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427526b-f974-4305-b06f-8ac7686f4ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:14.520940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427526b-f974-4305-b06f-8ac7686f4ae9 None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:14.521707 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427526b-f974-4305-b06f-8ac7686f4ae9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:14.522019 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427526b-f974-4305-b06f-8ac7686f4ae9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:14.523396 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427526b-f974-4305-b06f-8ac7686f4ae9 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:14.535396 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 624/1257] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:33:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:14.541361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be1827-5e10-4def-a369-408fc5dbc6ff None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:14.643484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be1827-5e10-4def-a369-408fc5dbc6ff None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:14.678334 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18334214-9e9e-4ca7-a344-b2243f8ed01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:14.679129 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18334214-9e9e-4ca7-a344-b2243f8ed01b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:14.679414 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18334214-9e9e-4ca7-a344-b2243f8ed01b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:14.679696 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18334214-9e9e-4ca7-a344-b2243f8ed01b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:14.686420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18334214-9e9e-4ca7-a344-b2243f8ed01b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:14.687869 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18334214-9e9e-4ca7-a344-b2243f8ed01b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:14.702308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-18334214-9e9e-4ca7-a344-b2243f8ed01b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:33:14.702308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:14.702308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:14.702308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:14.702308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:14.702308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:14.702308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:14.702308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:14.702308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:14.702308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:14.702308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:14.702308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:14.702308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:33:14.702308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:33:14.702308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:33:14.703431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:33:14.703431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:14.703431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:14.703431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:14.703431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:14.703431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:14.703431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:14.703431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:14.703431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:14.703431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:14.703431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:14.703431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:14.703431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:14.703431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:14.703431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:14.703431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:14.703431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:14.710111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:33:14.710111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:33:14.710111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:33:14.710111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:33:14.710111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:33:14.710111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:33:14.710111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:33:14.710111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:14.710111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 634/1258] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:33:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:14.710752 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427526b-f974-4305-b06f-8ac7686f4ae9 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:14.813920 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427526b-f974-4305-b06f-8ac7686f4ae9 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:14.848222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e6b54-cea7-4b42-b616-2e285c59db0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:14.848876 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e6b54-cea7-4b42-b616-2e285c59db0e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:14.849191 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e6b54-cea7-4b42-b616-2e285c59db0e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:14.849471 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e6b54-cea7-4b42-b616-2e285c59db0e None admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:14.850292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e6b54-cea7-4b42-b616-2e285c59db0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:14.850596 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e6b54-cea7-4b42-b616-2e285c59db0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:14.852085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6e6b54-cea7-4b42-b616-2e285c59db0e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:14.864746 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 625/1259] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:33:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:14.870924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18334214-9e9e-4ca7-a344-b2243f8ed01b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:14.902803 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:14.979022 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18334214-9e9e-4ca7-a344-b2243f8ed01b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:15.014262 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7ca38-da9e-4e63-b922-b4dac67b2ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:15.014919 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7ca38-da9e-4e63-b922-b4dac67b2ddd None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:15.015197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7ca38-da9e-4e63-b922-b4dac67b2ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:15.015468 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7ca38-da9e-4e63-b922-b4dac67b2ddd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:15.016291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7ca38-da9e-4e63-b922-b4dac67b2ddd None admin] RBAC: Adding query filter params (role.id=c2d5d80485df4730903a874937d68aa3, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=9c8d6afb4ccd41a5972e3241a3eebc7e) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:15.016599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7ca38-da9e-4e63-b922-b4dac67b2ddd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:15.018120 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7ca38-da9e-4e63-b922-b4dac67b2ddd None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:15.023686 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 635/1260] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:33:14 2022] GET /identity/v3/role_assignments?user.id=9c8d6afb4ccd41a5972e3241a3eebc7e&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=c2d5d80485df4730903a874937d68aa3 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:17.049208 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3842f-9c2f-4f2e-ac0d-571dcba547e6 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:17.049752 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3842f-9c2f-4f2e-ac0d-571dcba547e6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:17.049847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3842f-9c2f-4f2e-ac0d-571dcba547e6 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:17.051152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 626/1261] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:33:17.056586 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45896f2-aaa1-48e1-8c9e-3958c5326ae4 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:17.064436 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45896f2-aaa1-48e1-8c9e-3958c5326ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:17.064436 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45896f2-aaa1-48e1-8c9e-3958c5326ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:17.074640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e45896f2-aaa1-48e1-8c9e-3958c5326ae4 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:33:17.075853 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e45896f2-aaa1-48e1-8c9e-3958c5326ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:33:17.147222 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 636/1262] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:33:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:33:17.170507 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3842f-9c2f-4f2e-ac0d-571dcba547e6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:17.181526 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:17.272991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3842f-9c2f-4f2e-ac0d-571dcba547e6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:17.307299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f7a29-a611-4dce-b383-3181a491ffc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:17.308020 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f7a29-a611-4dce-b383-3181a491ffc6 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:17.308915 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f7a29-a611-4dce-b383-3181a491ffc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:17.309182 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f7a29-a611-4dce-b383-3181a491ffc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:17.320071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7f7a29-a611-4dce-b383-3181a491ffc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:33:17.328672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-7c7f7a29-a611-4dce-b383-3181a491ffc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:33:17.328672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:17.328672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:17.328672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:17.328672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:17.328672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:17.328672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:17.328672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:17.328672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:17.328672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:17.328672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:17.328672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:17.328672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:33:17.328672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:33:17.328672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:33:17.328672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:33:17.329873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:33:17.329873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:33:17.329873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:33:17.329873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:33:17.329873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:17.329873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:17.329873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:17.329873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:17.329873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:17.329873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:17.329873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:17.329873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:17.329873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:17.329873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:17.329873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:17.329873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:17.330925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:17.330925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:17.330925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:17.330925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:17.330925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:33:17.330925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:33:17.330925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:33:17.330925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:33:17.330925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:33:17.330925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:33:17.330925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:33:17.330925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:33:17.330925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 627/1263] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:33:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:17.335970 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45896f2-aaa1-48e1-8c9e-3958c5326ae4 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:17.354285 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:17.436072 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45896f2-aaa1-48e1-8c9e-3958c5326ae4 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:17.470674 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce80a86-ab7a-4bcc-8114-ef1296dc6c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:17.471356 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce80a86-ab7a-4bcc-8114-ef1296dc6c74 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:17.471668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce80a86-ab7a-4bcc-8114-ef1296dc6c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:17.471949 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce80a86-ab7a-4bcc-8114-ef1296dc6c74 None admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:17.472703 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce80a86-ab7a-4bcc-8114-ef1296dc6c74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:17.473027 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce80a86-ab7a-4bcc-8114-ef1296dc6c74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:17.474450 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce80a86-ab7a-4bcc-8114-ef1296dc6c74 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:17.482530 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 637/1264] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:33:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:17.488623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f7a29-a611-4dce-b383-3181a491ffc6 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:17.555312 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:17.589722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f7a29-a611-4dce-b383-3181a491ffc6 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:17.623729 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1800fbd-0402-402a-a769-f5679f5dc1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:17.624585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1800fbd-0402-402a-a769-f5679f5dc1f4 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:17.624858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1800fbd-0402-402a-a769-f5679f5dc1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:17.625241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1800fbd-0402-402a-a769-f5679f5dc1f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:17.636152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1800fbd-0402-402a-a769-f5679f5dc1f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:17.645980 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1800fbd-0402-402a-a769-f5679f5dc1f4 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:17.654774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-a1800fbd-0402-402a-a769-f5679f5dc1f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:17.654774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:17.654774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:17.654774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:17.654774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:17.654774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:17.654774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:17.654774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:17.654774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:17.654774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:17.654774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:17.654774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:17.654774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:33:17.654774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:33:17.654774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:33:17.655813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:33:17.655813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:17.655813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:17.655813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:17.655813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:17.655813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:17.655813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:17.655813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:17.655813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:17.655813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:17.655813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:17.655813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:17.655813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:17.655813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:17.655813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:17.655813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:17.655813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:17.656933 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:33:17.656933 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:33:17.656933 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:17.656933 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:33:17.656933 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 628/1265] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:17.661969 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce80a86-ab7a-4bcc-8114-ef1296dc6c74 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:17.742340 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:17.765698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce80a86-ab7a-4bcc-8114-ef1296dc6c74 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:17.799708 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3703527-98bd-4e58-aff5-b117b4c079d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:17.800388 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3703527-98bd-4e58-aff5-b117b4c079d1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:17.800701 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3703527-98bd-4e58-aff5-b117b4c079d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:17.800980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3703527-98bd-4e58-aff5-b117b4c079d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:17.801736 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3703527-98bd-4e58-aff5-b117b4c079d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:17.802045 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3703527-98bd-4e58-aff5-b117b4c079d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:17.803411 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3703527-98bd-4e58-aff5-b117b4c079d1 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:17.816059 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 638/1266] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:17.822225 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1800fbd-0402-402a-a769-f5679f5dc1f4 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:17.922496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1800fbd-0402-402a-a769-f5679f5dc1f4 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:17.942646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:17.956633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac50a8-2ba3-4bcf-a2f0-eeec8e274766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:17.957459 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac50a8-2ba3-4bcf-a2f0-eeec8e274766 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:17.957743 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac50a8-2ba3-4bcf-a2f0-eeec8e274766 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:17.958020 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac50a8-2ba3-4bcf-a2f0-eeec8e274766 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:17.965530 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac50a8-2ba3-4bcf-a2f0-eeec8e274766 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:17.967034 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac50a8-2ba3-4bcf-a2f0-eeec8e274766 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:17.981160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-94ac50a8-2ba3-4bcf-a2f0-eeec8e274766 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:33:17.981160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:17.981160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:17.981160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:17.981160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:17.981160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:17.981160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:17.981160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:17.981160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:17.981160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:17.981160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:17.981160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:17.981160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:33:17.981160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:33:17.981160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:33:17.981160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:33:17.982273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:17.982273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:17.982273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:33:17.982273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:33:17.982273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:33:17.982273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:33:17.982273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:17.982273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:17.982273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:17.982273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:17.982273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:17.982273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:17.982273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:17.982273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:17.982273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:17.982273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:17.982273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:17.982273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:17.983647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:17.983647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:17.983647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:33:17.983647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:33:17.983647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:33:17.983647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:33:17.983647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:33:17.983647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:33:17.983647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:33:17.983647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:33:17.983647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 629/1267] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:33:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:17.988883 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3703527-98bd-4e58-aff5-b117b4c079d1 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:18.090724 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3703527-98bd-4e58-aff5-b117b4c079d1 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:18.124982 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7f405-5120-4397-b8e8-1c7783988550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:18.125686 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7f405-5120-4397-b8e8-1c7783988550 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:18.125971 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7f405-5120-4397-b8e8-1c7783988550 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:18.126250 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7f405-5120-4397-b8e8-1c7783988550 None admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:18.127078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7f405-5120-4397-b8e8-1c7783988550 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:18.127388 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7f405-5120-4397-b8e8-1c7783988550 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:18.128833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7f405-5120-4397-b8e8-1c7783988550 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:18.138157 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:18.146449 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 639/1268] 10.222.0.76 () {56 vars in 1143 bytes} [Mon Jul 18 16:33:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:18.152482 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac50a8-2ba3-4bcf-a2f0-eeec8e274766 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:18.255290 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac50a8-2ba3-4bcf-a2f0-eeec8e274766 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:18.288833 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31147de1-8f88-441a-9664-f27c110d6dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:18.289704 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31147de1-8f88-441a-9664-f27c110d6dfd None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:18.289986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31147de1-8f88-441a-9664-f27c110d6dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:18.290260 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31147de1-8f88-441a-9664-f27c110d6dfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:18.301000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31147de1-8f88-441a-9664-f27c110d6dfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:18.302473 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31147de1-8f88-441a-9664-f27c110d6dfd None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:18.320169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-31147de1-8f88-441a-9664-f27c110d6dfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:18.320169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:18.320169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:18.320169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:18.320169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:18.320169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:18.320169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:18.320169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:18.320169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:18.320169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:18.320169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:18.320169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:18.320169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:33:18.320169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:33:18.320169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:33:18.325657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:33:18.325657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:18.325657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:18.325657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:18.325657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:18.325657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:18.325657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:18.325657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:18.325657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:18.325657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:18.325657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:18.325657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:18.325657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:18.325657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:18.325657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:18.325657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:18.325657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:18.326813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:33:18.326813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:33:18.326813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:18.326813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:33:18.326813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 630/1269] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:33:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:18.328189 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7f405-5120-4397-b8e8-1c7783988550 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:18.434368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7f405-5120-4397-b8e8-1c7783988550 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:18.468374 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3673cc9-9646-410f-9686-f0126aee26cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:18.469062 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3673cc9-9646-410f-9686-f0126aee26cb None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:18.469344 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3673cc9-9646-410f-9686-f0126aee26cb None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:18.469641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3673cc9-9646-410f-9686-f0126aee26cb None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:18.470345 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3673cc9-9646-410f-9686-f0126aee26cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:18.470643 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3673cc9-9646-410f-9686-f0126aee26cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:18.472022 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3673cc9-9646-410f-9686-f0126aee26cb None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:18.483819 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 640/1270] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:33:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:18.490008 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31147de1-8f88-441a-9664-f27c110d6dfd None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:18.522260 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:18.590456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31147de1-8f88-441a-9664-f27c110d6dfd None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:18.625926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64135c-a93d-45eb-abcd-3f9eeb65c90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:18.626759 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64135c-a93d-45eb-abcd-3f9eeb65c90a None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:18.627047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64135c-a93d-45eb-abcd-3f9eeb65c90a None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:18.627377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e64135c-a93d-45eb-abcd-3f9eeb65c90a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:18.634280 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64135c-a93d-45eb-abcd-3f9eeb65c90a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:18.635737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e64135c-a93d-45eb-abcd-3f9eeb65c90a None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:18.650769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-9e64135c-a93d-45eb-abcd-3f9eeb65c90a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:33:18.650769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:18.650769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:18.650769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:18.650769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:18.650769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:18.650769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:18.650769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:18.650769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:18.650769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:18.650769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:18.650769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:18.650769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:33:18.650769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:33:18.650769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:33:18.651906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:33:18.651906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:18.651906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:18.651906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:18.651906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:18.651906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:18.651906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:18.651906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:18.651906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:18.651906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:18.651906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:18.651906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:18.651906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:18.651906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:18.651906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:18.651906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:18.651906 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:18.658884 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:33:18.658884 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:33:18.658884 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:33:18.658884 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:33:18.658884 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:33:18.658884 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:33:18.658884 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:33:18.658884 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:33:18.658884 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 631/1271] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:33:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:18.659547 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3673cc9-9646-410f-9686-f0126aee26cb None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:18.718516 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:18.759987 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3673cc9-9646-410f-9686-f0126aee26cb None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:18.793916 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2723d-c1cb-43ba-8e8b-0c8471753ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:18.794508 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2723d-c1cb-43ba-8e8b-0c8471753ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:18.794792 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2723d-c1cb-43ba-8e8b-0c8471753ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:18.795103 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2723d-c1cb-43ba-8e8b-0c8471753ec1 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:18.795850 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2723d-c1cb-43ba-8e8b-0c8471753ec1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:18.796163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2723d-c1cb-43ba-8e8b-0c8471753ec1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:18.797628 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2723d-c1cb-43ba-8e8b-0c8471753ec1 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:18.809903 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 641/1272] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:33:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:18.816094 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64135c-a93d-45eb-abcd-3f9eeb65c90a None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:18.911703 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:18.920905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e64135c-a93d-45eb-abcd-3f9eeb65c90a None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:18.954572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20419aa-02c3-4adf-aa19-b0d315bb2c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:18.955545 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20419aa-02c3-4adf-aa19-b0d315bb2c56 None admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:18.955841 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20419aa-02c3-4adf-aa19-b0d315bb2c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:18.956335 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20419aa-02c3-4adf-aa19-b0d315bb2c56 None admin] PATH_INFO: `/v3/projects/30a4824228ec47519a01574d82879b25/users/9c8d6afb4ccd41a5972e3241a3eebc7e/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:18.958715 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20419aa-02c3-4adf-aa19-b0d315bb2c56 None admin] RBAC: Authorizing `identity:create_grant(project_id=30a4824228ec47519a01574d82879b25, user_id=9c8d6afb4ccd41a5972e3241a3eebc7e, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:18.960152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20419aa-02c3-4adf-aa19-b0d315bb2c56 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:19.103379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 632/1273] 10.222.0.76 () {58 vars in 1439 bytes} [Mon Jul 18 16:33:18 2022] PUT /identity/v3/projects/30a4824228ec47519a01574d82879b25/users/9c8d6afb4ccd41a5972e3241a3eebc7e/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:33:21.110811 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a7b01-9192-4829-88cb-5fe7bf766427 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:21.111338 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a7b01-9192-4829-88cb-5fe7bf766427 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:21.111462 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a7b01-9192-4829-88cb-5fe7bf766427 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:21.113024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 642/1274] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:33:21.118272 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d53236-89d9-41a8-a9c0-9130a8f02661 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:21.118730 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d53236-89d9-41a8-a9c0-9130a8f02661 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:21.118904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d53236-89d9-41a8-a9c0-9130a8f02661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:21.136235 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-54d53236-89d9-41a8-a9c0-9130a8f02661 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:33:21.138195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-54d53236-89d9-41a8-a9c0-9130a8f02661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:33:21.206359 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 633/1275] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:33:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:33:21.229371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a7b01-9192-4829-88cb-5fe7bf766427 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:21.333926 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a7b01-9192-4829-88cb-5fe7bf766427 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:21.351191 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:21.371705 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a6499-647c-4815-823d-4bcbcb472263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:21.372917 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a6499-647c-4815-823d-4bcbcb472263 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:21.373453 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a6499-647c-4815-823d-4bcbcb472263 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:21.373966 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a6499-647c-4815-823d-4bcbcb472263 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:21.385947 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182a6499-647c-4815-823d-4bcbcb472263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 18 16:33:21.395998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-182a6499-647c-4815-823d-4bcbcb472263 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:33:21.395998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:21.395998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:21.395998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:21.395998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:21.395998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:21.395998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:21.395998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:21.395998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:21.395998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:21.395998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:21.395998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:21.395998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 18 16:33:21.395998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 18 16:33:21.395998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 18 16:33:21.395998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 18 16:33:21.397203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 18 16:33:21.397203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 18 16:33:21.397203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 18 16:33:21.397203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 18 16:33:21.397203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:21.397203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:21.397203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:21.397203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:21.397203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:21.397203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:21.397203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:21.397203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:21.397203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:21.397203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:21.397203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:21.397203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:21.398267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:21.398267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:21.398267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:21.398267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:21.398267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 18 16:33:21.398267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 18 16:33:21.398267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 18 16:33:21.398267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 18 16:33:21.398267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 18 16:33:21.398267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 18 16:33:21.398267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 18 16:33:21.398267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:21.398267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 643/1276] 10.222.0.76 () {56 vars in 1096 bytes} [Mon Jul 18 16:33:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:21.403958 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d53236-89d9-41a8-a9c0-9130a8f02661 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:21.486836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:21.505715 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d53236-89d9-41a8-a9c0-9130a8f02661 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:21.539012 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663ffb4-64d5-4ebb-93a0-0fa0a9e54e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:21.539681 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663ffb4-64d5-4ebb-93a0-0fa0a9e54e8e None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:21.539969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663ffb4-64d5-4ebb-93a0-0fa0a9e54e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:21.540246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c663ffb4-64d5-4ebb-93a0-0fa0a9e54e8e None admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:21.541056 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663ffb4-64d5-4ebb-93a0-0fa0a9e54e8e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:21.541380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663ffb4-64d5-4ebb-93a0-0fa0a9e54e8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:21.543321 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c663ffb4-64d5-4ebb-93a0-0fa0a9e54e8e None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:21.551442 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 634/1277] 10.222.0.76 () {56 vars in 1099 bytes} [Mon Jul 18 16:33:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:21.557518 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a6499-647c-4815-823d-4bcbcb472263 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:21.662334 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a6499-647c-4815-823d-4bcbcb472263 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:21.696384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0566fbd-866a-415a-881e-7f2adbc9cd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:21.697215 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0566fbd-866a-415a-881e-7f2adbc9cd8b None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:21.697525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0566fbd-866a-415a-881e-7f2adbc9cd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:21.697775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0566fbd-866a-415a-881e-7f2adbc9cd8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:21.708567 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0566fbd-866a-415a-881e-7f2adbc9cd8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:21.710055 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0566fbd-866a-415a-881e-7f2adbc9cd8b None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:21.727400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-d0566fbd-866a-415a-881e-7f2adbc9cd8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:21.727400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:21.727400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:21.727400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:21.727400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:21.727400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:21.727400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:21.727400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:21.727400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:21.727400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:21.727400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:21.727400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:21.727400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:33:21.727400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:33:21.727400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:33:21.728692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:33:21.728692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:21.728692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:21.728692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:21.728692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:21.728692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:21.728692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:21.728692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:21.728692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:21.728692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:21.728692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:21.728692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:21.728692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:21.728692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:21.728692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:21.728692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:21.728692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:21.729826 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:33:21.729826 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:33:21.729826 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:21.729826 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:21.729826 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 644/1278] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:21.735368 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663ffb4-64d5-4ebb-93a0-0fa0a9e54e8e None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:21.842953 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c663ffb4-64d5-4ebb-93a0-0fa0a9e54e8e None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:21.876869 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04ac3e-cdbb-490e-a50b-a66200ca207f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:21.877572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04ac3e-cdbb-490e-a50b-a66200ca207f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:21.877857 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04ac3e-cdbb-490e-a50b-a66200ca207f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:21.878140 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04ac3e-cdbb-490e-a50b-a66200ca207f None admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:21.878867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04ac3e-cdbb-490e-a50b-a66200ca207f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:21.879186 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04ac3e-cdbb-490e-a50b-a66200ca207f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:21.880566 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04ac3e-cdbb-490e-a50b-a66200ca207f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:21.893202 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 635/1279] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:21.898938 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0566fbd-866a-415a-881e-7f2adbc9cd8b None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:21.931127 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:22.002602 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0566fbd-866a-415a-881e-7f2adbc9cd8b None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:22.039409 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8a7db-7d24-48c0-a18d-02a20268ef51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:22.040219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8a7db-7d24-48c0-a18d-02a20268ef51 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:22.040506 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8a7db-7d24-48c0-a18d-02a20268ef51 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:22.040786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8a7db-7d24-48c0-a18d-02a20268ef51 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:22.050245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8a7db-7d24-48c0-a18d-02a20268ef51 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:22.051696 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8a7db-7d24-48c0-a18d-02a20268ef51 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:22.066576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-17b8a7db-7d24-48c0-a18d-02a20268ef51 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:33:22.066576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:22.066576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:22.066576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:22.066576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:22.066576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:22.066576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:22.066576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:22.066576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:22.066576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:22.066576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:22.066576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:22.066576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 18 16:33:22.066576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 18 16:33:22.066576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 18 16:33:22.066576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 18 16:33:22.067728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:22.067728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:22.067728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 18 16:33:22.067728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:33:22.067728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 18 16:33:22.067728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 18 16:33:22.067728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:22.067728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:22.067728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:22.067728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:22.067728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:22.067728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:22.067728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:22.067728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:22.067728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:22.067728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:22.067728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:22.067728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:22.068804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:22.068804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:22.068804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 18 16:33:22.068804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 18 16:33:22.068804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 18 16:33:22.068804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 18 16:33:22.068804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 18 16:33:22.068804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 18 16:33:22.068804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 18 16:33:22.068804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:22.068804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 645/1280] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:33:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:22.073784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04ac3e-cdbb-490e-a50b-a66200ca207f None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:22.078218 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:22.180110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04ac3e-cdbb-490e-a50b-a66200ca207f None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:22.218778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7523c-b329-4ed2-be3e-3dea19cf9df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:22.219398 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7523c-b329-4ed2-be3e-3dea19cf9df0 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:22.219685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7523c-b329-4ed2-be3e-3dea19cf9df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:22.219962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce7523c-b329-4ed2-be3e-3dea19cf9df0 None admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:22.220816 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7523c-b329-4ed2-be3e-3dea19cf9df0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:22.221158 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7523c-b329-4ed2-be3e-3dea19cf9df0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:22.222599 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce7523c-b329-4ed2-be3e-3dea19cf9df0 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:22.241805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 636/1281] 10.222.0.76 () {56 vars in 1143 bytes} [Mon Jul 18 16:33:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:33:22.248067 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8a7db-7d24-48c0-a18d-02a20268ef51 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:22.339516 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:22.349352 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8a7db-7d24-48c0-a18d-02a20268ef51 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:22.382725 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413d2f1-1c93-4b67-b804-87605ff4e4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:22.383378 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413d2f1-1c93-4b67-b804-87605ff4e4f6 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:22.383666 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413d2f1-1c93-4b67-b804-87605ff4e4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:22.383935 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413d2f1-1c93-4b67-b804-87605ff4e4f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:22.454284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413d2f1-1c93-4b67-b804-87605ff4e4f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:22.455741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8413d2f1-1c93-4b67-b804-87605ff4e4f6 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:22.546684 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:22.557173 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 646/1282] 10.222.0.76 () {58 vars in 1282 bytes} [Mon Jul 18 16:33:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 18 16:33:22.563631 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7523c-b329-4ed2-be3e-3dea19cf9df0 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:22.628022 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:22.670448 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce7523c-b329-4ed2-be3e-3dea19cf9df0 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:22.703144 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b195b-9ef0-4209-9268-92757d80fb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:22.703938 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b195b-9ef0-4209-9268-92757d80fb87 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:22.704224 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b195b-9ef0-4209-9268-92757d80fb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:22.704515 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b195b-9ef0-4209-9268-92757d80fb87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:22.716182 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b195b-9ef0-4209-9268-92757d80fb87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:22.717674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b195b-9ef0-4209-9268-92757d80fb87 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:22.734823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-b17b195b-9ef0-4209-9268-92757d80fb87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:22.734823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:22.734823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:22.734823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:22.734823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:22.734823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:22.734823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:22.734823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:22.734823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:22.734823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:22.734823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:22.734823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:22.734823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 18 16:33:22.734823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 18 16:33:22.734823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 18 16:33:22.735964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 18 16:33:22.735964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:22.735964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:22.735964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:22.735964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:22.735964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:22.735964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:22.735964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:22.735964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:22.735964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:22.735964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:22.735964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:22.735964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:22.735964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:22.735964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:22.735964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:22.735964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:22.737461 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 18 16:33:22.737461 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 18 16:33:22.737461 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 18 16:33:22.737461 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:33:22.737461 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 637/1283] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:33:22.742175 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413d2f1-1c93-4b67-b804-87605ff4e4f6 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:22.839122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413d2f1-1c93-4b67-b804-87605ff4e4f6 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:22.873100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b1ad2-bd52-4f05-a40e-6c22d753d9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:22.873765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b1ad2-bd52-4f05-a40e-6c22d753d9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:22.874046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b1ad2-bd52-4f05-a40e-6c22d753d9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:22.874320 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b1ad2-bd52-4f05-a40e-6c22d753d9d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:22.875034 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b1ad2-bd52-4f05-a40e-6c22d753d9d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:22.875338 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b1ad2-bd52-4f05-a40e-6c22d753d9d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:22.876700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b1ad2-bd52-4f05-a40e-6c22d753d9d9 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:22.888346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 647/1284] 10.222.0.76 () {56 vars in 1109 bytes} [Mon Jul 18 16:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:22.899878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b195b-9ef0-4209-9268-92757d80fb87 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:22.997471 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b195b-9ef0-4209-9268-92757d80fb87 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:23.031510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de97e7-c77f-4ceb-a01c-d423055430f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:23.032317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de97e7-c77f-4ceb-a01c-d423055430f2 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:23.032602 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de97e7-c77f-4ceb-a01c-d423055430f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:23.032883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90de97e7-c77f-4ceb-a01c-d423055430f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:23.039546 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de97e7-c77f-4ceb-a01c-d423055430f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:23.040995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90de97e7-c77f-4ceb-a01c-d423055430f2 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:23.055371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application [None req-90de97e7-c77f-4ceb-a01c-d423055430f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:33:23.055371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:23.055371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:23.055371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:23.055371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:23.055371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:23.055371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:23.055371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:23.055371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:23.055371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:23.055371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:23.055371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:23.055371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 18 16:33:23.055371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 18 16:33:23.055371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 18 16:33:23.056440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 18 16:33:23.056440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:23.056440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:23.056440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:23.056440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:23.056440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:23.056440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:23.056440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:23.056440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:23.056440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:23.056440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:23.056440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:23.056440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:23.056440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:23.056440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:23.056440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:23.056440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:23.062788 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 18 16:33:23.062788 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 18 16:33:23.062788 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 18 16:33:23.062788 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 18 16:33:23.062788 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 18 16:33:23.062788 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 18 16:33:23.062788 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 18 16:33:23.062788 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: ERROR keystone.server.flask.application Jul 18 16:33:23.062788 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 638/1285] 10.222.0.76 () {56 vars in 1111 bytes} [Mon Jul 18 16:33:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:23.063395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b1ad2-bd52-4f05-a40e-6c22d753d9d9 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:23.117233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:23.118142 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:23.168871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b1ad2-bd52-4f05-a40e-6c22d753d9d9 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:23.203918 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6aa0a-d868-4718-9c52-be47a1f5ed74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:23.204586 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6aa0a-d868-4718-9c52-be47a1f5ed74 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:23.204870 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6aa0a-d868-4718-9c52-be47a1f5ed74 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:23.205185 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6aa0a-d868-4718-9c52-be47a1f5ed74 None admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:23.205975 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6aa0a-d868-4718-9c52-be47a1f5ed74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:23.206282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6aa0a-d868-4718-9c52-be47a1f5ed74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:23.207776 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6aa0a-d868-4718-9c52-be47a1f5ed74 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:23.220208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 648/1286] 10.222.0.76 () {56 vars in 1148 bytes} [Mon Jul 18 16:33:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:23.226429 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de97e7-c77f-4ceb-a01c-d423055430f2 None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:23.328872 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90de97e7-c77f-4ceb-a01c-d423055430f2 None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:23.363280 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76234fe1-82cf-4049-8fcf-f7c8f3eebcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:23.363946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76234fe1-82cf-4049-8fcf-f7c8f3eebcaa None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:23.364237 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76234fe1-82cf-4049-8fcf-f7c8f3eebcaa None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:23.364519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76234fe1-82cf-4049-8fcf-f7c8f3eebcaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:23.365397 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76234fe1-82cf-4049-8fcf-f7c8f3eebcaa None admin] RBAC: Adding query filter params (role.id=c2d5d80485df4730903a874937d68aa3, scope.project.id=30a4824228ec47519a01574d82879b25, user.id=9c8d6afb4ccd41a5972e3241a3eebc7e) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:23.365713 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76234fe1-82cf-4049-8fcf-f7c8f3eebcaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:23.367157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76234fe1-82cf-4049-8fcf-f7c8f3eebcaa None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:23.374286 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 639/1287] 10.222.0.76 () {56 vars in 1374 bytes} [Mon Jul 18 16:33:23 2022] GET /identity/v3/role_assignments?user.id=9c8d6afb4ccd41a5972e3241a3eebc7e&scope.project.id=30a4824228ec47519a01574d82879b25&role.id=c2d5d80485df4730903a874937d68aa3 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:25.462753 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7752e1-ce11-4ae0-814d-9cd8a8b4f7a3 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:25.463271 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7752e1-ce11-4ae0-814d-9cd8a8b4f7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:25.463271 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7752e1-ce11-4ae0-814d-9cd8a8b4f7a3 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:25.464626 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 649/1288] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:33:25.470621 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e99bf4-70f0-4fbb-83ce-6e20d1db9b82 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:25.471078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e99bf4-70f0-4fbb-83ce-6e20d1db9b82 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:25.471176 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e99bf4-70f0-4fbb-83ce-6e20d1db9b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:25.488742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-09e99bf4-70f0-4fbb-83ce-6e20d1db9b82 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:33:25.489977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-09e99bf4-70f0-4fbb-83ce-6e20d1db9b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:33:25.519618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:25.556809 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 640/1289] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:33:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:33:25.579087 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7752e1-ce11-4ae0-814d-9cd8a8b4f7a3 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:25.680553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7752e1-ce11-4ae0-814d-9cd8a8b4f7a3 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:25.692302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:25.715409 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfe725-0e00-4665-86bf-6666807d0453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:25.716289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfe725-0e00-4665-86bf-6666807d0453 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:25.716571 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfe725-0e00-4665-86bf-6666807d0453 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:25.716846 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebfe725-0e00-4665-86bf-6666807d0453 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:25.717532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfe725-0e00-4665-86bf-6666807d0453 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:25.718892 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebfe725-0e00-4665-86bf-6666807d0453 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:25.731082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-9ebfe725-0e00-4665-86bf-6666807d0453 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 16:33:25.731082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:25.731082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:33:25.731082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:33:25.731082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:33:25.731082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:33:25.731082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:33:25.731082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:33:25.731082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 16:33:25.731082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:25.731082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:33:25.731082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:25.731082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:25.731082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:25.731082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:25.731082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:25.731082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:25.732355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:25.732355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:25.732355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:25.732355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:25.732355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:25.732355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:25.732355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:33:25.732355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:33:25.732355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:33:25.732355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:33:25.732355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:25.732355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:25.732355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:25.732355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:25.732355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:25.732355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:25.733823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:25.733823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:25.733823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:25.733823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:25.733823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:25.733823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:25.733823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:25.733823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:25.733823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:25.733823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:25.733823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:33:25.733823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:33:25.733823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 16:33:25.733823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:25.733823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 650/1290] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Jul 18 16:33:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:25.738688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e99bf4-70f0-4fbb-83ce-6e20d1db9b82 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:25.843241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e99bf4-70f0-4fbb-83ce-6e20d1db9b82 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:25.879572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714faa7-29d5-4490-9e74-aeba0ab9ea8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:25.880251 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714faa7-29d5-4490-9e74-aeba0ab9ea8f None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:25.880538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714faa7-29d5-4490-9e74-aeba0ab9ea8f None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:25.880818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714faa7-29d5-4490-9e74-aeba0ab9ea8f None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:25.881574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714faa7-29d5-4490-9e74-aeba0ab9ea8f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:25.881903 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714faa7-29d5-4490-9e74-aeba0ab9ea8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:25.883269 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714faa7-29d5-4490-9e74-aeba0ab9ea8f None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:25.888970 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 641/1291] 10.222.0.76 () {56 vars in 1116 bytes} [Mon Jul 18 16:33:25 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:25.894688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfe725-0e00-4665-86bf-6666807d0453 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:25.995669 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebfe725-0e00-4665-86bf-6666807d0453 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:26.029422 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0825db60-e30c-4da1-adb0-fbab9ca32a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:26.030090 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825db60-e30c-4da1-adb0-fbab9ca32a97 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:26.030374 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825db60-e30c-4da1-adb0-fbab9ca32a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:26.030649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0825db60-e30c-4da1-adb0-fbab9ca32a97 None admin] PATH_INFO: `/v3/services` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:26.031358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825db60-e30c-4da1-adb0-fbab9ca32a97 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:26.031659 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825db60-e30c-4da1-adb0-fbab9ca32a97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:26.033050 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0825db60-e30c-4da1-adb0-fbab9ca32a97 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:26.037593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 651/1292] 10.222.0.76 () {56 vars in 1116 bytes} [Mon Jul 18 16:33:25 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:28.072160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71a143-61b4-49ee-b6ea-78d3fcd12e18 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:28.072693 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71a143-61b4-49ee-b6ea-78d3fcd12e18 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:28.072808 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d71a143-61b4-49ee-b6ea-78d3fcd12e18 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:28.074175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 642/1293] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:33:28.079987 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcdc85-89c8-4779-83f6-34e8db0378ba None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:28.080433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcdc85-89c8-4779-83f6-34e8db0378ba None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:28.080537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcdc85-89c8-4779-83f6-34e8db0378ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:28.097629 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-26bcdc85-89c8-4779-83f6-34e8db0378ba None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:33:28.098868 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-26bcdc85-89c8-4779-83f6-34e8db0378ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:33:28.131264 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:28.170290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 652/1294] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:33:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:33:28.193177 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71a143-61b4-49ee-b6ea-78d3fcd12e18 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:28.225852 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:28.300072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d71a143-61b4-49ee-b6ea-78d3fcd12e18 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:28.337618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99df2d81-1994-4161-9361-ebac0eefbd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:28.337618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df2d81-1994-4161-9361-ebac0eefbd88 None admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:28.337618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df2d81-1994-4161-9361-ebac0eefbd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:28.337618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99df2d81-1994-4161-9361-ebac0eefbd88 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:28.338113 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df2d81-1994-4161-9361-ebac0eefbd88 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:28.338113 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99df2d81-1994-4161-9361-ebac0eefbd88 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:28.432673 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 643/1295] 10.222.0.76 () {60 vars in 1141 bytes} [Mon Jul 18 16:33:28 2022] POST /identity/v3/services => generated 246 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:33:30.483035 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fea46-5d32-407b-9498-102a0673c6f4 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:30.483536 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fea46-5d32-407b-9498-102a0673c6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:30.483536 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114fea46-5d32-407b-9498-102a0673c6f4 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:30.484882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 653/1296] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:33:30.490545 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee5374-bc59-49c2-974a-0a23738d556f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:30.491015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee5374-bc59-49c2-974a-0a23738d556f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:30.491126 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ee5374-bc59-49c2-974a-0a23738d556f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:30.507884 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-47ee5374-bc59-49c2-974a-0a23738d556f None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:33:30.516451 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-47ee5374-bc59-49c2-974a-0a23738d556f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:33:30.583190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 644/1297] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:33:30 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 18 16:33:30.605774 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fea46-5d32-407b-9498-102a0673c6f4 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:30.708151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114fea46-5d32-407b-9498-102a0673c6f4 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:30.743388 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f1573-fc9b-4086-9d76-10ae42a15936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:30.744126 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f1573-fc9b-4086-9d76-10ae42a15936 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:30.744413 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f1573-fc9b-4086-9d76-10ae42a15936 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:30.744690 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f1573-fc9b-4086-9d76-10ae42a15936 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:30.745376 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f1573-fc9b-4086-9d76-10ae42a15936 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:30.747477 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f1573-fc9b-4086-9d76-10ae42a15936 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:30.759484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-363f1573-fc9b-4086-9d76-10ae42a15936 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 16:33:30.759484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:30.759484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:33:30.759484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:33:30.759484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:33:30.759484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:33:30.759484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:33:30.759484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:33:30.759484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 16:33:30.759484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:30.759484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:33:30.759484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:30.759484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:30.759484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:30.759484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:30.759484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:30.759484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:30.760698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:30.760698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:30.760698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:30.760698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:30.760698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:30.760698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:30.760698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:33:30.760698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:33:30.760698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:33:30.760698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:33:30.760698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:30.760698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:30.760698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:30.760698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:30.760698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:30.760698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:30.761656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:30.761656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:30.761656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:30.761656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:30.761656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:30.761656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:30.761656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:30.761656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:30.761656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:30.761656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:30.761656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:33:30.761656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:33:30.761656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 16:33:30.761656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:30.761656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 654/1298] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Jul 18 16:33:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 18 16:33:30.767710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee5374-bc59-49c2-974a-0a23738d556f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:30.786183 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:30.867468 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ee5374-bc59-49c2-974a-0a23738d556f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:30.902290 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d1590-13d6-4347-8c50-4718b0aefbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:30.902991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d1590-13d6-4347-8c50-4718b0aefbda None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:30.903273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d1590-13d6-4347-8c50-4718b0aefbda None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:30.903544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28d1590-13d6-4347-8c50-4718b0aefbda None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:30.904336 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d1590-13d6-4347-8c50-4718b0aefbda None admin] RBAC: Adding query filter params (name=placement) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:30.904642 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d1590-13d6-4347-8c50-4718b0aefbda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:30.906057 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28d1590-13d6-4347-8c50-4718b0aefbda None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:30.911027 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 645/1299] 10.222.0.76 () {56 vars in 1116 bytes} [Mon Jul 18 16:33:30 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:30.917036 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f1573-fc9b-4086-9d76-10ae42a15936 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:30.949037 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:31.020582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f1573-fc9b-4086-9d76-10ae42a15936 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:31.053267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec253e69-6946-48a9-b857-fc0ffcdbc57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:31.054045 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec253e69-6946-48a9-b857-fc0ffcdbc57d None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:31.054325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec253e69-6946-48a9-b857-fc0ffcdbc57d None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:31.054598 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec253e69-6946-48a9-b857-fc0ffcdbc57d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:31.055383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec253e69-6946-48a9-b857-fc0ffcdbc57d None admin] RBAC: Adding query filter params (interface=public, service_id=6ecd91dd325c40a89b7944fb6b0bdaf3, region_id=RegionOne) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:31.055693 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec253e69-6946-48a9-b857-fc0ffcdbc57d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:31.057070 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec253e69-6946-48a9-b857-fc0ffcdbc57d None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:31.062710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 655/1300] 10.222.0.76 () {56 vars in 1251 bytes} [Mon Jul 18 16:33:30 2022] GET /identity/v3/endpoints?service_id=6ecd91dd325c40a89b7944fb6b0bdaf3&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:33:31.068491 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d1590-13d6-4347-8c50-4718b0aefbda None admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:31.153182 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:31.171323 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28d1590-13d6-4347-8c50-4718b0aefbda None admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:31.205484 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368331e-a46f-47c6-ad46-76bdd8ecb614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:31.206159 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368331e-a46f-47c6-ad46-76bdd8ecb614 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:31.206446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368331e-a46f-47c6-ad46-76bdd8ecb614 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:31.206726 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368331e-a46f-47c6-ad46-76bdd8ecb614 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:31.207412 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368331e-a46f-47c6-ad46-76bdd8ecb614 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:31.208832 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368331e-a46f-47c6-ad46-76bdd8ecb614 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:31.215895 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 646/1301] 10.222.0.76 () {56 vars in 1087 bytes} [Mon Jul 18 16:33:31 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:33:33.249643 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f05134-0d56-498e-9f3c-c9c19e1e8161 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:33.250159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f05134-0d56-498e-9f3c-c9c19e1e8161 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:33.250281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f05134-0d56-498e-9f3c-c9c19e1e8161 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:33.251616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 656/1302] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:33:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:33:33.256895 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2573da6-98a2-473e-80d3-3a35ecb04a73 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:33.257376 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2573da6-98a2-473e-80d3-3a35ecb04a73 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:33.257495 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2573da6-98a2-473e-80d3-3a35ecb04a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:33.274480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c2573da6-98a2-473e-80d3-3a35ecb04a73 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:33:33.275665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c2573da6-98a2-473e-80d3-3a35ecb04a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:33:33.342830 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 647/1303] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:33:33 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 18 16:33:33.366517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f05134-0d56-498e-9f3c-c9c19e1e8161 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:33.466569 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:33.473608 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f05134-0d56-498e-9f3c-c9c19e1e8161 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:33.508674 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2d4fc-8665-4884-80e9-68558851a778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:33.509551 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2d4fc-8665-4884-80e9-68558851a778 None admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:33.509840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2d4fc-8665-4884-80e9-68558851a778 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:33.510222 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2d4fc-8665-4884-80e9-68558851a778 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:33.510998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2d4fc-8665-4884-80e9-68558851a778 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:33.512437 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2d4fc-8665-4884-80e9-68558851a778 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:33.524302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application [None req-11e2d4fc-8665-4884-80e9-68558851a778 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 16:33:33.524302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:33.524302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 18 16:33:33.524302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 18 16:33:33.524302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 18 16:33:33.524302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 18 16:33:33.524302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 18 16:33:33.524302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:33:33.524302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 16:33:33.524302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:33.524302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 18 16:33:33.524302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:33.524302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 18 16:33:33.524302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 18 16:33:33.524302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 18 16:33:33.524302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 18 16:33:33.524302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 18 16:33:33.525592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 18 16:33:33.525592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 18 16:33:33.525592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 18 16:33:33.525592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 18 16:33:33.525592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 18 16:33:33.525592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 18 16:33:33.525592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 18 16:33:33.525592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 18 16:33:33.525592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 18 16:33:33.525592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 18 16:33:33.525592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 18 16:33:33.525592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 18 16:33:33.525592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 18 16:33:33.525592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 18 16:33:33.525592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 18 16:33:33.525592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.get_or_create( Jul 18 16:33:33.526712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 18 16:33:33.526712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application with Lock( Jul 18 16:33:33.526712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 18 16:33:33.526712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self._enter() Jul 18 16:33:33.526712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 18 16:33:33.526712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 18 16:33:33.526712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 18 16:33:33.526712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application return self.creator() Jul 18 16:33:33.526712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 18 16:33:33.526712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application created_value = creator( Jul 18 16:33:33.526712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 18 16:33:33.526712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 18 16:33:33.526712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 18 16:33:33.526712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: ERROR keystone.server.flask.application Jul 18 16:33:33.526712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 657/1304] 10.222.0.76 () {56 vars in 1117 bytes} [Mon Jul 18 16:33:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 18 16:33:33.531903 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2573da6-98a2-473e-80d3-3a35ecb04a73 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:33.611656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:33.635615 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2573da6-98a2-473e-80d3-3a35ecb04a73 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:33.670059 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f75e0-5686-4bf5-9f82-c6fb1f385ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:33.670747 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f75e0-5686-4bf5-9f82-c6fb1f385ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:33.670747 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f75e0-5686-4bf5-9f82-c6fb1f385ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:33.670747 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f75e0-5686-4bf5-9f82-c6fb1f385ad8 None admin] PATH_INFO: `/v3/services` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:33.670747 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f75e0-5686-4bf5-9f82-c6fb1f385ad8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:33:33.670747 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f75e0-5686-4bf5-9f82-c6fb1f385ad8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:33.670747 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f75e0-5686-4bf5-9f82-c6fb1f385ad8 None admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:33.679272 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 648/1305] 10.222.0.76 () {56 vars in 1116 bytes} [Mon Jul 18 16:33:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:33:33.686638 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2d4fc-8665-4884-80e9-68558851a778 None admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:33:33.790718 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2d4fc-8665-4884-80e9-68558851a778 None admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:33:33.828108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925d3e4e-2439-40f5-94e6-27e006c13159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:33:33.828768 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d3e4e-2439-40f5-94e6-27e006c13159 None admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:33:33.829070 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d3e4e-2439-40f5-94e6-27e006c13159 None admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:33:33.829346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d3e4e-2439-40f5-94e6-27e006c13159 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:33:33.830149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d3e4e-2439-40f5-94e6-27e006c13159 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:33:33.831538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925d3e4e-2439-40f5-94e6-27e006c13159 None admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:33:33.964132 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 658/1306] 10.222.0.76 () {60 vars in 1144 bytes} [Mon Jul 18 16:33:33 2022] POST /identity/v3/endpoints => generated 331 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:33:43.676176 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=30 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:33:43.959317 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:01.470687 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f5038-c5fb-4d2d-971f-83da70e7e253 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:01.471930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f5038-c5fb-4d2d-971f-83da70e7e253 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:01.472366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012f5038-c5fb-4d2d-971f-83da70e7e253 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:01.475279 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 649/1307] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:42:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:01.480828 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db11e9-9322-4ee1-86fa-867c255119a3 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:01.481359 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db11e9-9322-4ee1-86fa-867c255119a3 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:01.481649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db11e9-9322-4ee1-86fa-867c255119a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:01.661347 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-42db11e9-9322-4ee1-86fa-867c255119a3 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:01.662689 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-42db11e9-9322-4ee1-86fa-867c255119a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:01.856424 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 659/1308] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:01.947033 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224bae1-51c8-4d93-a3d6-690e0109ed23 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:01.947837 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224bae1-51c8-4d93-a3d6-690e0109ed23 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:01.948748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9224bae1-51c8-4d93-a3d6-690e0109ed23 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:01.952292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 650/1309] 10.222.0.76 () {54 vars in 965 bytes} [Mon Jul 18 16:42:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:01.959543 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a26afd-39dd-4450-840a-9c9ef15695ed None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:01.959841 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a26afd-39dd-4450-840a-9c9ef15695ed None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:01.960130 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a26afd-39dd-4450-840a-9c9ef15695ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:02.108972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-31a26afd-39dd-4450-840a-9c9ef15695ed None None] MFA Rules not processed for user `e9dcca05df70446090cd525c0644cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:02.110922 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-31a26afd-39dd-4450-840a-9c9ef15695ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:02.135576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:02.226280 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 660/1310] 10.222.0.76 () {58 vars in 1062 bytes} [Mon Jul 18 16:42:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:02.236055 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224bae1-51c8-4d93-a3d6-690e0109ed23 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:02.237856 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9224bae1-51c8-4d93-a3d6-690e0109ed23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:02.423809 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9224bae1-51c8-4d93-a3d6-690e0109ed23 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:02.512408 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4039b7-a898-49be-a630-57edd75bc7a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:02.513160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4039b7-a898-49be-a630-57edd75bc7a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:02.513395 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4039b7-a898-49be-a630-57edd75bc7a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:02.513673 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4039b7-a898-49be-a630-57edd75bc7a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:02.515374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cc4039b7-a898-49be-a630-57edd75bc7a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:02.575674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:02.644327 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4039b7-a898-49be-a630-57edd75bc7a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:02.645824 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4039b7-a898-49be-a630-57edd75bc7a0 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:02.669322 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 651/1311] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:05.135025 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0286c8f-99b9-4fb1-a302-4181614cd73f None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:05.135603 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0286c8f-99b9-4fb1-a302-4181614cd73f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:05.135603 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0286c8f-99b9-4fb1-a302-4181614cd73f None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:05.137001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 661/1312] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:05.144124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c7aac-31e5-43b6-a089-8d4292539f86 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:05.144676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c7aac-31e5-43b6-a089-8d4292539f86 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:05.144676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c7aac-31e5-43b6-a089-8d4292539f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:05.237673 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-729c7aac-31e5-43b6-a089-8d4292539f86 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:05.238918 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-729c7aac-31e5-43b6-a089-8d4292539f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:05.380000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 652/1313] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:42:05.428930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0286c8f-99b9-4fb1-a302-4181614cd73f None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:05.430550 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d0286c8f-99b9-4fb1-a302-4181614cd73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:05.544694 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0286c8f-99b9-4fb1-a302-4181614cd73f None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:05.623276 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:05.626388 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491b0c4-6c97-4db4-8539-4a685abeac29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:05.627052 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491b0c4-6c97-4db4-8539-4a685abeac29 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:05.627337 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491b0c4-6c97-4db4-8539-4a685abeac29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:05.627620 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491b0c4-6c97-4db4-8539-4a685abeac29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:05.629322 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c491b0c4-6c97-4db4-8539-4a685abeac29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:05.749315 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491b0c4-6c97-4db4-8539-4a685abeac29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:05.751686 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491b0c4-6c97-4db4-8539-4a685abeac29 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:05.773497 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 662/1314] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:42:08.386985 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc42583-acc1-4313-ac25-f313b5428c64 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:08.387515 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc42583-acc1-4313-ac25-f313b5428c64 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:08.387607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc42583-acc1-4313-ac25-f313b5428c64 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:08.388998 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 653/1315] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:42:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:08.394698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64d067-efdd-40f5-a681-dafcd1908077 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:08.395132 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64d067-efdd-40f5-a681-dafcd1908077 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:08.395265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64d067-efdd-40f5-a681-dafcd1908077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:08.461192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-9f64d067-efdd-40f5-a681-dafcd1908077 None None] MFA Rules not processed for user `99906ed469184f2280ab4490ea782efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:08.462360 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9f64d067-efdd-40f5-a681-dafcd1908077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:08.515195 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:08.564107 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 663/1316] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:42:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:08.610113 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc42583-acc1-4313-ac25-f313b5428c64 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:08.611647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-edc42583-acc1-4313-ac25-f313b5428c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:08.622109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:08.716435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc42583-acc1-4313-ac25-f313b5428c64 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:08.796837 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5112d23e-02e0-4374-ab5d-b22e545b4ed9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:08.799440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112d23e-02e0-4374-ab5d-b22e545b4ed9 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:08.799725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112d23e-02e0-4374-ab5d-b22e545b4ed9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:08.800014 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5112d23e-02e0-4374-ab5d-b22e545b4ed9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:08.801793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5112d23e-02e0-4374-ab5d-b22e545b4ed9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:08.878159 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:08.926902 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112d23e-02e0-4374-ab5d-b22e545b4ed9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:08.928342 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5112d23e-02e0-4374-ab5d-b22e545b4ed9 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:08.946709 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 654/1317] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:11.860049 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618692b-eaae-418a-8e4b-3239f52bf67b None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:11.860607 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618692b-eaae-418a-8e4b-3239f52bf67b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:11.860607 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618692b-eaae-418a-8e4b-3239f52bf67b None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:11.862075 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 664/1318] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:42:11.867807 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab917856-8a15-4ee4-ab6b-0a07ca10242c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:11.868217 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab917856-8a15-4ee4-ab6b-0a07ca10242c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:11.872570 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab917856-8a15-4ee4-ab6b-0a07ca10242c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:11.935566 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ab917856-8a15-4ee4-ab6b-0a07ca10242c None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:11.936690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ab917856-8a15-4ee4-ab6b-0a07ca10242c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:12.034475 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 655/1319] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:42:11 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:12.074304 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618692b-eaae-418a-8e4b-3239f52bf67b None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:12.075877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0618692b-eaae-418a-8e4b-3239f52bf67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:12.183191 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618692b-eaae-418a-8e4b-3239f52bf67b None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:12.257561 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f481c3a-1258-44ef-9a34-71a6b825de40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:12.258141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f481c3a-1258-44ef-9a34-71a6b825de40 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:12.258420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f481c3a-1258-44ef-9a34-71a6b825de40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:12.258693 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f481c3a-1258-44ef-9a34-71a6b825de40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:12.260336 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0f481c3a-1258-44ef-9a34-71a6b825de40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:12.268521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:12.376933 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f481c3a-1258-44ef-9a34-71a6b825de40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:12.378430 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f481c3a-1258-44ef-9a34-71a6b825de40 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:12.396745 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 665/1320] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:15.597889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1f7b1-4bb3-4299-990c-5a37a615c236 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:15.598430 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1f7b1-4bb3-4299-990c-5a37a615c236 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:15.598430 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e1f7b1-4bb3-4299-990c-5a37a615c236 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:15.599821 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 656/1321] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:15.606721 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99ebf0-e3df-4058-9bb5-be3a5c24da66 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:15.607209 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99ebf0-e3df-4058-9bb5-be3a5c24da66 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:15.607311 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99ebf0-e3df-4058-9bb5-be3a5c24da66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:15.675821 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-fb99ebf0-e3df-4058-9bb5-be3a5c24da66 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:15.676611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fb99ebf0-e3df-4058-9bb5-be3a5c24da66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:15.736731 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:15.778992 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 666/1322] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:15.816020 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1f7b1-4bb3-4299-990c-5a37a615c236 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:15.817662 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-42e1f7b1-4bb3-4299-990c-5a37a615c236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:15.840831 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:15.957246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e1f7b1-4bb3-4299-990c-5a37a615c236 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:16.064589 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71be1201-a93a-456b-bb94-ce29ea1c77a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:16.065531 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be1201-a93a-456b-bb94-ce29ea1c77a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:16.065818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be1201-a93a-456b-bb94-ce29ea1c77a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:16.066180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be1201-a93a-456b-bb94-ce29ea1c77a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:16.068695 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-71be1201-a93a-456b-bb94-ce29ea1c77a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:16.155919 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:16.206335 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be1201-a93a-456b-bb94-ce29ea1c77a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:16.207858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71be1201-a93a-456b-bb94-ce29ea1c77a8 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:16.228310 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 657/1323] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:18.386144 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dfeb6-84b3-423c-b4e4-926a80b5002d None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:18.386717 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dfeb6-84b3-423c-b4e4-926a80b5002d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:18.386717 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dfeb6-84b3-423c-b4e4-926a80b5002d None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:18.388252 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 667/1324] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:18.393880 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e6ba1-53ae-42e8-a512-dbe810b57eb0 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:18.394343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e6ba1-53ae-42e8-a512-dbe810b57eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:18.394524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e6ba1-53ae-42e8-a512-dbe810b57eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:18.462848 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-455e6ba1-53ae-42e8-a512-dbe810b57eb0 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:18.463991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-455e6ba1-53ae-42e8-a512-dbe810b57eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:18.566952 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 658/1325] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:18.607802 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dfeb6-84b3-423c-b4e4-926a80b5002d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:18.609987 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8f0dfeb6-84b3-423c-b4e4-926a80b5002d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:18.717747 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dfeb6-84b3-423c-b4e4-926a80b5002d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:18.794553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918c55b-a0d2-4ec7-9737-4b39da406ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:18.795216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918c55b-a0d2-4ec7-9737-4b39da406ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:18.795500 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918c55b-a0d2-4ec7-9737-4b39da406ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:18.795775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918c55b-a0d2-4ec7-9737-4b39da406ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:18.798343 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5918c55b-a0d2-4ec7-9737-4b39da406ff2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:18.817991 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:18.923373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918c55b-a0d2-4ec7-9737-4b39da406ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:18.924856 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918c55b-a0d2-4ec7-9737-4b39da406ff2 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:18.946257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 668/1326] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:21.039672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f68d06-ecae-45b9-8f76-b6d713d6773f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:21.040261 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f68d06-ecae-45b9-8f76-b6d713d6773f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:21.040261 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f68d06-ecae-45b9-8f76-b6d713d6773f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:21.041697 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 659/1327] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:21.048493 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf78dc-776e-4e26-80c1-3d18ff3f35b0 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:21.049073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf78dc-776e-4e26-80c1-3d18ff3f35b0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:21.049173 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf78dc-776e-4e26-80c1-3d18ff3f35b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:21.118444 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-1ecf78dc-776e-4e26-80c1-3d18ff3f35b0 None None] MFA Rules not processed for user `99906ed469184f2280ab4490ea782efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:21.119951 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1ecf78dc-776e-4e26-80c1-3d18ff3f35b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:21.188124 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:21.225754 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 669/1328] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:42:21 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:21.283785 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f96af4-446f-44cc-b823-943d0599d7cb None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:21.284079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f96af4-446f-44cc-b823-943d0599d7cb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:21.284359 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f96af4-446f-44cc-b823-943d0599d7cb None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:21.285924 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 660/1329] 10.222.0.76 () {54 vars in 965 bytes} [Mon Jul 18 16:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:21.292727 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b425a-2d51-43e5-8164-9eb5473530b1 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:21.293040 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b425a-2d51-43e5-8164-9eb5473530b1 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:21.293392 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b425a-2d51-43e5-8164-9eb5473530b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:21.375568 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-844b425a-2d51-43e5-8164-9eb5473530b1 None None] MFA Rules not processed for user `e9dcca05df70446090cd525c0644cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:21.376791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-844b425a-2d51-43e5-8164-9eb5473530b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:21.453808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 670/1330] 10.222.0.76 () {58 vars in 1062 bytes} [Mon Jul 18 16:42:21 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:21.462896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f96af4-446f-44cc-b823-943d0599d7cb None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:21.464416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-36f96af4-446f-44cc-b823-943d0599d7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:21.496740 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:21.581053 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f96af4-446f-44cc-b823-943d0599d7cb None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:21.663389 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a4eeb-d16a-46b5-9151-26152c0f031a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:21.664046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a4eeb-d16a-46b5-9151-26152c0f031a service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:21.664338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a4eeb-d16a-46b5-9151-26152c0f031a service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:21.664620 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a4eeb-d16a-46b5-9151-26152c0f031a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:21.666327 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cb9a4eeb-d16a-46b5-9151-26152c0f031a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:21.775993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:21.830198 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a4eeb-d16a-46b5-9151-26152c0f031a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:21.830198 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a4eeb-d16a-46b5-9151-26152c0f031a service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:21.841478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 661/1331] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:24.831179 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bdcd7-c127-4610-a931-3215e5cbc867 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:24.831783 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bdcd7-c127-4610-a931-3215e5cbc867 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:24.831783 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042bdcd7-c127-4610-a931-3215e5cbc867 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:24.833203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 671/1332] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:24.838337 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e6223-5918-4f1a-8a64-083ae532764e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:24.838819 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e6223-5918-4f1a-8a64-083ae532764e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:24.838916 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e6223-5918-4f1a-8a64-083ae532764e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:24.907891 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9a3e6223-5918-4f1a-8a64-083ae532764e None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:24.909563 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9a3e6223-5918-4f1a-8a64-083ae532764e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:25.008950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 662/1333] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:25.044948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bdcd7-c127-4610-a931-3215e5cbc867 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:25.047108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-042bdcd7-c127-4610-a931-3215e5cbc867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:25.118127 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:25.153433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042bdcd7-c127-4610-a931-3215e5cbc867 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:25.229139 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b9711-2cbc-4df8-a6ae-e6c9738b6f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:25.229794 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b9711-2cbc-4df8-a6ae-e6c9738b6f75 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:25.230078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b9711-2cbc-4df8-a6ae-e6c9738b6f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:25.230357 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b9711-2cbc-4df8-a6ae-e6c9738b6f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:25.232021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a23b9711-2cbc-4df8-a6ae-e6c9738b6f75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:25.347208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b9711-2cbc-4df8-a6ae-e6c9738b6f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:25.348667 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b9711-2cbc-4df8-a6ae-e6c9738b6f75 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:25.358649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:25.367087 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 672/1334] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:27.476375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5e247-5958-4d7f-9e06-b42bd1ebd78d None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:27.476901 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5e247-5958-4d7f-9e06-b42bd1ebd78d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:27.476901 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf5e247-5958-4d7f-9e06-b42bd1ebd78d None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:27.478270 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 663/1335] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:42:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:27.484554 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13f405-8ae4-443e-9950-13eafdfc0a97 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:27.484999 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13f405-8ae4-443e-9950-13eafdfc0a97 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:27.485147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13f405-8ae4-443e-9950-13eafdfc0a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:27.549816 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-ca13f405-8ae4-443e-9950-13eafdfc0a97 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:27.551023 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ca13f405-8ae4-443e-9950-13eafdfc0a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:27.648863 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 673/1336] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:42:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:27.693562 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5e247-5958-4d7f-9e06-b42bd1ebd78d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:27.695124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7bf5e247-5958-4d7f-9e06-b42bd1ebd78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:27.739183 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:27.802927 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf5e247-5958-4d7f-9e06-b42bd1ebd78d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:27.876584 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed70f2-dab3-422a-a81f-7b4c6ce554d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:27.877275 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed70f2-dab3-422a-a81f-7b4c6ce554d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:27.877569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed70f2-dab3-422a-a81f-7b4c6ce554d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:27.877846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed70f2-dab3-422a-a81f-7b4c6ce554d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:27.879502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e8ed70f2-dab3-422a-a81f-7b4c6ce554d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:27.963561 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:27.990195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed70f2-dab3-422a-a81f-7b4c6ce554d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:27.991554 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed70f2-dab3-422a-a81f-7b4c6ce554d6 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:28.011584 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 664/1337] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:30.914580 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65985e-cebf-4c5e-8cf8-2414ebf566b1 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:30.915141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65985e-cebf-4c5e-8cf8-2414ebf566b1 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:30.915141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65985e-cebf-4c5e-8cf8-2414ebf566b1 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:30.916597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 674/1338] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:30.921983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f4441-1e53-49b2-b725-703039dc2be7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:30.922424 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f4441-1e53-49b2-b725-703039dc2be7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:30.922553 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f4441-1e53-49b2-b725-703039dc2be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:30.987175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-822f4441-1e53-49b2-b725-703039dc2be7 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:30.988390 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-822f4441-1e53-49b2-b725-703039dc2be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:31.085089 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 665/1339] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:42:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:31.122072 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65985e-cebf-4c5e-8cf8-2414ebf566b1 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:31.124190 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-eb65985e-cebf-4c5e-8cf8-2414ebf566b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:31.201248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:31.230652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65985e-cebf-4c5e-8cf8-2414ebf566b1 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:31.310515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfe2f7-aa74-402b-8740-fb7022739f86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:31.311741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfe2f7-aa74-402b-8740-fb7022739f86 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:31.312232 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfe2f7-aa74-402b-8740-fb7022739f86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:31.312720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfe2f7-aa74-402b-8740-fb7022739f86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:31.314419 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-26bfe2f7-aa74-402b-8740-fb7022739f86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:31.429252 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfe2f7-aa74-402b-8740-fb7022739f86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:31.430609 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfe2f7-aa74-402b-8740-fb7022739f86 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:31.449390 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 675/1340] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:31 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:35.848811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928c79e-6a8c-4772-bf64-7d3a7de930fb None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:35.849637 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928c79e-6a8c-4772-bf64-7d3a7de930fb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:35.849637 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6928c79e-6a8c-4772-bf64-7d3a7de930fb None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:35.850922 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 666/1341] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:35.856278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b785e2c-7f86-45c4-a795-a104b5b92fff None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:35.856753 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b785e2c-7f86-45c4-a795-a104b5b92fff None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:35.856842 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b785e2c-7f86-45c4-a795-a104b5b92fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:35.861226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:35.940210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-0b785e2c-7f86-45c4-a795-a104b5b92fff None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:35.941604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0b785e2c-7f86-45c4-a795-a104b5b92fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:36.048452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 676/1342] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:42:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:36.090295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928c79e-6a8c-4772-bf64-7d3a7de930fb None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:36.092232 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6928c79e-6a8c-4772-bf64-7d3a7de930fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:36.157937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:36.219263 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6928c79e-6a8c-4772-bf64-7d3a7de930fb None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:36.293889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2726b5f2-b867-4ce6-9767-77fd76b973ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:36.294548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726b5f2-b867-4ce6-9767-77fd76b973ca service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:36.294837 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726b5f2-b867-4ce6-9767-77fd76b973ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:36.295147 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2726b5f2-b867-4ce6-9767-77fd76b973ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:36.296801 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2726b5f2-b867-4ce6-9767-77fd76b973ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:36.391464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:36.408681 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726b5f2-b867-4ce6-9767-77fd76b973ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:36.410268 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2726b5f2-b867-4ce6-9767-77fd76b973ca service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:36.428973 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 667/1343] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:42:39.540793 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8067b3-0712-41b3-a023-73be150a2dd7 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:39.541387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8067b3-0712-41b3-a023-73be150a2dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:39.541387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8067b3-0712-41b3-a023-73be150a2dd7 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:39.542782 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 677/1344] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:39.548625 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd60f74-6b1e-4f04-be44-52043134b220 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:39.549124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd60f74-6b1e-4f04-be44-52043134b220 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:39.549295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd60f74-6b1e-4f04-be44-52043134b220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:39.618938 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-efd60f74-6b1e-4f04-be44-52043134b220 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:39.620060 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-efd60f74-6b1e-4f04-be44-52043134b220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:39.721485 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 668/1345] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:42:39 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:39.768756 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8067b3-0712-41b3-a023-73be150a2dd7 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:39.770391 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3f8067b3-0712-41b3-a023-73be150a2dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:39.862075 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:39.880896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8067b3-0712-41b3-a023-73be150a2dd7 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:39.960325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3051b-30c6-4f1e-9d94-69e9da8c1e41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:39.960990 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3051b-30c6-4f1e-9d94-69e9da8c1e41 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:39.961312 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3051b-30c6-4f1e-9d94-69e9da8c1e41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:39.961587 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3051b-30c6-4f1e-9d94-69e9da8c1e41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:39.963238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-74f3051b-30c6-4f1e-9d94-69e9da8c1e41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:40.084044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3051b-30c6-4f1e-9d94-69e9da8c1e41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:40.085712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3051b-30c6-4f1e-9d94-69e9da8c1e41 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:40.107439 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 678/1346] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:44.416532 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70f641-efd6-4429-9a20-d86dda33515f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:44.417078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70f641-efd6-4429-9a20-d86dda33515f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:44.417197 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad70f641-efd6-4429-9a20-d86dda33515f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:44.418536 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 669/1347] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:44.424734 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a0b90-1591-4d49-871b-fc3f8b10269a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:44.425274 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a0b90-1591-4d49-871b-fc3f8b10269a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:44.425368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6a0b90-1591-4d49-871b-fc3f8b10269a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:44.440473 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:44.496490 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-fd6a0b90-1591-4d49-871b-fc3f8b10269a None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:44.497774 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fd6a0b90-1591-4d49-871b-fc3f8b10269a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:44.605942 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 679/1348] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:42:44.645542 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70f641-efd6-4429-9a20-d86dda33515f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:42:44.647277 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ad70f641-efd6-4429-9a20-d86dda33515f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:44.707739 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:44.757830 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad70f641-efd6-4429-9a20-d86dda33515f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:42:44.841550 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219514ab-4f07-485b-b66f-9100ca52d592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:42:44.842170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219514ab-4f07-485b-b66f-9100ca52d592 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:44.842466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219514ab-4f07-485b-b66f-9100ca52d592 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:44.842748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219514ab-4f07-485b-b66f-9100ca52d592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:44.844407 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-219514ab-4f07-485b-b66f-9100ca52d592 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:44.953455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:44.956987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219514ab-4f07-485b-b66f-9100ca52d592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:42:44.958456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219514ab-4f07-485b-b66f-9100ca52d592 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:42:44.975986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 670/1349] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:42:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:42:50.076440 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c9ef2-8492-493f-b772-d8b3094dc9b1 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:50.077923 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c9ef2-8492-493f-b772-d8b3094dc9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:50.078668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3c9ef2-8492-493f-b772-d8b3094dc9b1 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:50.081389 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 680/1350] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 16:42:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:50.095600 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441205d8-0b4e-4493-b191-05d6062bfc53 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:50.097066 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441205d8-0b4e-4493-b191-05d6062bfc53 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:50.097470 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441205d8-0b4e-4493-b191-05d6062bfc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:50.227656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-441205d8-0b4e-4493-b191-05d6062bfc53 None None] MFA Rules not processed for user `9c8d6afb4ccd41a5972e3241a3eebc7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:50.229271 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-441205d8-0b4e-4493-b191-05d6062bfc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:50.367055 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 671/1351] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 16:42:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:42:54.603988 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=59 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:54.738002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43598f7-cc3d-4e36-bbe8-e9583f4f01c9 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:54.738516 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43598f7-cc3d-4e36-bbe8-e9583f4f01c9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:54.739145 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43598f7-cc3d-4e36-bbe8-e9583f4f01c9 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:54.740612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 681/1352] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 16:42:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:54.746332 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84354fe-696f-4da5-9796-c133cce79347 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:54.746863 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84354fe-696f-4da5-9796-c133cce79347 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:54.747184 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84354fe-696f-4da5-9796-c133cce79347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:54.817962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:54.842949 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a84354fe-696f-4da5-9796-c133cce79347 None None] MFA Rules not processed for user `9c8d6afb4ccd41a5972e3241a3eebc7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:54.844167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a84354fe-696f-4da5-9796-c133cce79347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:54.977800 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 672/1353] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 16:42:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:42:56.328441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd2be5-c937-4848-b928-78b481586513 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:56.328980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd2be5-c937-4848-b928-78b481586513 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:56.329105 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd2be5-c937-4848-b928-78b481586513 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:56.330463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 682/1354] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 16:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:42:56.335876 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ce6df-b437-4d61-b7db-429d1e401125 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:42:56.336319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ce6df-b437-4d61-b7db-429d1e401125 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:42:56.336498 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ce6df-b437-4d61-b7db-429d1e401125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:42:56.415851 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f84ce6df-b437-4d61-b7db-429d1e401125 None None] MFA Rules not processed for user `9c8d6afb4ccd41a5972e3241a3eebc7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:42:56.417095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f84ce6df-b437-4d61-b7db-429d1e401125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:42:56.460877 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:42:56.550372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 673/1355] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 16:42:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:00.360220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8e945-03d7-4d7b-84f4-ca927d7e76e2 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:00.360220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8e945-03d7-4d7b-84f4-ca927d7e76e2 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:00.360220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8e945-03d7-4d7b-84f4-ca927d7e76e2 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:00.362409 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 683/1356] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:43:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:00.367946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d50cfc-fbe8-4758-924a-74ed617859c0 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:00.368413 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d50cfc-fbe8-4758-924a-74ed617859c0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:00.368530 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d50cfc-fbe8-4758-924a-74ed617859c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:00.465174 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f7d50cfc-fbe8-4758-924a-74ed617859c0 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:00.467590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f7d50cfc-fbe8-4758-924a-74ed617859c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:00.617062 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 674/1357] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:43:00.678567 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ff6d4-666b-44f2-8909-4638d6890bd6 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:00.678855 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ff6d4-666b-44f2-8909-4638d6890bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:00.679315 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ff6d4-666b-44f2-8909-4638d6890bd6 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:00.680863 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 684/1358] 10.222.0.76 () {54 vars in 962 bytes} [Mon Jul 18 16:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:00.690265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d869b-178b-4381-9cca-57b34c9635cd None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:00.690683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d869b-178b-4381-9cca-57b34c9635cd None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:00.691052 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d869b-178b-4381-9cca-57b34c9635cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:00.707722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:00.790295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f87d869b-178b-4381-9cca-57b34c9635cd None None] MFA Rules not processed for user `381cf4381ce64379b285d75e2909813d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:00.791506 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f87d869b-178b-4381-9cca-57b34c9635cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:00.925764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 675/1359] 10.222.0.76 () {58 vars in 1059 bytes} [Mon Jul 18 16:43:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:00.934319 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ff6d4-666b-44f2-8909-4638d6890bd6 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:00.936044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b21ff6d4-666b-44f2-8909-4638d6890bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:01.097385 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ff6d4-666b-44f2-8909-4638d6890bd6 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:01.187155 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:01.229762 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76740ebb-acc2-4c1e-8128-5d54c1f52098 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:01.230428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76740ebb-acc2-4c1e-8128-5d54c1f52098 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:01.230785 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76740ebb-acc2-4c1e-8128-5d54c1f52098 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:01.231720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76740ebb-acc2-4c1e-8128-5d54c1f52098 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:01.234223 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-76740ebb-acc2-4c1e-8128-5d54c1f52098 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:01.339326 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76740ebb-acc2-4c1e-8128-5d54c1f52098 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:01.341869 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76740ebb-acc2-4c1e-8128-5d54c1f52098 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:01.362596 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 685/1360] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:43:03.693522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c7553-40bf-4a9e-809b-c3099ecc4ee3 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:03.694020 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c7553-40bf-4a9e-809b-c3099ecc4ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:03.694102 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c7553-40bf-4a9e-809b-c3099ecc4ee3 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:03.695609 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 676/1361] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:03.701004 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94400529-2e5f-419b-a619-8fdfa953cb60 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:03.701416 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94400529-2e5f-419b-a619-8fdfa953cb60 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:03.701715 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94400529-2e5f-419b-a619-8fdfa953cb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:03.792287 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-94400529-2e5f-419b-a619-8fdfa953cb60 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:03.794520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-94400529-2e5f-419b-a619-8fdfa953cb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:03.836347 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:03.901570 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 686/1362] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:43:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:03.947512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c7553-40bf-4a9e-809b-c3099ecc4ee3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:03.949038 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-014c7553-40bf-4a9e-809b-c3099ecc4ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:04.040972 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:04.133454 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c7553-40bf-4a9e-809b-c3099ecc4ee3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:04.261078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9181bc1-d3a5-4600-aa7d-08de25cc2c04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:04.262438 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9181bc1-d3a5-4600-aa7d-08de25cc2c04 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:04.262438 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9181bc1-d3a5-4600-aa7d-08de25cc2c04 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:04.262890 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9181bc1-d3a5-4600-aa7d-08de25cc2c04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:04.264457 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a9181bc1-d3a5-4600-aa7d-08de25cc2c04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:04.288782 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:04.363124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9181bc1-d3a5-4600-aa7d-08de25cc2c04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:04.365046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9181bc1-d3a5-4600-aa7d-08de25cc2c04 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:04.386141 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 677/1363] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:07.008955 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d0b70-decd-4b9a-95bf-a52a774f3c50 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:07.009618 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d0b70-decd-4b9a-95bf-a52a774f3c50 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:07.009725 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d0b70-decd-4b9a-95bf-a52a774f3c50 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:07.012167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 687/1364] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:43:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:07.021710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3f767-aca7-4146-b131-129bc4be8d5c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:07.022265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3f767-aca7-4146-b131-129bc4be8d5c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:07.022265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3f767-aca7-4146-b131-129bc4be8d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:07.112830 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-98f3f767-aca7-4146-b131-129bc4be8d5c None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:07.114929 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-98f3f767-aca7-4146-b131-129bc4be8d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:07.241435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:07.244102 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 678/1365] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:07.304290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbf6cb-38fe-45bb-8e5c-804c8b81cc2b None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:07.304584 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbf6cb-38fe-45bb-8e5c-804c8b81cc2b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:07.305096 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bbf6cb-38fe-45bb-8e5c-804c8b81cc2b None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:07.306493 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 688/1366] 10.222.0.76 () {54 vars in 962 bytes} [Mon Jul 18 16:43:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:07.314179 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e4d4b-1760-4791-b0fd-ca9e297efb1b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:07.314179 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e4d4b-1760-4791-b0fd-ca9e297efb1b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:07.314474 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9e4d4b-1760-4791-b0fd-ca9e297efb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:07.413065 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-7d9e4d4b-1760-4791-b0fd-ca9e297efb1b None None] MFA Rules not processed for user `381cf4381ce64379b285d75e2909813d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:07.414333 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7d9e4d4b-1760-4791-b0fd-ca9e297efb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:07.546050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 679/1367] 10.222.0.76 () {58 vars in 1059 bytes} [Mon Jul 18 16:43:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:07.554078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbf6cb-38fe-45bb-8e5c-804c8b81cc2b None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:07.555939 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-45bbf6cb-38fe-45bb-8e5c-804c8b81cc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:07.728853 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bbf6cb-38fe-45bb-8e5c-804c8b81cc2b None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:07.753264 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:07.854809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21015545-2f8f-4537-90ac-2d108ad23cb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:07.855507 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21015545-2f8f-4537-90ac-2d108ad23cb5 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:07.855797 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21015545-2f8f-4537-90ac-2d108ad23cb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:07.856078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21015545-2f8f-4537-90ac-2d108ad23cb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:07.857786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-21015545-2f8f-4537-90ac-2d108ad23cb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:07.961098 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21015545-2f8f-4537-90ac-2d108ad23cb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:07.962726 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21015545-2f8f-4537-90ac-2d108ad23cb5 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:07.983312 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 689/1368] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:08.993208 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b7359-ca74-4784-8fc4-e6df23975cff None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:08.993769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b7359-ca74-4784-8fc4-e6df23975cff None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:08.993769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b7359-ca74-4784-8fc4-e6df23975cff None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:08.995294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 680/1369] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:09.000706 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a3c36-2023-4322-bb65-f76e21808796 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:09.001213 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a3c36-2023-4322-bb65-f76e21808796 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:09.001305 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a3c36-2023-4322-bb65-f76e21808796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:09.035104 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:09.073440 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-eb8a3c36-2023-4322-bb65-f76e21808796 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:09.075643 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-eb8a3c36-2023-4322-bb65-f76e21808796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:09.188203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 690/1370] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:43:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:09.539995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9b455-abe1-4f86-8b4d-85bd6c1ed383 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:09.539995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9b455-abe1-4f86-8b4d-85bd6c1ed383 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:09.539995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b9b455-abe1-4f86-8b4d-85bd6c1ed383 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:09.543551 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 681/1371] 10.222.0.76 () {54 vars in 964 bytes} [Mon Jul 18 16:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:09.547665 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c62bf-7066-44b0-855e-4e80c10ef6cf None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:09.547953 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c62bf-7066-44b0-855e-4e80c10ef6cf None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:09.548233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461c62bf-7066-44b0-855e-4e80c10ef6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:09.636925 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-461c62bf-7066-44b0-855e-4e80c10ef6cf None None] MFA Rules not processed for user `55d75cd269ff4f0daf51a728b159888a`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:09.640160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-461c62bf-7066-44b0-855e-4e80c10ef6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:09.700011 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:09.736355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 691/1372] 10.222.0.76 () {58 vars in 1061 bytes} [Mon Jul 18 16:43:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:09.744312 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9b455-abe1-4f86-8b4d-85bd6c1ed383 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:09.746016 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-00b9b455-abe1-4f86-8b4d-85bd6c1ed383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:09.805670 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:09.872146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b9b455-abe1-4f86-8b4d-85bd6c1ed383 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:09.955282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f143ad-5faa-43df-bb54-a4eebf865c2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:09.955941 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f143ad-5faa-43df-bb54-a4eebf865c2e service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:09.956224 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f143ad-5faa-43df-bb54-a4eebf865c2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:09.956495 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f143ad-5faa-43df-bb54-a4eebf865c2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:09.958174 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-23f143ad-5faa-43df-bb54-a4eebf865c2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:10.070383 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:10.085246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f143ad-5faa-43df-bb54-a4eebf865c2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:10.086453 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f143ad-5faa-43df-bb54-a4eebf865c2e service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:10.109172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 682/1373] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:10.331050 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ff00f-15b2-4db5-917b-8f6d97d84043 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:10.332977 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ff00f-15b2-4db5-917b-8f6d97d84043 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:10.333783 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ff00f-15b2-4db5-917b-8f6d97d84043 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:10.338126 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 692/1374] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:43:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:10.345077 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28636cc3-4bb9-46e4-8b9f-392f25f29328 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:10.346228 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28636cc3-4bb9-46e4-8b9f-392f25f29328 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:10.347015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28636cc3-4bb9-46e4-8b9f-392f25f29328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:10.461999 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-28636cc3-4bb9-46e4-8b9f-392f25f29328 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:10.463875 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-28636cc3-4bb9-46e4-8b9f-392f25f29328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:10.589263 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 683/1375] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:43:10.629547 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ff00f-15b2-4db5-917b-8f6d97d84043 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:10.631195 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-be1ff00f-15b2-4db5-917b-8f6d97d84043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:10.795637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ff00f-15b2-4db5-917b-8f6d97d84043 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:10.851586 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:10.916848 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe139969-c525-4eca-9fa1-1a68ecac1956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:10.917556 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe139969-c525-4eca-9fa1-1a68ecac1956 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:10.917871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe139969-c525-4eca-9fa1-1a68ecac1956 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:10.918148 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe139969-c525-4eca-9fa1-1a68ecac1956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:10.919787 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fe139969-c525-4eca-9fa1-1a68ecac1956 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:11.012774 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe139969-c525-4eca-9fa1-1a68ecac1956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:11.015640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe139969-c525-4eca-9fa1-1a68ecac1956 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:11.033308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 693/1376] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:13.231035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380a310-e98e-4f2d-825e-36f7d7643c22 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:13.231562 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380a310-e98e-4f2d-825e-36f7d7643c22 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:13.231668 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380a310-e98e-4f2d-825e-36f7d7643c22 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:13.233280 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 684/1377] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:43:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:13.238803 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75611247-0633-43f7-87fd-c49e316ef56a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:13.239232 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75611247-0633-43f7-87fd-c49e316ef56a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:13.239364 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75611247-0633-43f7-87fd-c49e316ef56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:13.329681 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-75611247-0633-43f7-87fd-c49e316ef56a None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:13.330897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-75611247-0633-43f7-87fd-c49e316ef56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:13.337687 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:13.429325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 694/1378] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:13.474152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380a310-e98e-4f2d-825e-36f7d7643c22 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:13.475714 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d380a310-e98e-4f2d-825e-36f7d7643c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:13.541098 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:13.641551 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380a310-e98e-4f2d-825e-36f7d7643c22 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:13.810815 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399de1f2-93d7-4370-8f7c-b6699b307b29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:13.811803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399de1f2-93d7-4370-8f7c-b6699b307b29 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:13.812784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399de1f2-93d7-4370-8f7c-b6699b307b29 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:13.813275 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399de1f2-93d7-4370-8f7c-b6699b307b29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:13.815219 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-399de1f2-93d7-4370-8f7c-b6699b307b29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:13.837936 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:13.922552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399de1f2-93d7-4370-8f7c-b6699b307b29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:13.924320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399de1f2-93d7-4370-8f7c-b6699b307b29 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:13.944240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 685/1379] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:16.164663 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f563287-4c17-4c8d-818f-bf887adcffae None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:16.164663 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f563287-4c17-4c8d-818f-bf887adcffae None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:16.168073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f563287-4c17-4c8d-818f-bf887adcffae None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:16.172361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244f152-67a7-41ce-83f6-6aa527b5045a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:16.173658 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244f152-67a7-41ce-83f6-6aa527b5045a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:16.173658 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244f152-67a7-41ce-83f6-6aa527b5045a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:16.174381 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 695/1380] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:43:16 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:16.268241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1244f152-67a7-41ce-83f6-6aa527b5045a None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:16.268241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1244f152-67a7-41ce-83f6-6aa527b5045a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:16.358271 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:16.364418 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 686/1381] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:43:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:16.414279 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f563287-4c17-4c8d-818f-bf887adcffae None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:16.415789 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3f563287-4c17-4c8d-818f-bf887adcffae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:16.570751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:16.584027 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f563287-4c17-4c8d-818f-bf887adcffae None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:16.716106 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccaf3fb-db27-48e2-9716-f39573add9b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:16.716770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaf3fb-db27-48e2-9716-f39573add9b4 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:16.717075 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaf3fb-db27-48e2-9716-f39573add9b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:16.717479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccaf3fb-db27-48e2-9716-f39573add9b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:16.719119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3ccaf3fb-db27-48e2-9716-f39573add9b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:16.821878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccaf3fb-db27-48e2-9716-f39573add9b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:16.824063 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccaf3fb-db27-48e2-9716-f39573add9b4 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:16.836939 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:16.848187 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 696/1382] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:19.375811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf5998-41e6-4a7a-a329-356265e6ce44 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:19.376383 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf5998-41e6-4a7a-a329-356265e6ce44 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:19.376383 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf5998-41e6-4a7a-a329-356265e6ce44 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:19.377834 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 687/1383] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:19.384132 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ed503-2e7d-410e-b0a9-3ee5b1b4fbd8 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:19.384587 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ed503-2e7d-410e-b0a9-3ee5b1b4fbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:19.384693 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ed503-2e7d-410e-b0a9-3ee5b1b4fbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:19.461135 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-f14ed503-2e7d-410e-b0a9-3ee5b1b4fbd8 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:19.462627 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f14ed503-2e7d-410e-b0a9-3ee5b1b4fbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:19.578188 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 697/1384] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:43:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:19.622211 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf5998-41e6-4a7a-a329-356265e6ce44 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:19.624009 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3ddf5998-41e6-4a7a-a329-356265e6ce44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:19.791450 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf5998-41e6-4a7a-a329-356265e6ce44 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:19.866309 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:19.917876 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f702f0-1057-46b4-bac3-f2c0fd8d48c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:19.918740 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f702f0-1057-46b4-bac3-f2c0fd8d48c7 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:19.919078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f702f0-1057-46b4-bac3-f2c0fd8d48c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:19.919370 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f702f0-1057-46b4-bac3-f2c0fd8d48c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:19.921188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-35f702f0-1057-46b4-bac3-f2c0fd8d48c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:20.029126 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f702f0-1057-46b4-bac3-f2c0fd8d48c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:20.030866 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f702f0-1057-46b4-bac3-f2c0fd8d48c7 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:20.052780 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 688/1385] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:22.191147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3808ebe-719e-43b6-89c7-3eb0c2dd2d6c None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:22.191697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3808ebe-719e-43b6-89c7-3eb0c2dd2d6c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:22.191697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3808ebe-719e-43b6-89c7-3eb0c2dd2d6c None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:22.193184 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 698/1386] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:22.200194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8fbd1-2df5-4126-8061-dbe74a2f4d5a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:22.200816 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8fbd1-2df5-4126-8061-dbe74a2f4d5a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:22.201077 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad8fbd1-2df5-4126-8061-dbe74a2f4d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:22.282840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0ad8fbd1-2df5-4126-8061-dbe74a2f4d5a None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:22.284080 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0ad8fbd1-2df5-4126-8061-dbe74a2f4d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:22.324072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:22.396033 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 689/1387] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:43:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:22.442526 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3808ebe-719e-43b6-89c7-3eb0c2dd2d6c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:22.444227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c3808ebe-719e-43b6-89c7-3eb0c2dd2d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:22.530534 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:22.616730 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3808ebe-719e-43b6-89c7-3eb0c2dd2d6c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:22.743061 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f87ba-3018-4911-ab2a-3fd0281c3a75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:22.743676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f87ba-3018-4911-ab2a-3fd0281c3a75 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:22.743972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f87ba-3018-4911-ab2a-3fd0281c3a75 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:22.744263 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f87ba-3018-4911-ab2a-3fd0281c3a75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:22.746460 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-210f87ba-3018-4911-ab2a-3fd0281c3a75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:22.789734 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:22.845451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f87ba-3018-4911-ab2a-3fd0281c3a75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:22.847127 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f87ba-3018-4911-ab2a-3fd0281c3a75 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:22.865711 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 699/1388] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:25.304934 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e77b9-2c38-4401-993e-ccd5656c439b None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:25.305560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e77b9-2c38-4401-993e-ccd5656c439b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:25.305560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e77b9-2c38-4401-993e-ccd5656c439b None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:25.306904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 690/1389] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:25.312832 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e0871-c82e-43cf-9f83-f962fa82fbbe None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:25.313317 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e0871-c82e-43cf-9f83-f962fa82fbbe None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:25.313436 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e0871-c82e-43cf-9f83-f962fa82fbbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:25.380993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-564e0871-c82e-43cf-9f83-f962fa82fbbe None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:25.382234 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-564e0871-c82e-43cf-9f83-f962fa82fbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:25.481017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 700/1390] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:25.525377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e77b9-2c38-4401-993e-ccd5656c439b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:25.527470 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-864e77b9-2c38-4401-993e-ccd5656c439b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:25.679330 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e77b9-2c38-4401-993e-ccd5656c439b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:25.696372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:25.797022 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dbd87e-91e1-47bf-b056-ff18e14eb9b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:25.797691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbd87e-91e1-47bf-b056-ff18e14eb9b9 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:25.797974 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbd87e-91e1-47bf-b056-ff18e14eb9b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:25.798251 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbd87e-91e1-47bf-b056-ff18e14eb9b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:25.799899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-85dbd87e-91e1-47bf-b056-ff18e14eb9b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:25.890958 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbd87e-91e1-47bf-b056-ff18e14eb9b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:25.892668 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dbd87e-91e1-47bf-b056-ff18e14eb9b9 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:25.911507 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 691/1391] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:25.948603 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae3ff6-f5eb-4518-b82d-d2afd23df654 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:25.949279 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae3ff6-f5eb-4518-b82d-d2afd23df654 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:25.949561 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ae3ff6-f5eb-4518-b82d-d2afd23df654 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:25.950966 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 701/1392] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:25.956364 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bab17-f86e-4b42-9d35-e8a8d09e0038 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:25.956657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bab17-f86e-4b42-9d35-e8a8d09e0038 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:25.956939 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bab17-f86e-4b42-9d35-e8a8d09e0038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:25.982817 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:26.025444 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4c1bab17-f86e-4b42-9d35-e8a8d09e0038 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:26.027260 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4c1bab17-f86e-4b42-9d35-e8a8d09e0038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:26.125184 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 692/1393] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:26.183907 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57821f8-353e-4364-967c-965ad8e5ad3d None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:26.184197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57821f8-353e-4364-967c-965ad8e5ad3d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:26.184477 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57821f8-353e-4364-967c-965ad8e5ad3d None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:26.185947 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 702/1394] 10.222.0.76 () {54 vars in 961 bytes} [Mon Jul 18 16:43:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:26.190949 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15a631-a7da-4fb8-8125-9868c4b31f70 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:26.191256 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15a631-a7da-4fb8-8125-9868c4b31f70 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:26.191557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15a631-a7da-4fb8-8125-9868c4b31f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:26.269094 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9e15a631-a7da-4fb8-8125-9868c4b31f70 None None] MFA Rules not processed for user `a1e1900754214020931b202e98f660a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:26.270331 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9e15a631-a7da-4fb8-8125-9868c4b31f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:26.320986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:26.361278 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 693/1395] 10.222.0.76 () {58 vars in 1058 bytes} [Mon Jul 18 16:43:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:26.369271 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57821f8-353e-4364-967c-965ad8e5ad3d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:26.371645 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c57821f8-353e-4364-967c-965ad8e5ad3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:26.388317 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:26.484271 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57821f8-353e-4364-967c-965ad8e5ad3d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:26.563294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edb5c98-cf6b-4f8c-b36e-b898dcfd190d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e1900754214020931b202e98f660a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:26.563878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb5c98-cf6b-4f8c-b36e-b898dcfd190d service glance] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:26.564164 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb5c98-cf6b-4f8c-b36e-b898dcfd190d service glance] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:26.564443 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edb5c98-cf6b-4f8c-b36e-b898dcfd190d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:26.566175 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6edb5c98-cf6b-4f8c-b36e-b898dcfd190d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:26.642203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:26.687077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb5c98-cf6b-4f8c-b36e-b898dcfd190d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:26.688519 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edb5c98-cf6b-4f8c-b36e-b898dcfd190d service glance] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:26.707001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 703/1396] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:27.597760 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1f7ba-d1e0-4fcb-8ad5-48ddba8ed58c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:27.598291 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1f7ba-d1e0-4fcb-8ad5-48ddba8ed58c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:27.598572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1f7ba-d1e0-4fcb-8ad5-48ddba8ed58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:27.665784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-04f1f7ba-d1e0-4fcb-8ad5-48ddba8ed58c None None] MFA Rules not processed for user `ff65e481807b4344897b1499cd450f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:27.667627 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-04f1f7ba-d1e0-4fcb-8ad5-48ddba8ed58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:27.756505 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 694/1397] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 16:43:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:43:27.806906 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3572a7-1bff-490e-b9bf-f1e9dcb4e2e7 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:27.808116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3572a7-1bff-490e-b9bf-f1e9dcb4e2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:27.808403 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3572a7-1bff-490e-b9bf-f1e9dcb4e2e7 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:27.810078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 704/1398] 10.222.0.76 () {54 vars in 943 bytes} [Mon Jul 18 16:43:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:27.817190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d85bc-d363-4b93-a8ae-a64604709317 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:27.817553 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d85bc-d363-4b93-a8ae-a64604709317 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:27.817895 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d85bc-d363-4b93-a8ae-a64604709317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:27.890624 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:27.898362 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c39d85bc-d363-4b93-a8ae-a64604709317 None None] MFA Rules not processed for user `50bc0fa34b414328a342d685bc1eaca3`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:27.901118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c39d85bc-d363-4b93-a8ae-a64604709317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:28.015144 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 695/1399] 10.222.0.76 () {58 vars in 1040 bytes} [Mon Jul 18 16:43:27 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:28.027114 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3572a7-1bff-490e-b9bf-f1e9dcb4e2e7 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:28.027114 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6d3572a7-1bff-490e-b9bf-f1e9dcb4e2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:28.173946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3572a7-1bff-490e-b9bf-f1e9dcb4e2e7 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:28.211682 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:28.283330 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8ed49-76a4-4dcb-a6c3-549d4e494746 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bc0fa34b414328a342d685bc1eaca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:28.284004 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8ed49-76a4-4dcb-a6c3-549d4e494746 service swift] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:28.284622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8ed49-76a4-4dcb-a6c3-549d4e494746 service swift] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:28.284907 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8ed49-76a4-4dcb-a6c3-549d4e494746 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:28.285922 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93b5a6-b1ee-4e92-b621-106a5a2c9e92 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:28.286217 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93b5a6-b1ee-4e92-b621-106a5a2c9e92 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:28.286498 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93b5a6-b1ee-4e92-b621-106a5a2c9e92 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:28.286749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f0a8ed49-76a4-4dcb-a6c3-549d4e494746 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:28.288208 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 696/1400] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:43:28.294366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c92381-ee45-4095-ba61-6992dae92910 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:28.294750 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c92381-ee45-4095-ba61-6992dae92910 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:28.295032 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c92381-ee45-4095-ba61-6992dae92910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:28.360630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-79c92381-ee45-4095-ba61-6992dae92910 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:28.361915 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-79c92381-ee45-4095-ba61-6992dae92910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:28.373678 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8ed49-76a4-4dcb-a6c3-549d4e494746 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:28.375306 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8ed49-76a4-4dcb-a6c3-549d4e494746 service swift] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:28.384053 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 705/1401] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 16:43:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:43:28.433710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:28.470113 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 697/1402] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:43:28.516335 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8ed49-76a4-4dcb-a6c3-549d4e494746 service swift] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:28.517575 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f0a8ed49-76a4-4dcb-a6c3-549d4e494746 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:28.590896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:28.623553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8ed49-76a4-4dcb-a6c3-549d4e494746 service swift] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:28.741371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98022d2b-b028-4392-90ce-cf3903b51027 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:28.741940 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98022d2b-b028-4392-90ce-cf3903b51027 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:28.742229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98022d2b-b028-4392-90ce-cf3903b51027 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:28.742524 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98022d2b-b028-4392-90ce-cf3903b51027 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:28.744155 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-98022d2b-b028-4392-90ce-cf3903b51027 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:28.837514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98022d2b-b028-4392-90ce-cf3903b51027 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:28.839373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98022d2b-b028-4392-90ce-cf3903b51027 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:28.859883 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 706/1403] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:29.026726 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:31.287851 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc23b2-dda2-4270-ac99-7042244e0b8a None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:31.288406 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc23b2-dda2-4270-ac99-7042244e0b8a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:31.288406 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc23b2-dda2-4270-ac99-7042244e0b8a None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:31.289835 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 698/1404] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:31.295423 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f349b3-32eb-4c07-8e84-a090e0887742 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:31.295865 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f349b3-32eb-4c07-8e84-a090e0887742 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:31.295965 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f349b3-32eb-4c07-8e84-a090e0887742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:31.365714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a1f349b3-32eb-4c07-8e84-a090e0887742 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:31.367015 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a1f349b3-32eb-4c07-8e84-a090e0887742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:31.496181 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 707/1405] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:43:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:31.543035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc23b2-dda2-4270-ac99-7042244e0b8a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:31.544600 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8bdc23b2-dda2-4270-ac99-7042244e0b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:31.740939 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc23b2-dda2-4270-ac99-7042244e0b8a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:31.803689 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:31.883289 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c369e-7a98-447d-bfd7-be7d50206d62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:31.884071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c369e-7a98-447d-bfd7-be7d50206d62 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:31.884424 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c369e-7a98-447d-bfd7-be7d50206d62 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:31.884859 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c369e-7a98-447d-bfd7-be7d50206d62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:31.886617 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1f7c369e-7a98-447d-bfd7-be7d50206d62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:31.986841 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c369e-7a98-447d-bfd7-be7d50206d62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:31.988743 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c369e-7a98-447d-bfd7-be7d50206d62 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:32.008887 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 699/1406] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:34.969675 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54085d-b519-494a-8b39-5bee82d2da6c None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:34.970964 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54085d-b519-494a-8b39-5bee82d2da6c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:34.971319 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54085d-b519-494a-8b39-5bee82d2da6c None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:34.972930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 708/1407] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:43:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:34.978387 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78689ebb-388d-40ee-85d5-2a11c275a23a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:34.979562 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78689ebb-388d-40ee-85d5-2a11c275a23a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:34.980063 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78689ebb-388d-40ee-85d5-2a11c275a23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:35.053556 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-78689ebb-388d-40ee-85d5-2a11c275a23a None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:35.055113 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-78689ebb-388d-40ee-85d5-2a11c275a23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:35.061616 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:35.185291 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 700/1408] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:35.231470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54085d-b519-494a-8b39-5bee82d2da6c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:35.232917 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ab54085d-b519-494a-8b39-5bee82d2da6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:35.306333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:35.394773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54085d-b519-494a-8b39-5bee82d2da6c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:35.538223 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f51add-4924-43cc-8c44-df4194f49209 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:35.538891 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f51add-4924-43cc-8c44-df4194f49209 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:35.539181 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f51add-4924-43cc-8c44-df4194f49209 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:35.539459 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f51add-4924-43cc-8c44-df4194f49209 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:35.541696 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-27f51add-4924-43cc-8c44-df4194f49209 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:35.574645 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:35.647939 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f51add-4924-43cc-8c44-df4194f49209 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:35.649592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f51add-4924-43cc-8c44-df4194f49209 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:35.670155 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 709/1409] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:45.182999 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=41 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:45.667155 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=34 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:53.126654 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3661da2-46d1-4b12-b711-cf7bb3729e6b None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:53.127221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3661da2-46d1-4b12-b711-cf7bb3729e6b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:53.127221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3661da2-46d1-4b12-b711-cf7bb3729e6b None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:53.128644 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 701/1410] 10.222.0.76 () {54 vars in 918 bytes} [Mon Jul 18 16:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:53.134330 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48feeb8-e18e-4bd9-8930-23045755445f None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:53.134794 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48feeb8-e18e-4bd9-8930-23045755445f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:53.134963 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48feeb8-e18e-4bd9-8930-23045755445f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:53.213879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a48feeb8-e18e-4bd9-8930-23045755445f None None] MFA Rules not processed for user `9c8d6afb4ccd41a5972e3241a3eebc7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:53.215110 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a48feeb8-e18e-4bd9-8930-23045755445f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:53.329803 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 710/1411] 10.222.0.76 () {58 vars in 1015 bytes} [Mon Jul 18 16:43:53 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:53.344736 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff7f3f-85ff-49c1-8d29-cec4be51ec21 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:53.345150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff7f3f-85ff-49c1-8d29-cec4be51ec21 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:53.345438 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff7f3f-85ff-49c1-8d29-cec4be51ec21 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:53.346803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 702/1412] 10.222.0.76 () {54 vars in 918 bytes} [Mon Jul 18 16:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:53.351360 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3171d-db13-4ed7-9692-701e786396ec None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:53.351653 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3171d-db13-4ed7-9692-701e786396ec None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:53.351930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3171d-db13-4ed7-9692-701e786396ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:53.425202 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:53.428163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-aaf3171d-db13-4ed7-9692-701e786396ec None None] MFA Rules not processed for user `381cf4381ce64379b285d75e2909813d`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:53.429407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-aaf3171d-db13-4ed7-9692-701e786396ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:53.552012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 711/1413] 10.222.0.76 () {58 vars in 1015 bytes} [Mon Jul 18 16:43:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:56.087343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f865d4-de60-4683-a20d-6bafcd5f5e6e None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:56.088067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f865d4-de60-4683-a20d-6bafcd5f5e6e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:56.088067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f865d4-de60-4683-a20d-6bafcd5f5e6e None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:56.089403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:56.095086 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516808d4-e14e-4ab6-a872-5cf36208396d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:56.095499 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516808d4-e14e-4ab6-a872-5cf36208396d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:56.095669 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516808d4-e14e-4ab6-a872-5cf36208396d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:56.165751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-516808d4-e14e-4ab6-a872-5cf36208396d None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:56.166989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-516808d4-e14e-4ab6-a872-5cf36208396d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:56.227966 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:56.270943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:56.316113 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f865d4-de60-4683-a20d-6bafcd5f5e6e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:56.317713 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-64f865d4-de60-4683-a20d-6bafcd5f5e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:56.487820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f865d4-de60-4683-a20d-6bafcd5f5e6e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:56.565032 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:56.605661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad08f5-b07d-4908-b7ec-f4dfd9b3d578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:56.606353 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad08f5-b07d-4908-b7ec-f4dfd9b3d578 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:56.606649 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad08f5-b07d-4908-b7ec-f4dfd9b3d578 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:56.607133 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad08f5-b07d-4908-b7ec-f4dfd9b3d578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:56.609304 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2aad08f5-b07d-4908-b7ec-f4dfd9b3d578 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:56.698683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad08f5-b07d-4908-b7ec-f4dfd9b3d578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:56.700294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad08f5-b07d-4908-b7ec-f4dfd9b3d578 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:56.718939 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 704/1416] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:57.629616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f517a1-0126-4d60-b957-5c72e581e8f0 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:57.630188 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f517a1-0126-4d60-b957-5c72e581e8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:57.630188 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f517a1-0126-4d60-b957-5c72e581e8f0 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:57.631576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:57.637285 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f1c06-c9a9-4221-a92a-715af9e397c8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:57.637723 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f1c06-c9a9-4221-a92a-715af9e397c8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:57.637882 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1f1c06-c9a9-4221-a92a-715af9e397c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:57.711815 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5a1f1c06-c9a9-4221-a92a-715af9e397c8 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:57.713053 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5a1f1c06-c9a9-4221-a92a-715af9e397c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:57.740788 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:57.814544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:57.965834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f517a1-0126-4d60-b957-5c72e581e8f0 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:57.967301 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-99f517a1-0126-4d60-b957-5c72e581e8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:58.115794 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f517a1-0126-4d60-b957-5c72e581e8f0 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:58.158347 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:58.232364 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69dffb-1036-4275-88c5-9617e28a6665 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:58.232952 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69dffb-1036-4275-88c5-9617e28a6665 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:58.233268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69dffb-1036-4275-88c5-9617e28a6665 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:58.233550 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69dffb-1036-4275-88c5-9617e28a6665 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:58.235210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ef69dffb-1036-4275-88c5-9617e28a6665 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:58.331594 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69dffb-1036-4275-88c5-9617e28a6665 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:43:58.333243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69dffb-1036-4275-88c5-9617e28a6665 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:43:58.353794 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 714/1419] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:43:59.275414 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fd57c-a2ad-496b-bcdd-becbd3b8149d None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:59.275981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fd57c-a2ad-496b-bcdd-becbd3b8149d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:59.275981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4fd57c-a2ad-496b-bcdd-becbd3b8149d None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:59.277388 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:43:59.282422 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f098824-4540-4e9d-a0ac-23ee0b0b8f16 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:59.282890 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f098824-4540-4e9d-a0ac-23ee0b0b8f16 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:59.283009 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f098824-4540-4e9d-a0ac-23ee0b0b8f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:59.342470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:59.364162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-7f098824-4540-4e9d-a0ac-23ee0b0b8f16 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:43:59.365405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7f098824-4540-4e9d-a0ac-23ee0b0b8f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:59.471582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:43:59.626661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fd57c-a2ad-496b-bcdd-becbd3b8149d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:43:59.628191 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0c4fd57c-a2ad-496b-bcdd-becbd3b8149d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:43:59.778717 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4fd57c-a2ad-496b-bcdd-becbd3b8149d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:43:59.791175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:43:59.902813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d580bd2-272d-4a8a-8bb0-43914e185d94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:43:59.903470 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d580bd2-272d-4a8a-8bb0-43914e185d94 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:43:59.903755 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d580bd2-272d-4a8a-8bb0-43914e185d94 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:43:59.904029 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d580bd2-272d-4a8a-8bb0-43914e185d94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:43:59.905746 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0d580bd2-272d-4a8a-8bb0-43914e185d94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:00.000314 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d580bd2-272d-4a8a-8bb0-43914e185d94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:44:00.001962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d580bd2-272d-4a8a-8bb0-43914e185d94 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:44:00.025652 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 707/1422] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:43:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:00.909719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f3f98-7078-4553-b06c-6d56a32392dc None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:00.910301 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f3f98-7078-4553-b06c-6d56a32392dc None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:00.910301 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f3f98-7078-4553-b06c-6d56a32392dc None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:00.911630 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:44:00.917887 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bae5fa-acc4-4dd0-9c75-de9433ac16e4 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:00.918432 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bae5fa-acc4-4dd0-9c75-de9433ac16e4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:00.918432 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bae5fa-acc4-4dd0-9c75-de9433ac16e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:00.939104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:00.999610 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-51bae5fa-acc4-4dd0-9c75-de9433ac16e4 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:44:01.001072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-51bae5fa-acc4-4dd0-9c75-de9433ac16e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:01.108675 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:44:01.262074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f3f98-7078-4553-b06c-6d56a32392dc None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:44:01.263593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-276f3f98-7078-4553-b06c-6d56a32392dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:01.380374 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:01.416495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f3f98-7078-4553-b06c-6d56a32392dc None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:44:01.532093 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec598a-41c1-443f-838d-29b00da515f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:44:01.532759 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec598a-41c1-443f-838d-29b00da515f2 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:01.533061 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec598a-41c1-443f-838d-29b00da515f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:01.533343 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec598a-41c1-443f-838d-29b00da515f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:01.534980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-87ec598a-41c1-443f-838d-29b00da515f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:01.616757 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:01.635657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec598a-41c1-443f-838d-29b00da515f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:44:01.637314 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec598a-41c1-443f-838d-29b00da515f2 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:44:01.656325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 717/1425] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:44:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:02.540623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90249c6b-0e94-4092-8dbf-206a1568a1f5 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:02.541267 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90249c6b-0e94-4092-8dbf-206a1568a1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:02.541267 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90249c6b-0e94-4092-8dbf-206a1568a1f5 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:02.542590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:44:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:44:02.547654 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99493f-bc4b-48de-904c-d02039244107 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:02.548093 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99493f-bc4b-48de-904c-d02039244107 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:02.548228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99493f-bc4b-48de-904c-d02039244107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:02.626090 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-7c99493f-bc4b-48de-904c-d02039244107 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:44:02.627326 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7c99493f-bc4b-48de-904c-d02039244107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:02.725670 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:44:02.879017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90249c6b-0e94-4092-8dbf-206a1568a1f5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:44:02.880442 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-90249c6b-0e94-4092-8dbf-206a1568a1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:02.969210 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:03.044805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90249c6b-0e94-4092-8dbf-206a1568a1f5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:44:03.173232 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd66cb8e-2777-4270-8b99-e19cf6ffd24c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:44:03.173902 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66cb8e-2777-4270-8b99-e19cf6ffd24c service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:03.174186 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66cb8e-2777-4270-8b99-e19cf6ffd24c service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:03.174462 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd66cb8e-2777-4270-8b99-e19cf6ffd24c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:03.176144 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bd66cb8e-2777-4270-8b99-e19cf6ffd24c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:03.225518 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:03.267458 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66cb8e-2777-4270-8b99-e19cf6ffd24c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:44:03.269078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd66cb8e-2777-4270-8b99-e19cf6ffd24c service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:44:03.288230 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 710/1428] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:44:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:04.181285 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000d6c1-10b6-43e3-aa1c-b68327e68efd None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:04.181811 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000d6c1-10b6-43e3-aa1c-b68327e68efd None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:04.181920 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000d6c1-10b6-43e3-aa1c-b68327e68efd None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:04.183296 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:44:04.188478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783c3e7-daaf-4525-88be-b0b7c91c02f1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:04.188985 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783c3e7-daaf-4525-88be-b0b7c91c02f1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:04.189141 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5783c3e7-daaf-4525-88be-b0b7c91c02f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:04.265516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5783c3e7-daaf-4525-88be-b0b7c91c02f1 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:44:04.266717 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5783c3e7-daaf-4525-88be-b0b7c91c02f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:04.367239 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:44:04.520290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000d6c1-10b6-43e3-aa1c-b68327e68efd None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:44:04.521881 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3000d6c1-10b6-43e3-aa1c-b68327e68efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:04.574608 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:04.676538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000d6c1-10b6-43e3-aa1c-b68327e68efd None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:44:04.794855 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f726a4-ea87-43e7-8fc2-8d192c5e5a0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:44:04.795515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f726a4-ea87-43e7-8fc2-8d192c5e5a0c service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:04.795802 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f726a4-ea87-43e7-8fc2-8d192c5e5a0c service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:04.796079 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f726a4-ea87-43e7-8fc2-8d192c5e5a0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:04.797794 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-47f726a4-ea87-43e7-8fc2-8d192c5e5a0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:04.805436 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:04.892842 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f726a4-ea87-43e7-8fc2-8d192c5e5a0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:44:04.894474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f726a4-ea87-43e7-8fc2-8d192c5e5a0c service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:44:04.913268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 720/1431] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:05.843803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64989c4f-7b0e-4bb4-b7b7-a6ba05d64ae2 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:05.844380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64989c4f-7b0e-4bb4-b7b7-a6ba05d64ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:05.844380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64989c4f-7b0e-4bb4-b7b7-a6ba05d64ae2 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:05.845779 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:44:05.850979 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd5c3e-2aae-4f07-9f44-6d708cdded94 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:05.851649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd5c3e-2aae-4f07-9f44-6d708cdded94 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:05.852293 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd5c3e-2aae-4f07-9f44-6d708cdded94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:05.931135 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-f7dd5c3e-2aae-4f07-9f44-6d708cdded94 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:44:05.932388 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f7dd5c3e-2aae-4f07-9f44-6d708cdded94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:06.003529 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:06.034052 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:44:06.186979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64989c4f-7b0e-4bb4-b7b7-a6ba05d64ae2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:44:06.188497 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-64989c4f-7b0e-4bb4-b7b7-a6ba05d64ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:06.206334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:06.336847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64989c4f-7b0e-4bb4-b7b7-a6ba05d64ae2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:44:06.425369 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:06.451826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59de577a-603e-4c6b-98a9-f758fa7bae49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:44:06.452480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de577a-603e-4c6b-98a9-f758fa7bae49 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:06.452762 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de577a-603e-4c6b-98a9-f758fa7bae49 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:06.453075 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de577a-603e-4c6b-98a9-f758fa7bae49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:06.454723 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-59de577a-603e-4c6b-98a9-f758fa7bae49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:06.545885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de577a-603e-4c6b-98a9-f758fa7bae49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:44:06.547516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59de577a-603e-4c6b-98a9-f758fa7bae49 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:44:06.566226 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 713/1434] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:44:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:07.462235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa476fd-47df-497d-81e8-a022158d17c8 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:07.462774 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa476fd-47df-497d-81e8-a022158d17c8 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:07.462774 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa476fd-47df-497d-81e8-a022158d17c8 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:07.464101 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:44:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:44:07.469245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16943e8f-0a69-4d36-be0f-f3e3f6ac4ecf None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:07.469753 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16943e8f-0a69-4d36-be0f-f3e3f6ac4ecf None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:07.469860 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16943e8f-0a69-4d36-be0f-f3e3f6ac4ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:07.547998 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-16943e8f-0a69-4d36-be0f-f3e3f6ac4ecf None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:44:07.549266 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-16943e8f-0a69-4d36-be0f-f3e3f6ac4ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:07.593234 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:07.650768 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:44:07.803753 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa476fd-47df-497d-81e8-a022158d17c8 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:44:07.806072 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6fa476fd-47df-497d-81e8-a022158d17c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:07.954587 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa476fd-47df-497d-81e8-a022158d17c8 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:44:08.009930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:08.071556 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20572fa-c7d5-4f32-b877-effff8c42e2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:44:08.072189 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20572fa-c7d5-4f32-b877-effff8c42e2a service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:08.072476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20572fa-c7d5-4f32-b877-effff8c42e2a service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:08.072751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20572fa-c7d5-4f32-b877-effff8c42e2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:08.074535 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a20572fa-c7d5-4f32-b877-effff8c42e2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:08.166826 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20572fa-c7d5-4f32-b877-effff8c42e2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:44:08.168484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20572fa-c7d5-4f32-b877-effff8c42e2a service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:44:08.188485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 723/1437] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:44:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:09.178998 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574dcc4-4170-4d50-bc37-a3ea0cfdb174 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:09.179676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574dcc4-4170-4d50-bc37-a3ea0cfdb174 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:09.179676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574dcc4-4170-4d50-bc37-a3ea0cfdb174 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:09.181089 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:44:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:44:09.186629 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc77db1-3e81-41fc-bad7-1fd0a9b5d271 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:09.187125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc77db1-3e81-41fc-bad7-1fd0a9b5d271 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:09.187228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc77db1-3e81-41fc-bad7-1fd0a9b5d271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:09.276206 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-0cc77db1-3e81-41fc-bad7-1fd0a9b5d271 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:44:09.277481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0cc77db1-3e81-41fc-bad7-1fd0a9b5d271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:09.279649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:09.385589 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:44:09.536731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574dcc4-4170-4d50-bc37-a3ea0cfdb174 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:44:09.538334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4574dcc4-4170-4d50-bc37-a3ea0cfdb174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:09.699137 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574dcc4-4170-4d50-bc37-a3ea0cfdb174 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:44:09.730515 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:09.831453 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18554c7-093c-4638-b0a8-6c28d8bc388b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:44:09.832031 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18554c7-093c-4638-b0a8-6c28d8bc388b service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:09.832376 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18554c7-093c-4638-b0a8-6c28d8bc388b service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:09.832592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18554c7-093c-4638-b0a8-6c28d8bc388b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:09.834335 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b18554c7-093c-4638-b0a8-6c28d8bc388b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:09.932140 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18554c7-093c-4638-b0a8-6c28d8bc388b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:44:09.933769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18554c7-093c-4638-b0a8-6c28d8bc388b service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:44:09.952233 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 716/1440] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:44:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:11.884016 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca8eda-f804-4605-aa4e-3d03b064ea8b None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:11.884610 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca8eda-f804-4605-aa4e-3d03b064ea8b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:11.884610 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca8eda-f804-4605-aa4e-3d03b064ea8b None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:11.886023 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:44:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:44:11.891366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af620878-917e-4ec9-a36d-3a2ff9368353 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:11.891768 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af620878-917e-4ec9-a36d-3a2ff9368353 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:11.891927 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af620878-917e-4ec9-a36d-3a2ff9368353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:11.932508 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:11.957928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-af620878-917e-4ec9-a36d-3a2ff9368353 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:44:11.959186 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-af620878-917e-4ec9-a36d-3a2ff9368353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:12.060179 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:44:12.099287 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca8eda-f804-4605-aa4e-3d03b064ea8b None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:44:12.100874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-93ca8eda-f804-4605-aa4e-3d03b064ea8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:12.207249 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca8eda-f804-4605-aa4e-3d03b064ea8b None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:44:12.240144 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:12.281885 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3e9318-7b5d-414f-bd9d-298a4bf604c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:44:12.282541 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e9318-7b5d-414f-bd9d-298a4bf604c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:12.282824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e9318-7b5d-414f-bd9d-298a4bf604c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:12.283097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3e9318-7b5d-414f-bd9d-298a4bf604c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:12.284737 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3c3e9318-7b5d-414f-bd9d-298a4bf604c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:12.395471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e9318-7b5d-414f-bd9d-298a4bf604c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:44:12.396816 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3e9318-7b5d-414f-bd9d-298a4bf604c9 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:44:12.416220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 726/1443] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:44:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:14.617698 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ea365-0cba-4f43-84a7-b0e8a87b4d4a None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:14.618279 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ea365-0cba-4f43-84a7-b0e8a87b4d4a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:14.618279 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ea365-0cba-4f43-84a7-b0e8a87b4d4a None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:14.619709 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:44:14.625414 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a241f-bc5d-47ec-89b6-455e2a46ad77 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:14.625914 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a241f-bc5d-47ec-89b6-455e2a46ad77 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:14.626024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a241f-bc5d-47ec-89b6-455e2a46ad77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:14.693996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e50a241f-bc5d-47ec-89b6-455e2a46ad77 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:44:14.695722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e50a241f-bc5d-47ec-89b6-455e2a46ad77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:14.708601 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:14.798482 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:44:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:44:14.837732 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ea365-0cba-4f43-84a7-b0e8a87b4d4a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:44:14.839310 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f76ea365-0cba-4f43-84a7-b0e8a87b4d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:14.943639 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ea365-0cba-4f43-84a7-b0e8a87b4d4a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:44:14.956207 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:15.025642 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a17443-d4c0-4e20-81c4-3ad29c0a1e22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:44:15.026301 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a17443-d4c0-4e20-81c4-3ad29c0a1e22 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:15.026587 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a17443-d4c0-4e20-81c4-3ad29c0a1e22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:15.026863 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a17443-d4c0-4e20-81c4-3ad29c0a1e22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:15.028551 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-41a17443-d4c0-4e20-81c4-3ad29c0a1e22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:15.140215 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a17443-d4c0-4e20-81c4-3ad29c0a1e22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:44:15.141706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a17443-d4c0-4e20-81c4-3ad29c0a1e22 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:44:15.159574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 719/1446] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:44:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:17.567108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd53a7-7b4a-40e3-aabd-353d549c49d2 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:17.567658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd53a7-7b4a-40e3-aabd-353d549c49d2 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:17.567658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd53a7-7b4a-40e3-aabd-353d549c49d2 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:17.569085 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:44:17.575385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caede64-995b-474b-92b7-4037a3fd39f1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:17.575826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caede64-995b-474b-92b7-4037a3fd39f1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:17.575947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caede64-995b-474b-92b7-4037a3fd39f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:17.624887 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:17.642256 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3caede64-995b-474b-92b7-4037a3fd39f1 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:44:17.643572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3caede64-995b-474b-92b7-4037a3fd39f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:17.739969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:44:17.780209 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd53a7-7b4a-40e3-aabd-353d549c49d2 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:44:17.781795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6afd53a7-7b4a-40e3-aabd-353d549c49d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:17.890772 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd53a7-7b4a-40e3-aabd-353d549c49d2 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:44:17.932821 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:17.966969 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3a5d9-b147-483d-98f6-6eeb3f92980f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:44:17.967635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3a5d9-b147-483d-98f6-6eeb3f92980f service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:17.967949 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3a5d9-b147-483d-98f6-6eeb3f92980f service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:17.968233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3a5d9-b147-483d-98f6-6eeb3f92980f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:17.969958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-89b3a5d9-b147-483d-98f6-6eeb3f92980f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:18.083672 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3a5d9-b147-483d-98f6-6eeb3f92980f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:44:18.085292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3a5d9-b147-483d-98f6-6eeb3f92980f service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:44:18.103909 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 729/1449] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:44:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:20.278282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c19922-5e19-43cb-a8d7-ebd9f97e255e None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:20.278877 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c19922-5e19-43cb-a8d7-ebd9f97e255e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:20.278877 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c19922-5e19-43cb-a8d7-ebd9f97e255e None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:20.280216 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:44:20.285606 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddb27b-c928-4113-88a7-cd2b4b12f4ab None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:20.286038 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddb27b-c928-4113-88a7-cd2b4b12f4ab None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:20.286173 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ddb27b-c928-4113-88a7-cd2b4b12f4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:20.352435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-f8ddb27b-c928-4113-88a7-cd2b4b12f4ab None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:44:20.353903 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f8ddb27b-c928-4113-88a7-cd2b4b12f4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:20.377951 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:20.455533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:44:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:44:20.494710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c19922-5e19-43cb-a8d7-ebd9f97e255e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:44:20.496278 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c5c19922-5e19-43cb-a8d7-ebd9f97e255e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:20.602638 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c19922-5e19-43cb-a8d7-ebd9f97e255e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:44:20.624520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:20.682176 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f49088-0a05-47ec-9916-054ca949a4ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:44:20.682828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f49088-0a05-47ec-9916-054ca949a4ab service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:20.683111 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f49088-0a05-47ec-9916-054ca949a4ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:20.683389 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f49088-0a05-47ec-9916-054ca949a4ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:20.685054 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-32f49088-0a05-47ec-9916-054ca949a4ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:20.800638 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f49088-0a05-47ec-9916-054ca949a4ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:44:20.802105 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f49088-0a05-47ec-9916-054ca949a4ab service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:44:20.823816 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 722/1452] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:44:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:22.952546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837e543-24eb-45a8-9e77-9b5f7828f299 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:22.953161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837e543-24eb-45a8-9e77-9b5f7828f299 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:22.953161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837e543-24eb-45a8-9e77-9b5f7828f299 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:22.954526 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:44:22.960744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1df25b-9e8d-46a2-9e10-9870a558cfa9 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:22.961225 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1df25b-9e8d-46a2-9e10-9870a558cfa9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:22.961363 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1df25b-9e8d-46a2-9e10-9870a558cfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:23.024883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:23.027766 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ab1df25b-9e8d-46a2-9e10-9870a558cfa9 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:44:23.036252 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ab1df25b-9e8d-46a2-9e10-9870a558cfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:23.128787 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:44:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:44:23.167801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837e543-24eb-45a8-9e77-9b5f7828f299 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:44:23.169482 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0837e543-24eb-45a8-9e77-9b5f7828f299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:23.273826 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837e543-24eb-45a8-9e77-9b5f7828f299 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:44:23.328532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:23.357469 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25924c9a-b2e6-4f76-8d41-07559ee79fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:44:23.358129 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25924c9a-b2e6-4f76-8d41-07559ee79fdd service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:23.358411 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25924c9a-b2e6-4f76-8d41-07559ee79fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:23.358687 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25924c9a-b2e6-4f76-8d41-07559ee79fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:23.360390 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-25924c9a-b2e6-4f76-8d41-07559ee79fdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:23.485030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25924c9a-b2e6-4f76-8d41-07559ee79fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:44:23.486732 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25924c9a-b2e6-4f76-8d41-07559ee79fdd service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:44:23.505739 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 732/1455] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:44:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:44:25.580312 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a293b-a04b-4776-801f-b96e514c6f86 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:25.580877 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a293b-a04b-4776-801f-b96e514c6f86 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:25.580877 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a293b-a04b-4776-801f-b96e514c6f86 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:25.582291 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:44:25.588044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a5d24-5e97-450d-b783-8c7aca69b9eb None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:25.588450 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a5d24-5e97-450d-b783-8c7aca69b9eb None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:25.588642 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a5d24-5e97-450d-b783-8c7aca69b9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:25.656180 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a84a5d24-5e97-450d-b783-8c7aca69b9eb None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:44:25.657431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a84a5d24-5e97-450d-b783-8c7aca69b9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:25.687382 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:25.758025 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:44:25.796714 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a293b-a04b-4776-801f-b96e514c6f86 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:44:25.798304 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7b0a293b-a04b-4776-801f-b96e514c6f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:25.906005 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a293b-a04b-4776-801f-b96e514c6f86 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:44:25.935712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:25.983617 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f060921-9cb4-4a9f-86c6-de3b0755e473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:44:25.984271 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f060921-9cb4-4a9f-86c6-de3b0755e473 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:25.984562 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f060921-9cb4-4a9f-86c6-de3b0755e473 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:25.984842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f060921-9cb4-4a9f-86c6-de3b0755e473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:25.986873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3f060921-9cb4-4a9f-86c6-de3b0755e473 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:26.101301 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f060921-9cb4-4a9f-86c6-de3b0755e473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:44:26.103486 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f060921-9cb4-4a9f-86c6-de3b0755e473 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:44:26.122402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 725/1458] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:44:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:28.211402 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e12b66-4639-4a06-93c6-9d0d0ebb84f7 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:28.211934 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e12b66-4639-4a06-93c6-9d0d0ebb84f7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:28.211934 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e12b66-4639-4a06-93c6-9d0d0ebb84f7 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:28.213386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:44:28.218793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047f1ea-4b92-4deb-a85c-c69ff0733256 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:28.219236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047f1ea-4b92-4deb-a85c-c69ff0733256 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:28.219354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047f1ea-4b92-4deb-a85c-c69ff0733256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:28.285247 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5047f1ea-4b92-4deb-a85c-c69ff0733256 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:44:28.286451 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5047f1ea-4b92-4deb-a85c-c69ff0733256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:28.295659 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:28.385128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:44:28.423833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e12b66-4639-4a06-93c6-9d0d0ebb84f7 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:44:28.425383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-09e12b66-4639-4a06-93c6-9d0d0ebb84f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:28.536849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e12b66-4639-4a06-93c6-9d0d0ebb84f7 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:44:28.592529 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:28.611174 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858564f3-1cde-47d6-b6a7-fb6b9e8fe395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:44:28.611834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858564f3-1cde-47d6-b6a7-fb6b9e8fe395 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:28.612117 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858564f3-1cde-47d6-b6a7-fb6b9e8fe395 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:28.612391 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858564f3-1cde-47d6-b6a7-fb6b9e8fe395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:28.614071 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-858564f3-1cde-47d6-b6a7-fb6b9e8fe395 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:28.728269 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858564f3-1cde-47d6-b6a7-fb6b9e8fe395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:44:28.729682 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858564f3-1cde-47d6-b6a7-fb6b9e8fe395 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:44:28.749174 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 735/1461] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:44:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:30.844165 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32288305-f2e9-47f0-be92-ea670348bc82 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:30.844857 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32288305-f2e9-47f0-be92-ea670348bc82 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:30.844857 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32288305-f2e9-47f0-be92-ea670348bc82 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:30.846178 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:44:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:44:30.851575 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92049d-c666-4969-9182-117aa7fb2501 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:30.851991 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92049d-c666-4969-9182-117aa7fb2501 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:30.852143 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f92049d-c666-4969-9182-117aa7fb2501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:30.918700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-5f92049d-c666-4969-9182-117aa7fb2501 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:44:30.919907 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5f92049d-c666-4969-9182-117aa7fb2501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:30.958725 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:31.023982 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:44:31.060458 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32288305-f2e9-47f0-be92-ea670348bc82 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:44:31.062080 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-32288305-f2e9-47f0-be92-ea670348bc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:31.168377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32288305-f2e9-47f0-be92-ea670348bc82 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:44:31.206428 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:31.242901 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ecca26-0ed4-4e6a-afbd-cdb198cdc421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:44:31.243546 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecca26-0ed4-4e6a-afbd-cdb198cdc421 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:31.243831 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecca26-0ed4-4e6a-afbd-cdb198cdc421 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:31.244183 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ecca26-0ed4-4e6a-afbd-cdb198cdc421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:31.245825 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-56ecca26-0ed4-4e6a-afbd-cdb198cdc421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:31.356162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecca26-0ed4-4e6a-afbd-cdb198cdc421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:44:31.357665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ecca26-0ed4-4e6a-afbd-cdb198cdc421 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:44:31.376809 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 728/1464] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:44:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:33.443537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696afc4b-65c1-437b-ac86-ebf0541df8d4 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:33.444313 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696afc4b-65c1-437b-ac86-ebf0541df8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:33.444313 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696afc4b-65c1-437b-ac86-ebf0541df8d4 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:33.445504 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:44:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:44:33.450919 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b7744-b61a-4ad8-b809-651bc6cef1b3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:33.451351 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b7744-b61a-4ad8-b809-651bc6cef1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:33.451480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b7744-b61a-4ad8-b809-651bc6cef1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:33.520206 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-369b7744-b61a-4ad8-b809-651bc6cef1b3 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:44:33.522089 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-369b7744-b61a-4ad8-b809-651bc6cef1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:33.546949 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:33.635193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:44:33.676320 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696afc4b-65c1-437b-ac86-ebf0541df8d4 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:44:33.678431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-696afc4b-65c1-437b-ac86-ebf0541df8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:33.790475 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696afc4b-65c1-437b-ac86-ebf0541df8d4 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:44:33.861000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:33.867684 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f075b7f-0590-494f-b5e5-0f19431179f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:44:33.868342 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f075b7f-0590-494f-b5e5-0f19431179f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:33.868626 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f075b7f-0590-494f-b5e5-0f19431179f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:33.868898 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f075b7f-0590-494f-b5e5-0f19431179f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:33.870588 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4f075b7f-0590-494f-b5e5-0f19431179f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:33.987350 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f075b7f-0590-494f-b5e5-0f19431179f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:44:33.988696 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f075b7f-0590-494f-b5e5-0f19431179f2 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:44:34.008209 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 738/1467] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:44:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:36.102225 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d37836-9869-4c87-af03-b98879ba016c None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:36.103119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d37836-9869-4c87-af03-b98879ba016c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:36.103119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d37836-9869-4c87-af03-b98879ba016c None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:36.104706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:44:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:44:36.110887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95e67d-bfde-406d-a14f-682e2918989d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:36.111338 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95e67d-bfde-406d-a14f-682e2918989d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:36.111448 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95e67d-bfde-406d-a14f-682e2918989d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:36.180626 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-0a95e67d-bfde-406d-a14f-682e2918989d None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:44:36.181859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0a95e67d-bfde-406d-a14f-682e2918989d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:36.230900 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:36.280386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:44:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:44:36.318159 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d37836-9869-4c87-af03-b98879ba016c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:44:36.319863 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-23d37836-9869-4c87-af03-b98879ba016c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:36.422634 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d37836-9869-4c87-af03-b98879ba016c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:44:36.469066 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:36.496568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0395009-de91-4e0a-ade0-0e8c6656c122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:44:36.497453 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0395009-de91-4e0a-ade0-0e8c6656c122 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:36.497951 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0395009-de91-4e0a-ade0-0e8c6656c122 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:36.498497 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0395009-de91-4e0a-ade0-0e8c6656c122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:36.500220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e0395009-de91-4e0a-ade0-0e8c6656c122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:36.611520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0395009-de91-4e0a-ade0-0e8c6656c122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:44:36.612956 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0395009-de91-4e0a-ade0-0e8c6656c122 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:44:36.631548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 731/1470] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:44:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:46.278634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=22 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:46.628956 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=66 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:56.462221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10196e77-ba20-4977-bcc0-0ec58124ce51 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:56.462753 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10196e77-ba20-4977-bcc0-0ec58124ce51 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:56.462753 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10196e77-ba20-4977-bcc0-0ec58124ce51 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:56.464129 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 740/1471] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:44:56.469791 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320a5ca-486f-4b25-a674-c7d20aa160f0 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:56.470247 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320a5ca-486f-4b25-a674-c7d20aa160f0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:56.470367 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6320a5ca-486f-4b25-a674-c7d20aa160f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:56.541408 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6320a5ca-486f-4b25-a674-c7d20aa160f0 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:44:56.542641 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6320a5ca-486f-4b25-a674-c7d20aa160f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:56.647045 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 732/1472] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:44:56.698159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5f7e3-f0a5-4625-a980-4eb825f1f550 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:56.698453 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5f7e3-f0a5-4625-a980-4eb825f1f550 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:56.698735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db5f7e3-f0a5-4625-a980-4eb825f1f550 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:56.700130 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 741/1473] 10.222.0.76 () {54 vars in 961 bytes} [Mon Jul 18 16:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:44:56.706007 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a0492-41d1-48d4-91b2-3a797ad7f481 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:56.708363 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a0492-41d1-48d4-91b2-3a797ad7f481 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:56.708363 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a0492-41d1-48d4-91b2-3a797ad7f481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:56.798897 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-073a0492-41d1-48d4-91b2-3a797ad7f481 None None] MFA Rules not processed for user `a1e1900754214020931b202e98f660a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:44:56.800245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-073a0492-41d1-48d4-91b2-3a797ad7f481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:56.826787 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:56.893450 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 733/1474] 10.222.0.76 () {58 vars in 1058 bytes} [Mon Jul 18 16:44:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:44:56.902007 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5f7e3-f0a5-4625-a980-4eb825f1f550 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:44:56.903533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1db5f7e3-f0a5-4625-a980-4eb825f1f550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:57.012856 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db5f7e3-f0a5-4625-a980-4eb825f1f550 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:44:57.096317 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64015b3-37e3-4038-9813-29addddcd516 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e1900754214020931b202e98f660a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:44:57.096889 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64015b3-37e3-4038-9813-29addddcd516 service glance] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:57.097200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64015b3-37e3-4038-9813-29addddcd516 service glance] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:57.097474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64015b3-37e3-4038-9813-29addddcd516 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:57.100594 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f64015b3-37e3-4038-9813-29addddcd516 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:57.297756 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:44:57.360853 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64015b3-37e3-4038-9813-29addddcd516 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:44:57.362269 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64015b3-37e3-4038-9813-29addddcd516 service glance] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:44:57.383015 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 742/1475] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:44:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:44:59.754883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218965e-5bc8-4e4d-a55c-cf387b41736f None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:59.755523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218965e-5bc8-4e4d-a55c-cf387b41736f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:59.755523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218965e-5bc8-4e4d-a55c-cf387b41736f None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:59.756836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 734/1476] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:44:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:44:59.762556 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442d5c6-1658-4fa3-bf28-129a0b1c42be None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:44:59.763067 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442d5c6-1658-4fa3-bf28-129a0b1c42be None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:44:59.763168 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442d5c6-1658-4fa3-bf28-129a0b1c42be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:44:59.832472 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-7442d5c6-1658-4fa3-bf28-129a0b1c42be None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:44:59.833740 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7442d5c6-1658-4fa3-bf28-129a0b1c42be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:44:59.937784 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 743/1477] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:44:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:44:59.962194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218965e-5bc8-4e4d-a55c-cf387b41736f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:44:59.963804 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0218965e-5bc8-4e4d-a55c-cf387b41736f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:00.105371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218965e-5bc8-4e4d-a55c-cf387b41736f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:45:00.176609 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:00.245605 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2273c-ee45-45fa-8821-dd1a2b624fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:45:00.246283 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2273c-ee45-45fa-8821-dd1a2b624fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:00.246569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2273c-ee45-45fa-8821-dd1a2b624fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:00.246845 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2273c-ee45-45fa-8821-dd1a2b624fd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:00.247585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2273c-ee45-45fa-8821-dd1a2b624fd1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:45:00.249411 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: WARNING py.warnings [None req-dbf2273c-ee45-45fa-8821-dd1a2b624fd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:45:00.249411 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: warnings.warn(msg) Jul 18 16:45:00.249411 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: Jul 18 16:45:00.250561 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2273c-ee45-45fa-8821-dd1a2b624fd1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:45:00.272834 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 735/1478] 10.222.0.76 () {56 vars in 1108 bytes} [Mon Jul 18 16:44:59 2022] GET /identity/v3/projects => generated 2553 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:45:02.390459 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848818-f7ae-4102-ab87-31d2c663c857 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:02.391082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848818-f7ae-4102-ab87-31d2c663c857 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:02.391082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a848818-f7ae-4102-ab87-31d2c663c857 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:02.392456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 744/1479] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:45:02.399823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9363c-9291-4eab-9ecb-5520265aa4c7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:02.400401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9363c-9291-4eab-9ecb-5520265aa4c7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:02.400514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd9363c-9291-4eab-9ecb-5520265aa4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:02.473341 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ecd9363c-9291-4eab-9ecb-5520265aa4c7 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:45:02.474613 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ecd9363c-9291-4eab-9ecb-5520265aa4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:02.573739 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 736/1480] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:45:02.616902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a848818-f7ae-4102-ab87-31d2c663c857 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:45:02.618470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4a848818-f7ae-4102-ab87-31d2c663c857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:02.628371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:02.774043 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a848818-f7ae-4102-ab87-31d2c663c857 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:45:02.855611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:02.890557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690c5d0-fb10-4e7c-b87d-073daa7cbe85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:45:02.891232 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690c5d0-fb10-4e7c-b87d-073daa7cbe85 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:02.891519 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690c5d0-fb10-4e7c-b87d-073daa7cbe85 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:02.891802 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690c5d0-fb10-4e7c-b87d-073daa7cbe85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:02.893597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f690c5d0-fb10-4e7c-b87d-073daa7cbe85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:02.986197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690c5d0-fb10-4e7c-b87d-073daa7cbe85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:45:02.988562 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690c5d0-fb10-4e7c-b87d-073daa7cbe85 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:45:03.012149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 745/1481] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:45:05.275035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c6013-b198-4f1b-b754-e627ce81e754 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:05.275593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c6013-b198-4f1b-b754-e627ce81e754 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:05.275593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c6013-b198-4f1b-b754-e627ce81e754 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:05.276979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 737/1482] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:45:05.282197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d4058-9040-4835-8773-8b1dad2cca09 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:05.282648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d4058-9040-4835-8773-8b1dad2cca09 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:05.282781 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d4058-9040-4835-8773-8b1dad2cca09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:05.354787 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-0d9d4058-9040-4835-8773-8b1dad2cca09 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:45:05.356170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0d9d4058-9040-4835-8773-8b1dad2cca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:05.405618 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:05.458506 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 746/1483] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:45:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:45:05.497060 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c6013-b198-4f1b-b754-e627ce81e754 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:45:05.498648 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3c2c6013-b198-4f1b-b754-e627ce81e754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:05.522821 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:05.606085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c6013-b198-4f1b-b754-e627ce81e754 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:45:05.683123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92c2f60-7c16-411d-8417-b6ce809cd557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:45:05.683780 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c2f60-7c16-411d-8417-b6ce809cd557 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:05.684064 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c2f60-7c16-411d-8417-b6ce809cd557 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:05.684853 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92c2f60-7c16-411d-8417-b6ce809cd557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:05.686810 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f92c2f60-7c16-411d-8417-b6ce809cd557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:05.764015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:05.803117 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c2f60-7c16-411d-8417-b6ce809cd557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:45:05.804619 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92c2f60-7c16-411d-8417-b6ce809cd557 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:45:05.822847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 738/1484] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:45:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:45:07.944567 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aabd3d-f8a3-4fd3-94b0-115c0616b858 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:07.945149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aabd3d-f8a3-4fd3-94b0-115c0616b858 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:07.945149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aabd3d-f8a3-4fd3-94b0-115c0616b858 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:07.946723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 747/1485] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:45:07.952079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dca2b-d916-4960-981e-603591e98dad None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:07.952563 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dca2b-d916-4960-981e-603591e98dad None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:07.952671 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dca2b-d916-4960-981e-603591e98dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:08.018494 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8e9dca2b-d916-4960-981e-603591e98dad None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:45:08.020917 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8e9dca2b-d916-4960-981e-603591e98dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:08.123909 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 739/1486] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:45:08.162413 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aabd3d-f8a3-4fd3-94b0-115c0616b858 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:45:08.163963 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e9aabd3d-f8a3-4fd3-94b0-115c0616b858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:08.270052 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aabd3d-f8a3-4fd3-94b0-115c0616b858 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:45:08.343526 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:08.345278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147c9d3e-3d6c-4ed4-b0a2-d7a7f2486cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:45:08.345951 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c9d3e-3d6c-4ed4-b0a2-d7a7f2486cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:08.346214 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c9d3e-3d6c-4ed4-b0a2-d7a7f2486cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:08.346493 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147c9d3e-3d6c-4ed4-b0a2-d7a7f2486cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:08.348328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-147c9d3e-3d6c-4ed4-b0a2-d7a7f2486cc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:08.462232 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c9d3e-3d6c-4ed4-b0a2-d7a7f2486cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:45:08.463593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147c9d3e-3d6c-4ed4-b0a2-d7a7f2486cc7 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:45:08.482564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 748/1487] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:45:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:45:10.689222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346997f-7673-456c-bafb-4216df4af60e None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:10.689808 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346997f-7673-456c-bafb-4216df4af60e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:10.690166 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346997f-7673-456c-bafb-4216df4af60e None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:10.692483 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 740/1488] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:45:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:45:10.698821 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9da5dc-084c-4bfd-a9cc-3a857e6fba50 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:10.699357 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9da5dc-084c-4bfd-a9cc-3a857e6fba50 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:10.699466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9da5dc-084c-4bfd-a9cc-3a857e6fba50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:10.780967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-9b9da5dc-084c-4bfd-a9cc-3a857e6fba50 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:45:10.782213 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9b9da5dc-084c-4bfd-a9cc-3a857e6fba50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:10.848963 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:10.903031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 749/1489] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:45:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:45:10.948248 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346997f-7673-456c-bafb-4216df4af60e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:45:10.949872 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0346997f-7673-456c-bafb-4216df4af60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:10.990172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:11.075840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346997f-7673-456c-bafb-4216df4af60e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:45:11.157363 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383df73-aade-4293-b6ce-1be1d91ef0d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:45:11.158034 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383df73-aade-4293-b6ce-1be1d91ef0d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:11.158319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383df73-aade-4293-b6ce-1be1d91ef0d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:11.158595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383df73-aade-4293-b6ce-1be1d91ef0d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:11.160910 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f383df73-aade-4293-b6ce-1be1d91ef0d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:11.264337 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:11.299794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383df73-aade-4293-b6ce-1be1d91ef0d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:45:11.302483 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383df73-aade-4293-b6ce-1be1d91ef0d6 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:45:11.323941 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 741/1490] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:45:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:45:13.782345 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b949f-4131-4fc1-a423-1b6edf64d6ab None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:13.782897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b949f-4131-4fc1-a423-1b6edf64d6ab None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:13.782897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b949f-4131-4fc1-a423-1b6edf64d6ab None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:13.784343 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 750/1491] 10.222.0.76 () {54 vars in 926 bytes} [Mon Jul 18 16:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:45:13.790340 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da886fa5-6f90-4825-8d98-1c33efcb2ac0 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:13.790800 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da886fa5-6f90-4825-8d98-1c33efcb2ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:13.790926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da886fa5-6f90-4825-8d98-1c33efcb2ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:13.860102 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-da886fa5-6f90-4825-8d98-1c33efcb2ac0 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:45:13.861351 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-da886fa5-6f90-4825-8d98-1c33efcb2ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:13.959173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 742/1492] 10.222.0.76 () {58 vars in 1023 bytes} [Mon Jul 18 16:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:45:13.999134 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b949f-4131-4fc1-a423-1b6edf64d6ab None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:45:14.000706 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6c3b949f-4131-4fc1-a423-1b6edf64d6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:14.112793 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b949f-4131-4fc1-a423-1b6edf64d6ab None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:45:14.196421 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f8635-2282-4f06-9478-de937e6bbacf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:45:14.197124 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f8635-2282-4f06-9478-de937e6bbacf service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:45:14.197411 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f8635-2282-4f06-9478-de937e6bbacf service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:45:14.197686 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f8635-2282-4f06-9478-de937e6bbacf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:45:14.199333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-007f8635-2282-4f06-9478-de937e6bbacf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:45:14.209199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:14.311776 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f8635-2282-4f06-9478-de937e6bbacf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:45:14.313229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f8635-2282-4f06-9478-de937e6bbacf service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:45:14.331871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 751/1493] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:45:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:45:23.956177 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=82 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:45:24.329054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=50 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:00.448659 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12a1ea-36b0-4c93-8ee9-70422061b30b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:00.449617 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12a1ea-36b0-4c93-8ee9-70422061b30b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:00.449905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b12a1ea-36b0-4c93-8ee9-70422061b30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:00.538468 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2b12a1ea-36b0-4c93-8ee9-70422061b30b None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:47:00.539734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2b12a1ea-36b0-4c93-8ee9-70422061b30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:47:00.657445 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 743/1494] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:47:00.666054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e04ea-0d1f-4981-b0ac-2942e1f8e63e None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:00.666862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e04ea-0d1f-4981-b0ac-2942e1f8e63e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:00.666862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e04ea-0d1f-4981-b0ac-2942e1f8e63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:00.772768 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-6d1e04ea-0d1f-4981-b0ac-2942e1f8e63e None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:47:00.774120 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6d1e04ea-0d1f-4981-b0ac-2942e1f8e63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:47:00.890751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 752/1495] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:47:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:47:00.895743 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12a1ea-36b0-4c93-8ee9-70422061b30b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:47:00.896982 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2b12a1ea-36b0-4c93-8ee9-70422061b30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:47:00.909680 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b12a1ea-36b0-4c93-8ee9-70422061b30b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:47:00.998959 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:01.042967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da860316-cffb-4f8b-a66a-c713b8c8834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:47:01.043207 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da860316-cffb-4f8b-a66a-c713b8c8834c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:01.043326 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da860316-cffb-4f8b-a66a-c713b8c8834c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:01.043606 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da860316-cffb-4f8b-a66a-c713b8c8834c admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:01.044345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da860316-cffb-4f8b-a66a-c713b8c8834c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:47:01.044656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da860316-cffb-4f8b-a66a-c713b8c8834c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:47:01.045711 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: WARNING py.warnings [None req-da860316-cffb-4f8b-a66a-c713b8c8834c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:47:01.045711 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: warnings.warn(msg) Jul 18 16:47:01.045711 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: Jul 18 16:47:01.046601 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da860316-cffb-4f8b-a66a-c713b8c8834c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:47:01.061858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 744/1496] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:47:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:47:01.070086 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e04ea-0d1f-4981-b0ac-2942e1f8e63e None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:47:01.082657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e04ea-0d1f-4981-b0ac-2942e1f8e63e None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:47:01.146698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:01.192123 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f09f3b-54d2-45a4-925b-888be11f4497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:47:01.192800 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f09f3b-54d2-45a4-925b-888be11f4497 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:01.193112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f09f3b-54d2-45a4-925b-888be11f4497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:01.193388 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f09f3b-54d2-45a4-925b-888be11f4497 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:01.194086 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f09f3b-54d2-45a4-925b-888be11f4497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:47:01.195995 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: WARNING py.warnings [None req-95f09f3b-54d2-45a4-925b-888be11f4497 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:47:01.195995 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: warnings.warn(msg) Jul 18 16:47:01.195995 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: Jul 18 16:47:01.197151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f09f3b-54d2-45a4-925b-888be11f4497 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:47:01.339674 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 753/1497] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:47:01 2022] POST /identity/v3/projects => generated 379 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:47:01.344193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da860316-cffb-4f8b-a66a-c713b8c8834c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:47:01.345846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-da860316-cffb-4f8b-a66a-c713b8c8834c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:47:01.388325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da860316-cffb-4f8b-a66a-c713b8c8834c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:47:01.532525 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be912ac-de43-4c97-98b5-2698d7f7b15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:47:01.533810 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be912ac-de43-4c97-98b5-2698d7f7b15e admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:01.534300 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be912ac-de43-4c97-98b5-2698d7f7b15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:01.534844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be912ac-de43-4c97-98b5-2698d7f7b15e admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:01.536187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be912ac-de43-4c97-98b5-2698d7f7b15e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:47:01.538188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: WARNING py.warnings [None req-9be912ac-de43-4c97-98b5-2698d7f7b15e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:47:01.538188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: warnings.warn(msg) Jul 18 16:47:01.538188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: Jul 18 16:47:01.540645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be912ac-de43-4c97-98b5-2698d7f7b15e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:47:01.732476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 745/1498] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:47:01 2022] POST /identity/v3/users => generated 290 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:47:01.737369 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f09f3b-54d2-45a4-925b-888be11f4497 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:47:01.740776 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-95f09f3b-54d2-45a4-925b-888be11f4497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:47:01.824510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f09f3b-54d2-45a4-925b-888be11f4497 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:47:01.940634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:01.954786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3873733-4528-4cc1-98f9-3ffdb528ed97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:47:01.956006 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3873733-4528-4cc1-98f9-3ffdb528ed97 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:01.956006 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3873733-4528-4cc1-98f9-3ffdb528ed97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:01.956223 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3873733-4528-4cc1-98f9-3ffdb528ed97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:01.956982 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3873733-4528-4cc1-98f9-3ffdb528ed97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:47:01.958046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: WARNING py.warnings [None req-c3873733-4528-4cc1-98f9-3ffdb528ed97 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:47:01.958046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: warnings.warn(msg) Jul 18 16:47:01.958046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: Jul 18 16:47:01.958953 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3873733-4528-4cc1-98f9-3ffdb528ed97 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:47:01.973492 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 754/1499] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:47:01.977833 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be912ac-de43-4c97-98b5-2698d7f7b15e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:47:01.979432 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9be912ac-de43-4c97-98b5-2698d7f7b15e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:47:01.991606 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be912ac-de43-4c97-98b5-2698d7f7b15e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:47:02.020693 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:02.102596 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c708a4e-39df-48da-a7ac-c27b4a00fa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:47:02.103287 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c708a4e-39df-48da-a7ac-c27b4a00fa86 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:02.103576 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c708a4e-39df-48da-a7ac-c27b4a00fa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:02.103893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c708a4e-39df-48da-a7ac-c27b4a00fa86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:02.105299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c708a4e-39df-48da-a7ac-c27b4a00fa86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:47:02.106458 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: WARNING py.warnings [None req-4c708a4e-39df-48da-a7ac-c27b4a00fa86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:47:02.106458 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: warnings.warn(msg) Jul 18 16:47:02.106458 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: Jul 18 16:47:02.107678 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c708a4e-39df-48da-a7ac-c27b4a00fa86 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:47:02.122938 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 746/1500] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:47:01 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:47:02.127309 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3873733-4528-4cc1-98f9-3ffdb528ed97 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:47:02.129564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c3873733-4528-4cc1-98f9-3ffdb528ed97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:47:02.184811 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3873733-4528-4cc1-98f9-3ffdb528ed97 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:47:02.190018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831dbeb3-a94e-4e3f-95a4-9715dde26e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:47:02.191038 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dbeb3-a94e-4e3f-95a4-9715dde26e7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:02.191322 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dbeb3-a94e-4e3f-95a4-9715dde26e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:02.191600 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831dbeb3-a94e-4e3f-95a4-9715dde26e7e admin admin] PATH_INFO: `/v3/projects/31f4fb4c1309403aaf8462fef6a9e7b6/users/a0ae92e637e046bc8c0996154d8046a9/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:02.229775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831dbeb3-a94e-4e3f-95a4-9715dde26e7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=31f4fb4c1309403aaf8462fef6a9e7b6, user_id=a0ae92e637e046bc8c0996154d8046a9, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:47:02.231244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: WARNING py.warnings [None req-831dbeb3-a94e-4e3f-95a4-9715dde26e7e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:47:02.231244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: warnings.warn(msg) Jul 18 16:47:02.231244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: Jul 18 16:47:02.233269 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831dbeb3-a94e-4e3f-95a4-9715dde26e7e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:47:02.331459 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 755/1501] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:47:02 2022] PUT /identity/v3/projects/31f4fb4c1309403aaf8462fef6a9e7b6/users/a0ae92e637e046bc8c0996154d8046a9/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:47:02.345456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827b353-b655-4dcd-a04e-356537b33afd None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:02.345820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827b353-b655-4dcd-a04e-356537b33afd None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:02.346171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827b353-b655-4dcd-a04e-356537b33afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:02.379809 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c827b353-b655-4dcd-a04e-356537b33afd None None] MFA Rules not processed for user `a0ae92e637e046bc8c0996154d8046a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:47:02.381273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c827b353-b655-4dcd-a04e-356537b33afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:47:02.473427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 747/1502] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:47:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:47:02.488750 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1466906-2f1a-4b9d-ac83-4fcd93bd68a6 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:02.489070 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1466906-2f1a-4b9d-ac83-4fcd93bd68a6 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:02.489357 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1466906-2f1a-4b9d-ac83-4fcd93bd68a6 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:02.490768 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 756/1503] 10.222.0.76 () {54 vars in 964 bytes} [Mon Jul 18 16:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:47:02.496778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5276642-9ea3-41fc-abf5-eed9f72a4bf4 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:02.497244 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5276642-9ea3-41fc-abf5-eed9f72a4bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:02.497530 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5276642-9ea3-41fc-abf5-eed9f72a4bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:02.575162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b5276642-9ea3-41fc-abf5-eed9f72a4bf4 None None] MFA Rules not processed for user `55d75cd269ff4f0daf51a728b159888a`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:47:02.576437 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b5276642-9ea3-41fc-abf5-eed9f72a4bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:47:02.608361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:02.687960 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 748/1504] 10.222.0.76 () {58 vars in 1061 bytes} [Mon Jul 18 16:47:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:47:02.696362 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1466906-2f1a-4b9d-ac83-4fcd93bd68a6 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:47:02.711805 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1466906-2f1a-4b9d-ac83-4fcd93bd68a6 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:47:02.717471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cceb9-490c-4b32-8134-5b192d6519c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:47:02.718373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cceb9-490c-4b32-8134-5b192d6519c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:02.718717 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cceb9-490c-4b32-8134-5b192d6519c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:02.719004 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cceb9-490c-4b32-8134-5b192d6519c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:02.728350 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cceb9-490c-4b32-8134-5b192d6519c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:47:02.731151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cceb9-490c-4b32-8134-5b192d6519c2 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:47:02.741575 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 757/1505] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:47:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:47:02.802264 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27ccfe-8f1c-44b6-968e-576ead41b497 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:02.802557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27ccfe-8f1c-44b6-968e-576ead41b497 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:02.802838 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d27ccfe-8f1c-44b6-968e-576ead41b497 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:02.804171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 749/1506] 10.222.0.76 () {52 vars in 829 bytes} [Mon Jul 18 16:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:47:02.808906 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cceb9-490c-4b32-8134-5b192d6519c2 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:47:02.883014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cceb9-490c-4b32-8134-5b192d6519c2 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:47:02.889162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ebefd-bd02-4f29-be4d-9ac371dd2a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:47:02.890241 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ebefd-bd02-4f29-be4d-9ac371dd2a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:02.890569 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ebefd-bd02-4f29-be4d-9ac371dd2a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:02.890907 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ebefd-bd02-4f29-be4d-9ac371dd2a6d admin admin] PATH_INFO: `/v3/users/a0ae92e637e046bc8c0996154d8046a9` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:02.892344 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ebefd-bd02-4f29-be4d-9ac371dd2a6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0ae92e637e046bc8c0996154d8046a9)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:47:02.893546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: WARNING py.warnings [None req-186ebefd-bd02-4f29-be4d-9ac371dd2a6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:47:02.893546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: warnings.warn(msg) Jul 18 16:47:02.893546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: Jul 18 16:47:02.895008 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186ebefd-bd02-4f29-be4d-9ac371dd2a6d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:47:03.321151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-186ebefd-bd02-4f29-be4d-9ac371dd2a6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0ae92e637e046bc8c0996154d8046a9'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:47:03.448189 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-186ebefd-bd02-4f29-be4d-9ac371dd2a6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0ae92e637e046bc8c0996154d8046a9'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:47:03.467250 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-186ebefd-bd02-4f29-be4d-9ac371dd2a6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0ae92e637e046bc8c0996154d8046a9'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:47:03.468104 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-186ebefd-bd02-4f29-be4d-9ac371dd2a6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0ae92e637e046bc8c0996154d8046a9'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:47:03.489950 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-186ebefd-bd02-4f29-be4d-9ac371dd2a6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0ae92e637e046bc8c0996154d8046a9'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:47:03.491788 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:03.497233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 758/1507] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:47:02 2022] DELETE /identity/v3/users/a0ae92e637e046bc8c0996154d8046a9 => generated 0 bytes in 689 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:47:03.501719 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8f937-c56f-45c4-abef-d0a082ebed11 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:03.508470 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8f937-c56f-45c4-abef-d0a082ebed11 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:03.508470 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f8f937-c56f-45c4-abef-d0a082ebed11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:03.533566 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-85f8f937-c56f-45c4-abef-d0a082ebed11 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:47:03.534821 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-85f8f937-c56f-45c4-abef-d0a082ebed11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:47:03.614163 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 750/1508] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:47:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:47:03.625214 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ebefd-bd02-4f29-be4d-9ac371dd2a6d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:47:03.626722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-186ebefd-bd02-4f29-be4d-9ac371dd2a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:47:03.720452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ebefd-bd02-4f29-be4d-9ac371dd2a6d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:47:03.724444 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3a662-3caf-4461-a2aa-0f5353837117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:47:03.725159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3a662-3caf-4461-a2aa-0f5353837117 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:03.725450 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3a662-3caf-4461-a2aa-0f5353837117 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:03.725734 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3a662-3caf-4461-a2aa-0f5353837117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:03.736397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3a662-3caf-4461-a2aa-0f5353837117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:47:03.738336 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3a662-3caf-4461-a2aa-0f5353837117 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:47:03.755526 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 759/1509] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:47:04.514062 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8f937-c56f-45c4-abef-d0a082ebed11 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:47:04.515950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-85f8f937-c56f-45c4-abef-d0a082ebed11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:47:04.538498 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f8f937-c56f-45c4-abef-d0a082ebed11 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:47:04.547994 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb643378-00ca-40b3-af1c-c5ba7040eb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:47:04.549115 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb643378-00ca-40b3-af1c-c5ba7040eb5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:47:04.549697 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb643378-00ca-40b3-af1c-c5ba7040eb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:47:04.550135 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb643378-00ca-40b3-af1c-c5ba7040eb5f admin admin] PATH_INFO: `/v3/projects/31f4fb4c1309403aaf8462fef6a9e7b6` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:47:04.552544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb643378-00ca-40b3-af1c-c5ba7040eb5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=31f4fb4c1309403aaf8462fef6a9e7b6)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:47:04.554540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: WARNING py.warnings [None req-fb643378-00ca-40b3-af1c-c5ba7040eb5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:47:04.554540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: warnings.warn(msg) Jul 18 16:47:04.554540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: Jul 18 16:47:04.556844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb643378-00ca-40b3-af1c-c5ba7040eb5f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:47:04.913742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fb643378-00ca-40b3-af1c-c5ba7040eb5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31f4fb4c1309403aaf8462fef6a9e7b6', 'request_id': 'req-fb643378-00ca-40b3-af1c-c5ba7040eb5f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:47:04.929786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fb643378-00ca-40b3-af1c-c5ba7040eb5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31f4fb4c1309403aaf8462fef6a9e7b6', 'request_id': 'req-fb643378-00ca-40b3-af1c-c5ba7040eb5f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:47:04.937478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fb643378-00ca-40b3-af1c-c5ba7040eb5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31f4fb4c1309403aaf8462fef6a9e7b6', 'request_id': 'req-fb643378-00ca-40b3-af1c-c5ba7040eb5f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:47:05.064255 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fb643378-00ca-40b3-af1c-c5ba7040eb5f admin admin] The token cache is being invalidate because project 31f4fb4c1309403aaf8462fef6a9e7b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:47:05.064556 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fb643378-00ca-40b3-af1c-c5ba7040eb5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:47:05.065464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fb643378-00ca-40b3-af1c-c5ba7040eb5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:47:05.067227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 751/1510] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:47:04 2022] DELETE /identity/v3/projects/31f4fb4c1309403aaf8462fef6a9e7b6 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:47:13.748043 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=36 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:47:15.060256 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:48:56.529423 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5c7a1-1d80-4330-9ac9-a107024c133b None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:48:56.530039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5c7a1-1d80-4330-9ac9-a107024c133b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:48:56.530039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5c7a1-1d80-4330-9ac9-a107024c133b None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:48:56.531410 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:48:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:48:56.537040 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42726d2-1ca7-4984-b7b2-539da82d9624 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:48:56.537668 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42726d2-1ca7-4984-b7b2-539da82d9624 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:48:56.537668 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42726d2-1ca7-4984-b7b2-539da82d9624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:48:56.578747 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b42726d2-1ca7-4984-b7b2-539da82d9624 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:48:56.579982 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b42726d2-1ca7-4984-b7b2-539da82d9624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:48:56.664990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:48:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:48:56.826319 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5c7a1-1d80-4330-9ac9-a107024c133b None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:48:56.828182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-89b5c7a1-1d80-4330-9ac9-a107024c133b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:48:56.951862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5c7a1-1d80-4330-9ac9-a107024c133b None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:48:56.958973 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce706932-6b06-4529-839f-347318fbc37f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:48:56.959691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce706932-6b06-4529-839f-347318fbc37f service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:48:56.959983 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce706932-6b06-4529-839f-347318fbc37f service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:48:56.960291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce706932-6b06-4529-839f-347318fbc37f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:48:56.973422 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce706932-6b06-4529-839f-347318fbc37f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:48:56.975083 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce706932-6b06-4529-839f-347318fbc37f service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:48:56.986262 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 761/1513] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:48:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:48:57.507355 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb9338-3707-45ed-b33a-781274eb7a3c None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:48:57.507591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb9338-3707-45ed-b33a-781274eb7a3c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:48:57.507930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb9338-3707-45ed-b33a-781274eb7a3c None None] PATH_INFO: `/v3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:48:57.509436 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 753/1514] 10.222.0.49 () {54 vars in 925 bytes} [Mon Jul 18 16:48:57 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:48:57.515393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e67d2f-de46-4e3d-8ccb-9301fda64cca None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:48:57.515686 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e67d2f-de46-4e3d-8ccb-9301fda64cca None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:48:57.515980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e67d2f-de46-4e3d-8ccb-9301fda64cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:48:57.572204 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d8e67d2f-de46-4e3d-8ccb-9301fda64cca None None] MFA Rules not processed for user `9c8d6afb4ccd41a5972e3241a3eebc7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:48:57.573531 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d8e67d2f-de46-4e3d-8ccb-9301fda64cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:48:57.657586 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 762/1515] 10.222.0.49 () {58 vars in 1015 bytes} [Mon Jul 18 16:48:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:48:57.883839 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae163930-791a-403a-8745-73541a572fa8 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:48:57.884440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae163930-791a-403a-8745-73541a572fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:48:57.884771 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae163930-791a-403a-8745-73541a572fa8 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:48:57.886313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 754/1516] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:48:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:48:57.892985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff09527-45ca-4cc2-a8a2-874d00ba491c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:48:57.893314 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff09527-45ca-4cc2-a8a2-874d00ba491c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:48:57.893599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff09527-45ca-4cc2-a8a2-874d00ba491c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:48:57.913897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-9ff09527-45ca-4cc2-a8a2-874d00ba491c None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:48:57.915143 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9ff09527-45ca-4cc2-a8a2-874d00ba491c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:48:57.924928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 763/1517] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:48:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:48:58.084077 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae163930-791a-403a-8745-73541a572fa8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:48:58.104912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae163930-791a-403a-8745-73541a572fa8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:48:58.110812 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931b4012-953a-4868-9f02-582f586de201 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:48:58.111474 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b4012-953a-4868-9f02-582f586de201 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:48:58.111763 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b4012-953a-4868-9f02-582f586de201 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:48:58.112045 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931b4012-953a-4868-9f02-582f586de201 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:48:58.122848 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b4012-953a-4868-9f02-582f586de201 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:48:58.124587 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931b4012-953a-4868-9f02-582f586de201 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:48:58.135376 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 755/1518] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:48:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:49:07.163127 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e945a-47d3-454b-8891-fe08d619c017 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:07.163677 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e945a-47d3-454b-8891-fe08d619c017 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:07.163677 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e945a-47d3-454b-8891-fe08d619c017 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:07.165063 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 764/1519] 10.222.0.76 () {54 vars in 961 bytes} [Mon Jul 18 16:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:49:07.169959 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eedeee-c4f6-4a80-8976-f28b4ee190c6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:07.170426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eedeee-c4f6-4a80-8976-f28b4ee190c6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:07.170526 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eedeee-c4f6-4a80-8976-f28b4ee190c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:07.188443 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a5eedeee-c4f6-4a80-8976-f28b4ee190c6 None None] MFA Rules not processed for user `9c8d6afb4ccd41a5972e3241a3eebc7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:07.189693 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a5eedeee-c4f6-4a80-8976-f28b4ee190c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:07.198509 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 756/1520] 10.222.0.76 () {58 vars in 1058 bytes} [Mon Jul 18 16:49:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:49:07.206463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e945a-47d3-454b-8891-fe08d619c017 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:07.221049 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e945a-47d3-454b-8891-fe08d619c017 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:07.227691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21416e06-3504-4282-a5d7-a975e32977e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c8d6afb4ccd41a5972e3241a3eebc7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:07.228391 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21416e06-3504-4282-a5d7-a975e32977e6 service placement] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:07.228679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21416e06-3504-4282-a5d7-a975e32977e6 service placement] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:07.229099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21416e06-3504-4282-a5d7-a975e32977e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:07.238509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21416e06-3504-4282-a5d7-a975e32977e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:07.240203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21416e06-3504-4282-a5d7-a975e32977e6 service placement] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:07.251981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 765/1521] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:49:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:49:09.400936 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bceb8-71c1-4883-985e-de5f3947f5c9 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:09.401575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bceb8-71c1-4883-985e-de5f3947f5c9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:09.401575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bceb8-71c1-4883-985e-de5f3947f5c9 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:09.403011 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:49:09.410885 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b3130-38b1-4d6e-861c-4fa507184d97 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:09.411464 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b3130-38b1-4d6e-861c-4fa507184d97 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:09.411464 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642b3130-38b1-4d6e-861c-4fa507184d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:09.420672 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:09.435667 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-642b3130-38b1-4d6e-861c-4fa507184d97 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:09.436070 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-642b3130-38b1-4d6e-861c-4fa507184d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:09.445484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:49:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:49:09.605440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bceb8-71c1-4883-985e-de5f3947f5c9 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:09.619533 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bceb8-71c1-4883-985e-de5f3947f5c9 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:09.625096 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da90e66f-9246-4700-8dff-fe810789bbc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:09.625730 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90e66f-9246-4700-8dff-fe810789bbc5 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:09.626012 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90e66f-9246-4700-8dff-fe810789bbc5 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:09.626292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da90e66f-9246-4700-8dff-fe810789bbc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:09.635428 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90e66f-9246-4700-8dff-fe810789bbc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:09.637059 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da90e66f-9246-4700-8dff-fe810789bbc5 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:09.648143 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 758/1524] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:49:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:49:10.499010 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f4869-adf7-4bfc-adfa-9dc144b89a69 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:10.499577 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f4869-adf7-4bfc-adfa-9dc144b89a69 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:10.499577 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96f4869-adf7-4bfc-adfa-9dc144b89a69 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:10.500888 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 18 16:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:49:10.507005 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951958a0-e1eb-48de-a734-6827262c3d2d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:10.507768 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951958a0-e1eb-48de-a734-6827262c3d2d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:10.507768 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951958a0-e1eb-48de-a734-6827262c3d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:10.531032 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-951958a0-e1eb-48de-a734-6827262c3d2d None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:10.532314 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-951958a0-e1eb-48de-a734-6827262c3d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:10.541778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 18 16:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:49:10.714621 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f4869-adf7-4bfc-adfa-9dc144b89a69 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:10.730630 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96f4869-adf7-4bfc-adfa-9dc144b89a69 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:10.736166 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a29805-548d-4d41-8ecd-6706f9ece080 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:10.736857 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a29805-548d-4d41-8ecd-6706f9ece080 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:10.737285 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a29805-548d-4d41-8ecd-6706f9ece080 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:10.737588 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a29805-548d-4d41-8ecd-6706f9ece080 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:10.746341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a29805-548d-4d41-8ecd-6706f9ece080 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:10.747926 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a29805-548d-4d41-8ecd-6706f9ece080 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:10.757894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 768/1527] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:49:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:49:15.442937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e1201-fbaf-446a-9c08-811bb14907dd None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:15.443509 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e1201-fbaf-446a-9c08-811bb14907dd None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:15.443509 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e1201-fbaf-446a-9c08-811bb14907dd None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:15.444809 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:49:15.450391 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81735e26-93ce-410c-a496-30a96601d826 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:15.450861 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81735e26-93ce-410c-a496-30a96601d826 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:15.450961 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81735e26-93ce-410c-a496-30a96601d826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:15.469141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-81735e26-93ce-410c-a496-30a96601d826 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:15.470403 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-81735e26-93ce-410c-a496-30a96601d826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:15.478753 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:49:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:49:15.520993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e1201-fbaf-446a-9c08-811bb14907dd None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:15.522826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-574e1201-fbaf-446a-9c08-811bb14907dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:15.586346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e1201-fbaf-446a-9c08-811bb14907dd None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:15.589928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a381d53a-c1e6-4c24-9341-f032667632ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:15.590559 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381d53a-c1e6-4c24-9341-f032667632ca service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:15.590844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381d53a-c1e6-4c24-9341-f032667632ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:15.591124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a381d53a-c1e6-4c24-9341-f032667632ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:15.602162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381d53a-c1e6-4c24-9341-f032667632ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:15.603631 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a381d53a-c1e6-4c24-9341-f032667632ca service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:15.614434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 761/1530] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:49:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:49:17.728876 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374d49e-9aea-403f-8120-5898cda7f850 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:17.729998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374d49e-9aea-403f-8120-5898cda7f850 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:17.729998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374d49e-9aea-403f-8120-5898cda7f850 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:17.731339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:49:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:49:17.739036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c973d0-a413-4b1d-b7ba-b208d156e5e4 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:17.739628 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c973d0-a413-4b1d-b7ba-b208d156e5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:17.739746 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c973d0-a413-4b1d-b7ba-b208d156e5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:17.763581 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e3c973d0-a413-4b1d-b7ba-b208d156e5e4 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:17.765113 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e3c973d0-a413-4b1d-b7ba-b208d156e5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:17.776078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:49:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:49:17.817043 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374d49e-9aea-403f-8120-5898cda7f850 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:17.832168 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374d49e-9aea-403f-8120-5898cda7f850 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:17.837433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f057aaf-3a9e-455f-b908-68ce92d5b46c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:17.838507 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f057aaf-3a9e-455f-b908-68ce92d5b46c service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:17.838941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f057aaf-3a9e-455f-b908-68ce92d5b46c service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:17.839433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f057aaf-3a9e-455f-b908-68ce92d5b46c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:17.852916 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f057aaf-3a9e-455f-b908-68ce92d5b46c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:17.854837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f057aaf-3a9e-455f-b908-68ce92d5b46c service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:17.868909 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 771/1533] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:49:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:49:22.113788 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb5d10-94a2-4ee9-b462-b3cd6d5ab7f1 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:22.114371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb5d10-94a2-4ee9-b462-b3cd6d5ab7f1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:22.114371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb5d10-94a2-4ee9-b462-b3cd6d5ab7f1 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:22.115785 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:49:22.122312 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e6eab-8190-4dee-9442-02ffec8898ff None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:22.123127 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e6eab-8190-4dee-9442-02ffec8898ff None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:22.123326 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e6eab-8190-4dee-9442-02ffec8898ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:22.144113 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-995e6eab-8190-4dee-9442-02ffec8898ff None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:22.145402 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-995e6eab-8190-4dee-9442-02ffec8898ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:22.154733 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:49:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:49:22.479945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb5d10-94a2-4ee9-b462-b3cd6d5ab7f1 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:22.481826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3fcb5d10-94a2-4ee9-b462-b3cd6d5ab7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:22.541333 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:22.555025 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb5d10-94a2-4ee9-b462-b3cd6d5ab7f1 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:22.558943 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcadf5-5fed-4857-b14a-322f52972f9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:22.559663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcadf5-5fed-4857-b14a-322f52972f9b service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:22.559967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcadf5-5fed-4857-b14a-322f52972f9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:22.560254 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcadf5-5fed-4857-b14a-322f52972f9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:22.571613 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcadf5-5fed-4857-b14a-322f52972f9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:22.573557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcadf5-5fed-4857-b14a-322f52972f9b service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:22.586597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 764/1536] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:49:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:49:24.738363 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30d1eb-06b2-4d15-824d-0e70423deadf None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:24.739131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30d1eb-06b2-4d15-824d-0e70423deadf None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:24.739131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30d1eb-06b2-4d15-824d-0e70423deadf None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:24.740358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 18 16:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:49:24.746396 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78708b7d-52e4-44f6-a73e-27e57237c323 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:24.747012 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78708b7d-52e4-44f6-a73e-27e57237c323 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:24.747012 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78708b7d-52e4-44f6-a73e-27e57237c323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:24.772383 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-78708b7d-52e4-44f6-a73e-27e57237c323 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:49:24.774120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-78708b7d-52e4-44f6-a73e-27e57237c323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:24.782536 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 18 16:49:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:49:25.108941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30d1eb-06b2-4d15-824d-0e70423deadf None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:49:25.111486 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8e30d1eb-06b2-4d15-824d-0e70423deadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:49:25.129518 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30d1eb-06b2-4d15-824d-0e70423deadf None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:49:25.135453 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f17930-1618-4bd7-9ace-3dd4f376a616 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:49:25.136501 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f17930-1618-4bd7-9ace-3dd4f376a616 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:49:25.136955 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f17930-1618-4bd7-9ace-3dd4f376a616 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:49:25.137474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f17930-1618-4bd7-9ace-3dd4f376a616 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:49:25.154773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f17930-1618-4bd7-9ace-3dd4f376a616 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:49:25.156357 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f17930-1618-4bd7-9ace-3dd4f376a616 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:49:25.168311 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 774/1539] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:49:34.765585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=10 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:49:35.162693 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=26 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:05.211524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dec1fc-d26b-4642-b4f9-38c87a1b8fb5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:05.211524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dec1fc-d26b-4642-b4f9-38c87a1b8fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:05.211524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dec1fc-d26b-4642-b4f9-38c87a1b8fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:05.234969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e4dec1fc-d26b-4642-b4f9-38c87a1b8fb5 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:05.236207 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e4dec1fc-d26b-4642-b4f9-38c87a1b8fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:05.247139 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 766/1540] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:05.256739 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e95e8f-5ac5-4b66-96df-4ff68c9d2b8d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:05.257361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e95e8f-5ac5-4b66-96df-4ff68c9d2b8d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:05.257361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e95e8f-5ac5-4b66-96df-4ff68c9d2b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:05.281719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-19e95e8f-5ac5-4b66-96df-4ff68c9d2b8d None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:05.282989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-19e95e8f-5ac5-4b66-96df-4ff68c9d2b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:05.301049 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 775/1541] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:05.305729 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dec1fc-d26b-4642-b4f9-38c87a1b8fb5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:05.318482 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dec1fc-d26b-4642-b4f9-38c87a1b8fb5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:05.332521 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a72bde-d2ec-4754-aade-6dbc475f50f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:05.333242 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a72bde-d2ec-4754-aade-6dbc475f50f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:05.333533 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a72bde-d2ec-4754-aade-6dbc475f50f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:05.333815 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a72bde-d2ec-4754-aade-6dbc475f50f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:05.334569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a72bde-d2ec-4754-aade-6dbc475f50f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:05.334880 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a72bde-d2ec-4754-aade-6dbc475f50f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:05.336507 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a72bde-d2ec-4754-aade-6dbc475f50f2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:05.355308 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 767/1542] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:05.368708 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e95e8f-5ac5-4b66-96df-4ff68c9d2b8d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:05.382805 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e95e8f-5ac5-4b66-96df-4ff68c9d2b8d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:05.397770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab72888-5cc3-4b79-b6b4-efac899ee9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:05.398485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab72888-5cc3-4b79-b6b4-efac899ee9cb admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:05.398771 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab72888-5cc3-4b79-b6b4-efac899ee9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:05.399048 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab72888-5cc3-4b79-b6b4-efac899ee9cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:05.399762 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab72888-5cc3-4b79-b6b4-efac899ee9cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:05.401737 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab72888-5cc3-4b79-b6b4-efac899ee9cb admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:05.566305 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 776/1543] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:05 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:05.571290 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a72bde-d2ec-4754-aade-6dbc475f50f2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:05.589171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a72bde-d2ec-4754-aade-6dbc475f50f2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:05.679043 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc3a8c-ded3-43b7-8bfb-b0a921e115d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:05.679732 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc3a8c-ded3-43b7-8bfb-b0a921e115d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:05.680017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc3a8c-ded3-43b7-8bfb-b0a921e115d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:05.680295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc3a8c-ded3-43b7-8bfb-b0a921e115d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:05.680994 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc3a8c-ded3-43b7-8bfb-b0a921e115d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:05.682973 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc3a8c-ded3-43b7-8bfb-b0a921e115d5 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:05.766713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b0ef2-5a37-488d-ba08-5112d382e534 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:05.767089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b0ef2-5a37-488d-ba08-5112d382e534 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:05.767278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b0ef2-5a37-488d-ba08-5112d382e534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:05.778908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 768/1544] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:05 2022] POST /identity/v3/users => generated 289 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:05.784520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc3a8c-ded3-43b7-8bfb-b0a921e115d5 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:05.798265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a55b0ef2-5a37-488d-ba08-5112d382e534 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:05.799302 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc3a8c-ded3-43b7-8bfb-b0a921e115d5 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:05.799529 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a55b0ef2-5a37-488d-ba08-5112d382e534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:05.808380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62fd2b-acb0-4908-a1a7-a272a65b23f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:05.809096 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62fd2b-acb0-4908-a1a7-a272a65b23f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:05.809385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62fd2b-acb0-4908-a1a7-a272a65b23f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:05.809665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62fd2b-acb0-4908-a1a7-a272a65b23f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:05.810405 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62fd2b-acb0-4908-a1a7-a272a65b23f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:05.813314 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62fd2b-acb0-4908-a1a7-a272a65b23f0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:05.825534 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 777/1545] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:05.834573 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10267305-1d18-470f-85f7-42c78c0b6416 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:05.834894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10267305-1d18-470f-85f7-42c78c0b6416 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:05.835212 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10267305-1d18-470f-85f7-42c78c0b6416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:05.836799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 769/1546] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:51:05.841588 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62fd2b-acb0-4908-a1a7-a272a65b23f0 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:05.858171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62fd2b-acb0-4908-a1a7-a272a65b23f0 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:05.871562 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a044e-db1f-4221-a925-6bff177677a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:05.872516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a044e-db1f-4221-a925-6bff177677a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:05.872980 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a044e-db1f-4221-a925-6bff177677a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:05.873502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a044e-db1f-4221-a925-6bff177677a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:05.873819 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-10267305-1d18-470f-85f7-42c78c0b6416 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:05.875425 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a044e-db1f-4221-a925-6bff177677a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:05.875985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-10267305-1d18-470f-85f7-42c78c0b6416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:05.878696 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7a044e-db1f-4221-a925-6bff177677a8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:05.901707 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 770/1547] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:05 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:05.907145 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a044e-db1f-4221-a925-6bff177677a8 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:05.912286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 778/1548] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:05.916855 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10267305-1d18-470f-85f7-42c78c0b6416 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:05.924046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a044e-db1f-4221-a925-6bff177677a8 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:05.931297 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10267305-1d18-470f-85f7-42c78c0b6416 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:05.932595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f270690-6201-47ab-9480-3d71e927ad3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:05.933561 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f270690-6201-47ab-9480-3d71e927ad3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:05.933844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f270690-6201-47ab-9480-3d71e927ad3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:05.934119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f270690-6201-47ab-9480-3d71e927ad3c admin admin] PATH_INFO: `/v3/projects/b5d7c6ee418c41cb833e47c51ea4158b/users/d6df4c3768134ebeb90d5566624a7cdd/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:05.948408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba421e-0919-48f0-aebc-e80658aa3d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:05.949137 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba421e-0919-48f0-aebc-e80658aa3d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:05.949425 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba421e-0919-48f0-aebc-e80658aa3d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:05.949700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ba421e-0919-48f0-aebc-e80658aa3d5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:05.950439 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba421e-0919-48f0-aebc-e80658aa3d5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:05.950899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba421e-0919-48f0-aebc-e80658aa3d5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:05.951968 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: WARNING py.warnings [None req-f8ba421e-0919-48f0-aebc-e80658aa3d5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:51:05.951968 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: warnings.warn(msg) Jul 18 16:51:05.951968 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: Jul 18 16:51:05.953624 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ba421e-0919-48f0-aebc-e80658aa3d5f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:05.977036 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 779/1549] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:51:05.979461 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f270690-6201-47ab-9480-3d71e927ad3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d7c6ee418c41cb833e47c51ea4158b, user_id=d6df4c3768134ebeb90d5566624a7cdd, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:05.982921 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: WARNING py.warnings [None req-5f270690-6201-47ab-9480-3d71e927ad3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:51:05.982921 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: warnings.warn(msg) Jul 18 16:51:05.982921 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: Jul 18 16:51:05.982921 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f270690-6201-47ab-9480-3d71e927ad3c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:05.990243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba421e-0919-48f0-aebc-e80658aa3d5f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:06.008741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ba421e-0919-48f0-aebc-e80658aa3d5f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:06.020205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92413414-7729-40ef-81b1-5542310f147c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:06.020896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92413414-7729-40ef-81b1-5542310f147c admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.021213 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92413414-7729-40ef-81b1-5542310f147c admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.021666 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92413414-7729-40ef-81b1-5542310f147c admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.022383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92413414-7729-40ef-81b1-5542310f147c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:06.024381 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92413414-7729-40ef-81b1-5542310f147c admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:06.076511 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 771/1550] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:05 2022] PUT /identity/v3/projects/b5d7c6ee418c41cb833e47c51ea4158b/users/d6df4c3768134ebeb90d5566624a7cdd/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:06.089190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956011a-a93b-4753-a026-cea8750fef8d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.089577 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956011a-a93b-4753-a026-cea8750fef8d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.089772 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956011a-a93b-4753-a026-cea8750fef8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.126319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e956011a-a93b-4753-a026-cea8750fef8d None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:06.127558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e956011a-a93b-4753-a026-cea8750fef8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:06.175372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 780/1551] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:05 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:06.178791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6391d-0e09-4589-95fb-0c49d08fd8a5 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.178791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6391d-0e09-4589-95fb-0c49d08fd8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.178791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e6391d-0e09-4589-95fb-0c49d08fd8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.226372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-38e6391d-0e09-4589-95fb-0c49d08fd8a5 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:06.227614 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-38e6391d-0e09-4589-95fb-0c49d08fd8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:06.251059 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 772/1552] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:06.251059 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956011a-a93b-4753-a026-cea8750fef8d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:06.266938 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956011a-a93b-4753-a026-cea8750fef8d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:06.290406 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:06.319554 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 781/1553] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:06.321688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad02197-8b51-4086-8b61-913ea81b9d6b None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.322144 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad02197-8b51-4086-8b61-913ea81b9d6b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.322606 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad02197-8b51-4086-8b61-913ea81b9d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.336061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b20388-aecc-4f79-9e69-506b0c533bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:06.336673 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b20388-aecc-4f79-9e69-506b0c533bf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.336965 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b20388-aecc-4f79-9e69-506b0c533bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.337279 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b20388-aecc-4f79-9e69-506b0c533bf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.337983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b20388-aecc-4f79-9e69-506b0c533bf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:06.339922 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b20388-aecc-4f79-9e69-506b0c533bf2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:06.344748 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-dad02197-8b51-4086-8b61-913ea81b9d6b None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:06.346170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-dad02197-8b51-4086-8b61-913ea81b9d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:06.354999 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 782/1554] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:06.356287 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014a322-fe2f-43e0-9e37-c0a4952459dc None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.356572 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014a322-fe2f-43e0-9e37-c0a4952459dc None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.356849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7014a322-fe2f-43e0-9e37-c0a4952459dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.378886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-7014a322-fe2f-43e0-9e37-c0a4952459dc None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:06.381296 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7014a322-fe2f-43e0-9e37-c0a4952459dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:06.394161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 783/1555] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:06.395507 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f6ea8-e888-44ee-92b2-c461b42ea0ca None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.395800 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f6ea8-e888-44ee-92b2-c461b42ea0ca None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.396080 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f6ea8-e888-44ee-92b2-c461b42ea0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.421100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-682f6ea8-e888-44ee-92b2-c461b42ea0ca None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:06.423037 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-682f6ea8-e888-44ee-92b2-c461b42ea0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:06.431038 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 784/1556] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:06.431858 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f6ea8-e888-44ee-92b2-c461b42ea0ca None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:06.433243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-682f6ea8-e888-44ee-92b2-c461b42ea0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:06.486757 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 773/1557] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:06 2022] POST /identity/v3/users => generated 287 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:06.488626 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef941c-f3d7-405f-a0f7-a3a82ef702d5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.489043 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef941c-f3d7-405f-a0f7-a3a82ef702d5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.489368 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef941c-f3d7-405f-a0f7-a3a82ef702d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.496688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f6ea8-e888-44ee-92b2-c461b42ea0ca None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:06.501825 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c413c5-1bc9-4cea-933c-fd1e3d8ff8c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:06.502505 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c413c5-1bc9-4cea-933c-fd1e3d8ff8c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.502787 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c413c5-1bc9-4cea-933c-fd1e3d8ff8c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.503059 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c413c5-1bc9-4cea-933c-fd1e3d8ff8c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.510425 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6fef941c-f3d7-405f-a0f7-a3a82ef702d5 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:06.511637 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6fef941c-f3d7-405f-a0f7-a3a82ef702d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:06.513092 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c413c5-1bc9-4cea-933c-fd1e3d8ff8c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:06.514516 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c413c5-1bc9-4cea-933c-fd1e3d8ff8c3 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:06.518788 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:06.520252 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 774/1558] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:06.521723 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72657f55-268e-4788-8424-8218179cb1cb None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.522022 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72657f55-268e-4788-8424-8218179cb1cb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.522565 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72657f55-268e-4788-8424-8218179cb1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.526711 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 785/1559] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:06.528083 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9d1c0-6314-441a-a639-4942b3262351 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.528512 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9d1c0-6314-441a-a639-4942b3262351 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.528983 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec9d1c0-6314-441a-a639-4942b3262351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.541870 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-72657f55-268e-4788-8424-8218179cb1cb None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:06.546845 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-72657f55-268e-4788-8424-8218179cb1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:06.549197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-2ec9d1c0-6314-441a-a639-4942b3262351 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:06.550433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2ec9d1c0-6314-441a-a639-4942b3262351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:06.552894 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 775/1560] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:06.554339 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d931c3-38f3-421d-8f0c-e858b56435b5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.554741 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d931c3-38f3-421d-8f0c-e858b56435b5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.555033 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d931c3-38f3-421d-8f0c-e858b56435b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.559122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 786/1561] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:06.560383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226685e7-3a48-4935-b52b-e5bcbad98011 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.560675 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226685e7-3a48-4935-b52b-e5bcbad98011 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.560954 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226685e7-3a48-4935-b52b-e5bcbad98011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.576735 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-92d931c3-38f3-421d-8f0c-e858b56435b5 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:06.578037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-92d931c3-38f3-421d-8f0c-e858b56435b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:06.579369 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-226685e7-3a48-4935-b52b-e5bcbad98011 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:06.580601 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-226685e7-3a48-4935-b52b-e5bcbad98011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:06.586576 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 776/1562] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:06.587801 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2895691-09f0-4ba8-afc5-12772c1c7015 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.588090 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2895691-09f0-4ba8-afc5-12772c1c7015 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.588371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2895691-09f0-4ba8-afc5-12772c1c7015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.591855 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 787/1563] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:06.592706 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226685e7-3a48-4935-b52b-e5bcbad98011 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:06.603440 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226685e7-3a48-4935-b52b-e5bcbad98011 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:06.608988 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b12d4d-c0d7-4f35-b32e-6c0aacbf701d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:06.613943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b12d4d-c0d7-4f35-b32e-6c0aacbf701d admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.613943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b12d4d-c0d7-4f35-b32e-6c0aacbf701d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.614223 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e2895691-09f0-4ba8-afc5-12772c1c7015 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:06.614325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b12d4d-c0d7-4f35-b32e-6c0aacbf701d admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.614325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b12d4d-c0d7-4f35-b32e-6c0aacbf701d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:06.614507 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e2895691-09f0-4ba8-afc5-12772c1c7015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:06.614606 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b12d4d-c0d7-4f35-b32e-6c0aacbf701d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:06.620488 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 777/1564] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:06.621887 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d4d4d-826b-48f2-af90-3dc855158055 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.622238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d4d4d-826b-48f2-af90-3dc855158055 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.622579 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d4d4d-826b-48f2-af90-3dc855158055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.627771 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 788/1565] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:06.627771 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b12d4d-c0d7-4f35-b32e-6c0aacbf701d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:06.635979 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b12d4d-c0d7-4f35-b32e-6c0aacbf701d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:06.641303 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360f70c-d71c-465a-a569-e4f069790acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:06.642010 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360f70c-d71c-465a-a569-e4f069790acd admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.642315 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360f70c-d71c-465a-a569-e4f069790acd admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.642587 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9360f70c-d71c-465a-a569-e4f069790acd admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.643320 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360f70c-d71c-465a-a569-e4f069790acd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:06.643625 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360f70c-d71c-465a-a569-e4f069790acd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:06.645293 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9360f70c-d71c-465a-a569-e4f069790acd admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:06.647579 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b88d4d4d-826b-48f2-af90-3dc855158055 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:06.649323 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b88d4d4d-826b-48f2-af90-3dc855158055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:06.665436 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 789/1566] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:06.667379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 778/1567] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:06.667497 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360f70c-d71c-465a-a569-e4f069790acd admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:06.667605 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d4d4d-826b-48f2-af90-3dc855158055 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:06.675561 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d4d4d-826b-48f2-af90-3dc855158055 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:06.676119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9360f70c-d71c-465a-a569-e4f069790acd admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:06.680298 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308846d-4dd6-4be2-a898-a4f880ad5b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:06.680971 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308846d-4dd6-4be2-a898-a4f880ad5b2f admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.681177 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d3946-e1ad-4460-8013-f0907aa10b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:06.681298 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308846d-4dd6-4be2-a898-a4f880ad5b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.681572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308846d-4dd6-4be2-a898-a4f880ad5b2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.681830 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d3946-e1ad-4460-8013-f0907aa10b63 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.682120 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d3946-e1ad-4460-8013-f0907aa10b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.682311 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308846d-4dd6-4be2-a898-a4f880ad5b2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:06.682424 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d3946-e1ad-4460-8013-f0907aa10b63 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.682617 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308846d-4dd6-4be2-a898-a4f880ad5b2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:06.683112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d3946-e1ad-4460-8013-f0907aa10b63 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:06.683419 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d3946-e1ad-4460-8013-f0907aa10b63 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:06.684219 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308846d-4dd6-4be2-a898-a4f880ad5b2f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:06.685181 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4d3946-e1ad-4460-8013-f0907aa10b63 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:06.706633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 779/1568] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:06.706980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 790/1569] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:06.706980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d3946-e1ad-4460-8013-f0907aa10b63 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:06.707171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f946d71-3cc5-4239-9cae-7f6c4b8e3cf1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.707171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f946d71-3cc5-4239-9cae-7f6c4b8e3cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.707171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f946d71-3cc5-4239-9cae-7f6c4b8e3cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.715751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d3946-e1ad-4460-8013-f0907aa10b63 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:06.721168 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c828ae-3730-406d-ac85-89bc9212702a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:06.722543 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c828ae-3730-406d-ac85-89bc9212702a admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.722911 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c828ae-3730-406d-ac85-89bc9212702a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.723260 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c828ae-3730-406d-ac85-89bc9212702a admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.724072 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c828ae-3730-406d-ac85-89bc9212702a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:06.724456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c828ae-3730-406d-ac85-89bc9212702a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:06.726459 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c828ae-3730-406d-ac85-89bc9212702a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:06.732493 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0f946d71-3cc5-4239-9cae-7f6c4b8e3cf1 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:06.733803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0f946d71-3cc5-4239-9cae-7f6c4b8e3cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:06.745564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 791/1570] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:06.745564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c828ae-3730-406d-ac85-89bc9212702a admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:06.748754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 780/1571] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:06.751148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f946d71-3cc5-4239-9cae-7f6c4b8e3cf1 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:06.757687 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c828ae-3730-406d-ac85-89bc9212702a admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:06.761990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f946d71-3cc5-4239-9cae-7f6c4b8e3cf1 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:06.763068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41998a6-9e7d-4e09-9cda-a2873b4e2be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:06.763771 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41998a6-9e7d-4e09-9cda-a2873b4e2be0 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.764097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41998a6-9e7d-4e09-9cda-a2873b4e2be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.764373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41998a6-9e7d-4e09-9cda-a2873b4e2be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.766078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41998a6-9e7d-4e09-9cda-a2873b4e2be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:06.767837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41998a6-9e7d-4e09-9cda-a2873b4e2be0 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:06.771394 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201471e8-ed13-4f86-b787-1aeeec0bf906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:06.772598 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201471e8-ed13-4f86-b787-1aeeec0bf906 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.773112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201471e8-ed13-4f86-b787-1aeeec0bf906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.773611 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201471e8-ed13-4f86-b787-1aeeec0bf906 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.774534 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201471e8-ed13-4f86-b787-1aeeec0bf906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:06.775577 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: WARNING py.warnings [None req-201471e8-ed13-4f86-b787-1aeeec0bf906 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:51:06.775577 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: warnings.warn(msg) Jul 18 16:51:06.775577 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: Jul 18 16:51:06.776783 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201471e8-ed13-4f86-b787-1aeeec0bf906 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:06.780734 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 792/1572] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:06.782047 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41998a6-9e7d-4e09-9cda-a2873b4e2be0 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:06.794085 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41998a6-9e7d-4e09-9cda-a2873b4e2be0 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:06.799163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb038f-9d38-4679-b398-0619bf17c3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:06.799873 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb038f-9d38-4679-b398-0619bf17c3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.800161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb038f-9d38-4679-b398-0619bf17c3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.800446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb038f-9d38-4679-b398-0619bf17c3d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.801251 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb038f-9d38-4679-b398-0619bf17c3d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:06.801565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb038f-9d38-4679-b398-0619bf17c3d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:06.803223 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeb038f-9d38-4679-b398-0619bf17c3d7 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:06.817087 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 793/1573] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:06.817907 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb038f-9d38-4679-b398-0619bf17c3d7 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:06.828886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb038f-9d38-4679-b398-0619bf17c3d7 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:06.833855 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684a78d-b6a3-4b17-8c5d-7f875d87b130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:06.834550 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684a78d-b6a3-4b17-8c5d-7f875d87b130 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.834858 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684a78d-b6a3-4b17-8c5d-7f875d87b130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.837554 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4684a78d-b6a3-4b17-8c5d-7f875d87b130 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.837554 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684a78d-b6a3-4b17-8c5d-7f875d87b130 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:06.837782 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4684a78d-b6a3-4b17-8c5d-7f875d87b130 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:06.900449 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 781/1574] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:06 2022] POST /identity/v3/projects => generated 369 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:06.901223 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201471e8-ed13-4f86-b787-1aeeec0bf906 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:06.967296 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201471e8-ed13-4f86-b787-1aeeec0bf906 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:06.973082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52604824-79e6-46ee-9302-ff7cad37fcf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:06.973788 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52604824-79e6-46ee-9302-ff7cad37fcf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:06.974075 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52604824-79e6-46ee-9302-ff7cad37fcf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:06.974355 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52604824-79e6-46ee-9302-ff7cad37fcf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:06.975060 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52604824-79e6-46ee-9302-ff7cad37fcf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:06.977266 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52604824-79e6-46ee-9302-ff7cad37fcf6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:07.004568 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 794/1575] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:06 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:07.005497 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684a78d-b6a3-4b17-8c5d-7f875d87b130 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:07.088104 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4684a78d-b6a3-4b17-8c5d-7f875d87b130 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:07.093844 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85766318-5f02-4b46-839b-7960f5ab560b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:07.100018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85766318-5f02-4b46-839b-7960f5ab560b admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:07.100146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 782/1576] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:06 2022] POST /identity/v3/projects => generated 387 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:07.100234 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85766318-5f02-4b46-839b-7960f5ab560b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:07.100234 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85766318-5f02-4b46-839b-7960f5ab560b admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:07.100461 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52604824-79e6-46ee-9302-ff7cad37fcf6 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:07.100554 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85766318-5f02-4b46-839b-7960f5ab560b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:07.100554 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85766318-5f02-4b46-839b-7960f5ab560b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:07.126063 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:07.163090 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52604824-79e6-46ee-9302-ff7cad37fcf6 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:07.167910 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c5fee-e60f-486f-ac3d-b23ef887edf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:07.170263 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c5fee-e60f-486f-ac3d-b23ef887edf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:07.170263 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c5fee-e60f-486f-ac3d-b23ef887edf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:07.170263 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c5fee-e60f-486f-ac3d-b23ef887edf9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:07.170263 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c5fee-e60f-486f-ac3d-b23ef887edf9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:07.170659 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c5fee-e60f-486f-ac3d-b23ef887edf9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:07.172336 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7c5fee-e60f-486f-ac3d-b23ef887edf9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:07.184743 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 783/1577] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:07.185723 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c5fee-e60f-486f-ac3d-b23ef887edf9 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:07.195629 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c5fee-e60f-486f-ac3d-b23ef887edf9 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:07.200283 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b6e35-93f7-47d0-b0a8-523182154062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:07.201161 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b6e35-93f7-47d0-b0a8-523182154062 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:07.201452 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b6e35-93f7-47d0-b0a8-523182154062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:07.201726 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b6e35-93f7-47d0-b0a8-523182154062 admin admin] PATH_INFO: `/v3/projects/3aaa2899e49e4a378ed0ef8d50eba4b0/users/9b3512558eda4faab26294e3da298311/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:07.217238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b6e35-93f7-47d0-b0a8-523182154062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aaa2899e49e4a378ed0ef8d50eba4b0, user_id=9b3512558eda4faab26294e3da298311, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:07.220569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b6e35-93f7-47d0-b0a8-523182154062 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:07.240482 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 795/1578] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:07 2022] POST /identity/v3/projects => generated 385 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:07.240482 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85766318-5f02-4b46-839b-7960f5ab560b admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:07.277042 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:07.309372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 784/1579] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:07 2022] PUT /identity/v3/projects/3aaa2899e49e4a378ed0ef8d50eba4b0/users/9b3512558eda4faab26294e3da298311/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:07.310599 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b6e35-93f7-47d0-b0a8-523182154062 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:07.314863 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85766318-5f02-4b46-839b-7960f5ab560b admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:07.400238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b6e35-93f7-47d0-b0a8-523182154062 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:07.403276 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22574f6f-3ffb-4f36-8d6a-85c225a3b6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:07.403961 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22574f6f-3ffb-4f36-8d6a-85c225a3b6c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:07.404245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22574f6f-3ffb-4f36-8d6a-85c225a3b6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:07.404520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22574f6f-3ffb-4f36-8d6a-85c225a3b6c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:07.405259 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22574f6f-3ffb-4f36-8d6a-85c225a3b6c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:07.406188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58945918-a851-44d4-8019-1d6778520878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:07.407074 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58945918-a851-44d4-8019-1d6778520878 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:07.407438 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58945918-a851-44d4-8019-1d6778520878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:07.407741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22574f6f-3ffb-4f36-8d6a-85c225a3b6c5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:07.408000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58945918-a851-44d4-8019-1d6778520878 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:07.408547 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58945918-a851-44d4-8019-1d6778520878 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:07.410519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58945918-a851-44d4-8019-1d6778520878 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:07.511805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 785/1580] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:07 2022] POST /identity/v3/users => generated 285 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:07.515210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 796/1581] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:07 2022] POST /identity/v3/projects => generated 403 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:07.516652 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58945918-a851-44d4-8019-1d6778520878 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:07.516855 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22574f6f-3ffb-4f36-8d6a-85c225a3b6c5 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:07.529237 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58945918-a851-44d4-8019-1d6778520878 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:07.604851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22574f6f-3ffb-4f36-8d6a-85c225a3b6c5 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:07.612513 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed9de4-7015-4a46-835b-d708ea772f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:07.613260 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed9de4-7015-4a46-835b-d708ea772f5e admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:07.613549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed9de4-7015-4a46-835b-d708ea772f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:07.613828 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed9de4-7015-4a46-835b-d708ea772f5e admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:07.614598 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed9de4-7015-4a46-835b-d708ea772f5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:07.615729 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: WARNING py.warnings [None req-a2ed9de4-7015-4a46-835b-d708ea772f5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:51:07.615729 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: warnings.warn(msg) Jul 18 16:51:07.615729 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: Jul 18 16:51:07.617220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed9de4-7015-4a46-835b-d708ea772f5e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:07.617518 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8786ec-0fe3-4ca3-9163-5103d08d55fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:07.618713 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8786ec-0fe3-4ca3-9163-5103d08d55fe admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:07.619244 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8786ec-0fe3-4ca3-9163-5103d08d55fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:07.619732 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8786ec-0fe3-4ca3-9163-5103d08d55fe admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:07.621141 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8786ec-0fe3-4ca3-9163-5103d08d55fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:07.625168 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8786ec-0fe3-4ca3-9163-5103d08d55fe admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:07.767111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 797/1582] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:07 2022] POST /identity/v3/users => generated 294 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:07.767111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed9de4-7015-4a46-835b-d708ea772f5e admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:07.775536 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed9de4-7015-4a46-835b-d708ea772f5e admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:07.780113 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f236df-576a-41ce-9f94-fba5cb61c596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:07.781402 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f236df-576a-41ce-9f94-fba5cb61c596 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:07.781678 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f236df-576a-41ce-9f94-fba5cb61c596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:07.781996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f236df-576a-41ce-9f94-fba5cb61c596 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:07.782641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f236df-576a-41ce-9f94-fba5cb61c596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:07.784538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f236df-576a-41ce-9f94-fba5cb61c596 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:07.801585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 786/1583] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:07 2022] POST /identity/v3/users => generated 294 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:07.802416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8786ec-0fe3-4ca3-9163-5103d08d55fe admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:07.812484 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8786ec-0fe3-4ca3-9163-5103d08d55fe admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:07.817709 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cba40-3144-4a07-a410-1009c1974c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:07.818195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cba40-3144-4a07-a410-1009c1974c48 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:07.818485 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cba40-3144-4a07-a410-1009c1974c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:07.818770 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09cba40-3144-4a07-a410-1009c1974c48 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:07.819475 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09cba40-3144-4a07-a410-1009c1974c48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:07.821547 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09cba40-3144-4a07-a410-1009c1974c48 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:07.834756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:07.945161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 798/1584] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:07 2022] POST /identity/v3/projects => generated 393 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:07.947525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d8f74-7852-4d66-8f30-9ac58a8af228 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:07.947525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d8f74-7852-4d66-8f30-9ac58a8af228 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:07.947525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d8f74-7852-4d66-8f30-9ac58a8af228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:07.974514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-209d8f74-7852-4d66-8f30-9ac58a8af228 None None] MFA Rules not processed for user `9b3512558eda4faab26294e3da298311`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:07.975718 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-209d8f74-7852-4d66-8f30-9ac58a8af228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:07.998550 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:07.998710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 787/1585] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:07 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:07.998710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cba40-3144-4a07-a410-1009c1974c48 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.009717 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09cba40-3144-4a07-a410-1009c1974c48 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.047155 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 799/1586] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:08.047981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d8f74-7852-4d66-8f30-9ac58a8af228 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.071259 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a58f39-3640-445d-a4ff-b06a3890d83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.071942 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a58f39-3640-445d-a4ff-b06a3890d83b admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.072233 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a58f39-3640-445d-a4ff-b06a3890d83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.072515 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a58f39-3640-445d-a4ff-b06a3890d83b admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.073301 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a58f39-3640-445d-a4ff-b06a3890d83b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.075051 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a58f39-3640-445d-a4ff-b06a3890d83b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:08.089130 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 788/1587] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:08.089130 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a58f39-3640-445d-a4ff-b06a3890d83b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.097278 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a58f39-3640-445d-a4ff-b06a3890d83b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.102450 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22bff4-7bf8-431d-a97c-fdd804fa5cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.104841 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22bff4-7bf8-431d-a97c-fdd804fa5cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.104841 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22bff4-7bf8-431d-a97c-fdd804fa5cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.104841 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd22bff4-7bf8-431d-a97c-fdd804fa5cb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.104841 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22bff4-7bf8-431d-a97c-fdd804fa5cb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.106113 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd22bff4-7bf8-431d-a97c-fdd804fa5cb5 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:08.114793 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d8f74-7852-4d66-8f30-9ac58a8af228 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.116871 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 789/1588] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:08.117711 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22bff4-7bf8-431d-a97c-fdd804fa5cb5 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.122504 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90b74b-85f8-4fd0-8dff-6dec869009b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.123182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90b74b-85f8-4fd0-8dff-6dec869009b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.123470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90b74b-85f8-4fd0-8dff-6dec869009b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.123749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90b74b-85f8-4fd0-8dff-6dec869009b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.126016 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90b74b-85f8-4fd0-8dff-6dec869009b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.126973 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de90b74b-85f8-4fd0-8dff-6dec869009b5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:08.128274 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd22bff4-7bf8-431d-a97c-fdd804fa5cb5 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.134565 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c0cd5-72d0-43c8-9ee8-9e23e3c8583e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.135324 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c0cd5-72d0-43c8-9ee8-9e23e3c8583e admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.135615 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c0cd5-72d0-43c8-9ee8-9e23e3c8583e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.135898 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c0cd5-72d0-43c8-9ee8-9e23e3c8583e admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.136635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c0cd5-72d0-43c8-9ee8-9e23e3c8583e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.138268 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c0cd5-72d0-43c8-9ee8-9e23e3c8583e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:08.149726 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 790/1589] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:08.150666 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c0cd5-72d0-43c8-9ee8-9e23e3c8583e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.160774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c0cd5-72d0-43c8-9ee8-9e23e3c8583e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.165503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112356a4-9c94-48dc-b9a9-a7b7122db260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.166174 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112356a4-9c94-48dc-b9a9-a7b7122db260 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.166459 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112356a4-9c94-48dc-b9a9-a7b7122db260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.166764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112356a4-9c94-48dc-b9a9-a7b7122db260 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.167468 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112356a4-9c94-48dc-b9a9-a7b7122db260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.169464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112356a4-9c94-48dc-b9a9-a7b7122db260 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:08.227143 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 800/1590] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:08 2022] POST /identity/v3/users => generated 302 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:08.228119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90b74b-85f8-4fd0-8dff-6dec869009b5 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.238477 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90b74b-85f8-4fd0-8dff-6dec869009b5 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.243258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7819c22-5575-4f48-ab67-5439b3c15436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.244429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7819c22-5575-4f48-ab67-5439b3c15436 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.244429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7819c22-5575-4f48-ab67-5439b3c15436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.244663 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7819c22-5575-4f48-ab67-5439b3c15436 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.245438 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7819c22-5575-4f48-ab67-5439b3c15436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.247159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7819c22-5575-4f48-ab67-5439b3c15436 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:08.258441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 801/1591] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:08.259272 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7819c22-5575-4f48-ab67-5439b3c15436 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.268987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 791/1592] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:08 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:08.272909 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112356a4-9c94-48dc-b9a9-a7b7122db260 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.273063 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7819c22-5575-4f48-ab67-5439b3c15436 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.278337 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec0628-c409-40cf-8251-de35af55a6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.279114 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec0628-c409-40cf-8251-de35af55a6cb admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.279616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec0628-c409-40cf-8251-de35af55a6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.279902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ec0628-c409-40cf-8251-de35af55a6cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.280958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec0628-c409-40cf-8251-de35af55a6cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.281501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112356a4-9c94-48dc-b9a9-a7b7122db260 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.283189 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ec0628-c409-40cf-8251-de35af55a6cb admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:08.286490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd1479-1580-42d8-965a-8a080d93b8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.288095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd1479-1580-42d8-965a-8a080d93b8b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.288448 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd1479-1580-42d8-965a-8a080d93b8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.289172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efd1479-1580-42d8-965a-8a080d93b8b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.290064 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd1479-1580-42d8-965a-8a080d93b8b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.291726 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efd1479-1580-42d8-965a-8a080d93b8b5 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:08.308830 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 792/1593] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:08.309895 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd1479-1580-42d8-965a-8a080d93b8b5 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.322573 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efd1479-1580-42d8-965a-8a080d93b8b5 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.329323 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943558d-23a9-40d7-80c3-c4d79c3f3a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.330025 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943558d-23a9-40d7-80c3-c4d79c3f3a7b admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.330323 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943558d-23a9-40d7-80c3-c4d79c3f3a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.330630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943558d-23a9-40d7-80c3-c4d79c3f3a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.331378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943558d-23a9-40d7-80c3-c4d79c3f3a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.333038 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943558d-23a9-40d7-80c3-c4d79c3f3a7b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:08.344577 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 793/1594] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:08.345261 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943558d-23a9-40d7-80c3-c4d79c3f3a7b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.355581 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943558d-23a9-40d7-80c3-c4d79c3f3a7b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.360781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c9afe-8106-4a2b-8c5c-97f21edce6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.361479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c9afe-8106-4a2b-8c5c-97f21edce6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.361773 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c9afe-8106-4a2b-8c5c-97f21edce6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.362106 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c9afe-8106-4a2b-8c5c-97f21edce6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.362840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c9afe-8106-4a2b-8c5c-97f21edce6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.364475 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c9afe-8106-4a2b-8c5c-97f21edce6d4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:08.376430 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 794/1595] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:08.376959 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c9afe-8106-4a2b-8c5c-97f21edce6d4 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.387837 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c9afe-8106-4a2b-8c5c-97f21edce6d4 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.392965 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbeb23-de5c-44d3-92ac-64015d7dd014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.397441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbeb23-de5c-44d3-92ac-64015d7dd014 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.397441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbeb23-de5c-44d3-92ac-64015d7dd014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.397441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbeb23-de5c-44d3-92ac-64015d7dd014 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.397441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbeb23-de5c-44d3-92ac-64015d7dd014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.397441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbeb23-de5c-44d3-92ac-64015d7dd014 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:08.410796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 795/1596] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:08.410796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbeb23-de5c-44d3-92ac-64015d7dd014 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.418679 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbeb23-de5c-44d3-92ac-64015d7dd014 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.424017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f2c72-4e80-4ed4-a017-175b9ab567e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.424803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f2c72-4e80-4ed4-a017-175b9ab567e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.425161 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f2c72-4e80-4ed4-a017-175b9ab567e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.425419 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f2c72-4e80-4ed4-a017-175b9ab567e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.426157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f2c72-4e80-4ed4-a017-175b9ab567e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.427766 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f2c72-4e80-4ed4-a017-175b9ab567e6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:08.441897 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 796/1597] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:08.441897 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f2c72-4e80-4ed4-a017-175b9ab567e6 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.449707 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f2c72-4e80-4ed4-a017-175b9ab567e6 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.455666 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b4d39-42ce-485a-9c42-fdcb41204b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.456334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b4d39-42ce-485a-9c42-fdcb41204b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.456627 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b4d39-42ce-485a-9c42-fdcb41204b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.456908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b4d39-42ce-485a-9c42-fdcb41204b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.457673 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b4d39-42ce-485a-9c42-fdcb41204b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.459291 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b4d39-42ce-485a-9c42-fdcb41204b6c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:08.471399 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 797/1598] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:08.474065 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b4d39-42ce-485a-9c42-fdcb41204b6c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.482860 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b4d39-42ce-485a-9c42-fdcb41204b6c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.487977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f346a9-131d-4d5d-b7fa-1fda5ef40993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.488922 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f346a9-131d-4d5d-b7fa-1fda5ef40993 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.489382 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f346a9-131d-4d5d-b7fa-1fda5ef40993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.489668 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f346a9-131d-4d5d-b7fa-1fda5ef40993 admin admin] PATH_INFO: `/v3/projects/6dd162a361304c32be37f76f2932ddf7/users/578ff2b62efc4e93ab2943954cf00b5f/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.506549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f346a9-131d-4d5d-b7fa-1fda5ef40993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dd162a361304c32be37f76f2932ddf7, user_id=578ff2b62efc4e93ab2943954cf00b5f, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.509348 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f346a9-131d-4d5d-b7fa-1fda5ef40993 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:08.522069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 802/1599] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:08 2022] POST /identity/v3/projects => generated 371 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:08.523264 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec0628-c409-40cf-8251-de35af55a6cb admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.604605 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ec0628-c409-40cf-8251-de35af55a6cb admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.610293 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887d4ce-66d0-4982-b64a-88e057ebfd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.611372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887d4ce-66d0-4982-b64a-88e057ebfd28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.611807 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887d4ce-66d0-4982-b64a-88e057ebfd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.612222 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887d4ce-66d0-4982-b64a-88e057ebfd28 admin admin] PATH_INFO: `/v3/projects/327c5b3892374a53992da1dc2e3b0e27/users/176379d24f66484a84a18c8c41447521/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.629580 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887d4ce-66d0-4982-b64a-88e057ebfd28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=327c5b3892374a53992da1dc2e3b0e27, user_id=176379d24f66484a84a18c8c41447521, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.632449 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887d4ce-66d0-4982-b64a-88e057ebfd28 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:08.637434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 798/1600] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:08 2022] PUT /identity/v3/projects/6dd162a361304c32be37f76f2932ddf7/users/578ff2b62efc4e93ab2943954cf00b5f/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:08.638424 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f346a9-131d-4d5d-b7fa-1fda5ef40993 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.669211 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:08.708093 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f346a9-131d-4d5d-b7fa-1fda5ef40993 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.714334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924e843-6e3d-4b42-a106-505a694eb669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.714334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924e843-6e3d-4b42-a106-505a694eb669 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.714668 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924e843-6e3d-4b42-a106-505a694eb669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.714804 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924e843-6e3d-4b42-a106-505a694eb669 admin admin] PATH_INFO: `/v3/projects/d75a7e8f1e294903ade7a227878079f8/users/9faf38f2ccec4b60a3612648073d06d3/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.732528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924e843-6e3d-4b42-a106-505a694eb669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d75a7e8f1e294903ade7a227878079f8, user_id=9faf38f2ccec4b60a3612648073d06d3, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.735437 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924e843-6e3d-4b42-a106-505a694eb669 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:08.789038 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 803/1601] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:08 2022] PUT /identity/v3/projects/327c5b3892374a53992da1dc2e3b0e27/users/176379d24f66484a84a18c8c41447521/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:08.789038 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887d4ce-66d0-4982-b64a-88e057ebfd28 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.805595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:08.861334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 799/1602] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:08 2022] PUT /identity/v3/projects/d75a7e8f1e294903ade7a227878079f8/users/9faf38f2ccec4b60a3612648073d06d3/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:08.862163 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924e843-6e3d-4b42-a106-505a694eb669 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:08.916875 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887d4ce-66d0-4982-b64a-88e057ebfd28 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.959176 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924e843-6e3d-4b42-a106-505a694eb669 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:08.972399 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ced03-343c-4286-9939-af133ee1d254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.973228 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ced03-343c-4286-9939-af133ee1d254 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.974911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ced03-343c-4286-9939-af133ee1d254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.975387 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ced03-343c-4286-9939-af133ee1d254 admin admin] PATH_INFO: `/v3/projects/4f82344d2255427582cc29e253b37f0b/users/0cf277a2d03443c8af7a7bee2731d9d1/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.996733 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ced03-343c-4286-9939-af133ee1d254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f82344d2255427582cc29e253b37f0b, user_id=0cf277a2d03443c8af7a7bee2731d9d1, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:08.997833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd2edd-0052-4f61-bd3d-870fc855f973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:08.998522 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd2edd-0052-4f61-bd3d-870fc855f973 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:08.998872 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd2edd-0052-4f61-bd3d-870fc855f973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:08.999667 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd2edd-0052-4f61-bd3d-870fc855f973 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:08.999790 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ced03-343c-4286-9939-af133ee1d254 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:09.000574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd2edd-0052-4f61-bd3d-870fc855f973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:09.002248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cd2edd-0052-4f61-bd3d-870fc855f973 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:09.012642 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 804/1603] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:09.013518 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd2edd-0052-4f61-bd3d-870fc855f973 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:09.024224 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cd2edd-0052-4f61-bd3d-870fc855f973 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:09.028890 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d8aac-0f54-4b55-b45a-75d01c10b202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:09.029585 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d8aac-0f54-4b55-b45a-75d01c10b202 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.029872 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d8aac-0f54-4b55-b45a-75d01c10b202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.030152 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d8aac-0f54-4b55-b45a-75d01c10b202 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.030915 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d8aac-0f54-4b55-b45a-75d01c10b202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:09.032512 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656d8aac-0f54-4b55-b45a-75d01c10b202 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:09.042640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 805/1604] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:09.043420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d8aac-0f54-4b55-b45a-75d01c10b202 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:09.053056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d8aac-0f54-4b55-b45a-75d01c10b202 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:09.057692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc896c-5234-4993-9c0e-8cebd0c78b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:09.059378 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc896c-5234-4993-9c0e-8cebd0c78b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.059378 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc896c-5234-4993-9c0e-8cebd0c78b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.059378 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc896c-5234-4993-9c0e-8cebd0c78b7d admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.059694 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc896c-5234-4993-9c0e-8cebd0c78b7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:09.061459 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc896c-5234-4993-9c0e-8cebd0c78b7d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:09.168333 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 800/1605] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:08 2022] PUT /identity/v3/projects/4f82344d2255427582cc29e253b37f0b/users/0cf277a2d03443c8af7a7bee2731d9d1/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:09.169995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f87c1-64c4-4189-8d03-f3c97ae24a7d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.170652 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f87c1-64c4-4189-8d03-f3c97ae24a7d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.171892 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f87c1-64c4-4189-8d03-f3c97ae24a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.204498 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-113f87c1-64c4-4189-8d03-f3c97ae24a7d None None] MFA Rules not processed for user `578ff2b62efc4e93ab2943954cf00b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:09.206468 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-113f87c1-64c4-4189-8d03-f3c97ae24a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:09.252785 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 806/1606] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:09 2022] POST /identity/v3/users => generated 292 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:09.254157 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ac87e-1b1b-48ce-9d07-92a13541f96f None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.254511 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ac87e-1b1b-48ce-9d07-92a13541f96f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.254834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ac87e-1b1b-48ce-9d07-92a13541f96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.291916 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-150ac87e-1b1b-48ce-9d07-92a13541f96f None None] MFA Rules not processed for user `176379d24f66484a84a18c8c41447521`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:09.293892 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-150ac87e-1b1b-48ce-9d07-92a13541f96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:09.304796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 801/1607] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:09.304796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72b02c-9d2b-4208-b9f9-fb3eea67b7dd None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.304796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72b02c-9d2b-4208-b9f9-fb3eea67b7dd None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.304796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72b02c-9d2b-4208-b9f9-fb3eea67b7dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.330235 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1f72b02c-9d2b-4208-b9f9-fb3eea67b7dd None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:09.331625 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1f72b02c-9d2b-4208-b9f9-fb3eea67b7dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:09.350338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:09.452770 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 802/1608] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:09.453813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72b02c-9d2b-4208-b9f9-fb3eea67b7dd None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:09.459191 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 807/1609] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:09.463552 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ac87e-1b1b-48ce-9d07-92a13541f96f None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:09.466364 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72b02c-9d2b-4208-b9f9-fb3eea67b7dd None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:09.485633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c39bc3-6cb4-46ff-b29b-f51462b747e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:09.485633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c39bc3-6cb4-46ff-b29b-f51462b747e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.485633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c39bc3-6cb4-46ff-b29b-f51462b747e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.486782 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c39bc3-6cb4-46ff-b29b-f51462b747e8 admin admin] PATH_INFO: `/v3/projects/98bfac9b8e9e431bab086afaf3d4c15f/users/40df1fb3d4e14ee7bb5e38a03d3ad4a1/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.496030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ac87e-1b1b-48ce-9d07-92a13541f96f None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:09.502771 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c83b45-1e7b-4612-b77f-b73338f33069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:09.504072 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c83b45-1e7b-4612-b77f-b73338f33069 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.504581 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c83b45-1e7b-4612-b77f-b73338f33069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.505274 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c83b45-1e7b-4612-b77f-b73338f33069 admin admin] PATH_INFO: `/v3/projects/2e5e262f0ed548ee8a4450d0d4806667/users/4d27db5cdd9e453dbd93b862db694309/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.508196 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c39bc3-6cb4-46ff-b29b-f51462b747e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98bfac9b8e9e431bab086afaf3d4c15f, user_id=40df1fb3d4e14ee7bb5e38a03d3ad4a1, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:09.508656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:09.513270 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c39bc3-6cb4-46ff-b29b-f51462b747e8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:09.526628 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c83b45-1e7b-4612-b77f-b73338f33069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e5e262f0ed548ee8a4450d0d4806667, user_id=4d27db5cdd9e453dbd93b862db694309, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:09.531276 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c83b45-1e7b-4612-b77f-b73338f33069 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:09.616038 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 803/1610] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:09 2022] PUT /identity/v3/projects/98bfac9b8e9e431bab086afaf3d4c15f/users/40df1fb3d4e14ee7bb5e38a03d3ad4a1/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:09.616451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 808/1611] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:09 2022] PUT /identity/v3/projects/2e5e262f0ed548ee8a4450d0d4806667/users/4d27db5cdd9e453dbd93b862db694309/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:09.617478 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c83b45-1e7b-4612-b77f-b73338f33069 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:09.618144 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3caeb-4caf-4630-a4cf-24fb3fa4c854 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.618567 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3caeb-4caf-4630-a4cf-24fb3fa4c854 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.619071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a3caeb-4caf-4630-a4cf-24fb3fa4c854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.642539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-88a3caeb-4caf-4630-a4cf-24fb3fa4c854 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:09.644126 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-88a3caeb-4caf-4630-a4cf-24fb3fa4c854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:09.696436 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c83b45-1e7b-4612-b77f-b73338f33069 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:09.701837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eede9f8-dc3c-4ba3-b597-3e179093c6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:09.703476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eede9f8-dc3c-4ba3-b597-3e179093c6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.703943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eede9f8-dc3c-4ba3-b597-3e179093c6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.704219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eede9f8-dc3c-4ba3-b597-3e179093c6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.704985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eede9f8-dc3c-4ba3-b597-3e179093c6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:09.707036 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eede9f8-dc3c-4ba3-b597-3e179093c6e5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:09.713748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 804/1612] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:09.715705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86135535-3df2-4471-bf19-a007a9bc7b8d None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.716216 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86135535-3df2-4471-bf19-a007a9bc7b8d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.716696 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86135535-3df2-4471-bf19-a007a9bc7b8d None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.718684 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 809/1613] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:09.719604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eede9f8-dc3c-4ba3-b597-3e179093c6e5 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:09.725213 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 805/1614] 10.222.0.76 () {54 vars in 962 bytes} [Mon Jul 18 16:51:09 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:51:09.726410 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86135535-3df2-4471-bf19-a007a9bc7b8d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:09.734551 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eede9f8-dc3c-4ba3-b597-3e179093c6e5 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:09.743622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e627ba-316f-4c95-84bf-a2d424d7f7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:09.744422 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e627ba-316f-4c95-84bf-a2d424d7f7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.744750 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e627ba-316f-4c95-84bf-a2d424d7f7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.745091 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e627ba-316f-4c95-84bf-a2d424d7f7f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.745971 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e627ba-316f-4c95-84bf-a2d424d7f7f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:09.750044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e627ba-316f-4c95-84bf-a2d424d7f7f8 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:09.795114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86135535-3df2-4471-bf19-a007a9bc7b8d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:09.799253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3993d22-19fd-4904-903f-b44c15794c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:09.799886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3993d22-19fd-4904-903f-b44c15794c9d service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.800172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3993d22-19fd-4904-903f-b44c15794c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.800452 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3993d22-19fd-4904-903f-b44c15794c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.810362 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3993d22-19fd-4904-903f-b44c15794c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:09.812555 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3993d22-19fd-4904-903f-b44c15794c9d service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:09.823620 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 806/1615] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:09.825172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11a57e-c6eb-4a68-9e48-b6a6fd8747ec None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.825501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11a57e-c6eb-4a68-9e48-b6a6fd8747ec None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.825822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11a57e-c6eb-4a68-9e48-b6a6fd8747ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.846477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5b11a57e-c6eb-4a68-9e48-b6a6fd8747ec None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:09.847937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5b11a57e-c6eb-4a68-9e48-b6a6fd8747ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:09.857652 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 807/1616] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:09.858071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a46a8e-d179-4ef6-a3d6-f8a6885300df None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.858364 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a46a8e-d179-4ef6-a3d6-f8a6885300df None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.859175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a46a8e-d179-4ef6-a3d6-f8a6885300df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.877002 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-99a46a8e-d179-4ef6-a3d6-f8a6885300df None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:09.878238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-99a46a8e-d179-4ef6-a3d6-f8a6885300df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:09.885775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 808/1617] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:09.886518 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a46a8e-d179-4ef6-a3d6-f8a6885300df None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:09.898738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a46a8e-d179-4ef6-a3d6-f8a6885300df None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:09.900634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 810/1618] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:09 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:09.903090 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bd43f-717f-486b-86ba-90b171e63fa2 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.903470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bd43f-717f-486b-86ba-90b171e63fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.903696 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bd43f-717f-486b-86ba-90b171e63fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:09.927542 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:09.953936 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-6b1bd43f-717f-486b-86ba-90b171e63fa2 None None] MFA Rules not processed for user `381cf4381ce64379b285d75e2909813d`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:09.955080 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6b1bd43f-717f-486b-86ba-90b171e63fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:09.978667 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccee99e-68a7-4d70-95ca-e13a0cee0ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:09.979783 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccee99e-68a7-4d70-95ca-e13a0cee0ad7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:09.980127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccee99e-68a7-4d70-95ca-e13a0cee0ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:09.984173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccee99e-68a7-4d70-95ca-e13a0cee0ad7 admin admin] PATH_INFO: `/v3/projects/84660825d3f3429c995f1197c2cb7900/users/1bf9cfc0c45e4af5964a18856863fba4/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:10.003657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccee99e-68a7-4d70-95ca-e13a0cee0ad7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84660825d3f3429c995f1197c2cb7900, user_id=1bf9cfc0c45e4af5964a18856863fba4, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:10.006934 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccee99e-68a7-4d70-95ca-e13a0cee0ad7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:10.071516 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 811/1619] 10.222.0.76 () {58 vars in 1059 bytes} [Mon Jul 18 16:51:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:10.073657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bd43f-717f-486b-86ba-90b171e63fa2 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:10.139632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 809/1620] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:09 2022] PUT /identity/v3/projects/84660825d3f3429c995f1197c2cb7900/users/1bf9cfc0c45e4af5964a18856863fba4/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:10.143761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccee99e-68a7-4d70-95ca-e13a0cee0ad7 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:10.189788 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:10.223924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bd43f-717f-486b-86ba-90b171e63fa2 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:10.256150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccee99e-68a7-4d70-95ca-e13a0cee0ad7 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:10.260990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ecfc8b-cbd0-4c09-b957-09e1ad949ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:10.261762 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecfc8b-cbd0-4c09-b957-09e1ad949ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.262052 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecfc8b-cbd0-4c09-b957-09e1ad949ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.262385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ecfc8b-cbd0-4c09-b957-09e1ad949ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:10.291924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1f80f-d289-48fa-a088-757d888451d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:10.292928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1f80f-d289-48fa-a088-757d888451d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.293247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1f80f-d289-48fa-a088-757d888451d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.293571 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1f80f-d289-48fa-a088-757d888451d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:10.352610 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ecfc8b-cbd0-4c09-b957-09e1ad949ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:10.354538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ecfc8b-cbd0-4c09-b957-09e1ad949ff0 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:10.372079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 810/1621] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:10.372079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ecfc8b-cbd0-4c09-b957-09e1ad949ff0 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:10.381771 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ecfc8b-cbd0-4c09-b957-09e1ad949ff0 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:10.389814 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6b2f8-999c-4c0c-9ff3-14a3e4e0893d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:10.391069 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6b2f8-999c-4c0c-9ff3-14a3e4e0893d service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.391523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6b2f8-999c-4c0c-9ff3-14a3e4e0893d service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.391949 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6b2f8-999c-4c0c-9ff3-14a3e4e0893d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:10.394562 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1f80f-d289-48fa-a088-757d888451d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:10.397701 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1f80f-d289-48fa-a088-757d888451d2 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:10.417054 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6b2f8-999c-4c0c-9ff3-14a3e4e0893d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:10.418530 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6b2f8-999c-4c0c-9ff3-14a3e4e0893d service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:10.419035 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 812/1622] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:10.422434 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1f80f-d289-48fa-a088-757d888451d2 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:10.434992 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 811/1623] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:10.435866 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6b2f8-999c-4c0c-9ff3-14a3e4e0893d service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:10.437213 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1f80f-d289-48fa-a088-757d888451d2 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:10.444231 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc09cf-d59a-4ade-9363-b9d0534550ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:10.449267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc09cf-d59a-4ade-9363-b9d0534550ba admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.449267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc09cf-d59a-4ade-9363-b9d0534550ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.449267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc09cf-d59a-4ade-9363-b9d0534550ba admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:10.449267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc09cf-d59a-4ade-9363-b9d0534550ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:10.449988 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cc09cf-d59a-4ade-9363-b9d0534550ba admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:10.496253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:10.524724 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6b2f8-999c-4c0c-9ff3-14a3e4e0893d service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:10.536820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac6a0a-f059-48ec-b400-88859fd7cf50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:10.536820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac6a0a-f059-48ec-b400-88859fd7cf50 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.536820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac6a0a-f059-48ec-b400-88859fd7cf50 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.536820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac6a0a-f059-48ec-b400-88859fd7cf50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:10.597373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 813/1624] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:10 2022] POST /identity/v3/users => generated 300 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:10.598312 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc09cf-d59a-4ade-9363-b9d0534550ba admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:10.622453 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc09cf-d59a-4ade-9363-b9d0534550ba admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:10.623995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac6a0a-f059-48ec-b400-88859fd7cf50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:10.626093 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac6a0a-f059-48ec-b400-88859fd7cf50 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:10.636800 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 812/1625] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:10 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:10.637681 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac6a0a-f059-48ec-b400-88859fd7cf50 service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:10.649138 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac6a0a-f059-48ec-b400-88859fd7cf50 service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:10.649368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63534722-7e7e-4f17-84fa-abe6393bb5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:10.649980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63534722-7e7e-4f17-84fa-abe6393bb5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.650336 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63534722-7e7e-4f17-84fa-abe6393bb5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.650548 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63534722-7e7e-4f17-84fa-abe6393bb5a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:10.651290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63534722-7e7e-4f17-84fa-abe6393bb5a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:10.652935 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63534722-7e7e-4f17-84fa-abe6393bb5a8 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:10.654088 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57529331-b2a1-4765-b835-5a22a0de240c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:10.654786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57529331-b2a1-4765-b835-5a22a0de240c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.655075 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57529331-b2a1-4765-b835-5a22a0de240c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.655937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57529331-b2a1-4765-b835-5a22a0de240c admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:10.656669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57529331-b2a1-4765-b835-5a22a0de240c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:10.658900 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57529331-b2a1-4765-b835-5a22a0de240c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:10.677847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 813/1626] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:10.682090 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57529331-b2a1-4765-b835-5a22a0de240c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:10.688747 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 814/1627] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:10.694336 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63534722-7e7e-4f17-84fa-abe6393bb5a8 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:10.700183 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57529331-b2a1-4765-b835-5a22a0de240c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:10.714625 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ac7a7-ccd3-443f-aaf2-67e88a589f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:10.715553 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ac7a7-ccd3-443f-aaf2-67e88a589f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.715842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ac7a7-ccd3-443f-aaf2-67e88a589f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.716123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ac7a7-ccd3-443f-aaf2-67e88a589f6f admin admin] PATH_INFO: `/v3/projects/ded263158d0e4521a581958db136cb28/users/f88c9fdb481c4ff4ade52b69faa6cb73/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:10.716877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63534722-7e7e-4f17-84fa-abe6393bb5a8 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:10.729545 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaeee09-04f2-400c-b530-3e9415b4e522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:10.730930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaeee09-04f2-400c-b530-3e9415b4e522 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.731403 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaeee09-04f2-400c-b530-3e9415b4e522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.731852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaeee09-04f2-400c-b530-3e9415b4e522 admin admin] PATH_INFO: `/v3/projects/84660825d3f3429c995f1197c2cb7900/users/1bf9cfc0c45e4af5964a18856863fba4/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:10.735606 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaeee09-04f2-400c-b530-3e9415b4e522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84660825d3f3429c995f1197c2cb7900, user_id=1bf9cfc0c45e4af5964a18856863fba4, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:10.741301 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaeee09-04f2-400c-b530-3e9415b4e522 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:10.749195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ac7a7-ccd3-443f-aaf2-67e88a589f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded263158d0e4521a581958db136cb28, user_id=f88c9fdb481c4ff4ade52b69faa6cb73, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:10.751869 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ac7a7-ccd3-443f-aaf2-67e88a589f6f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:10.773384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 815/1628] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:10 2022] PUT /identity/v3/projects/84660825d3f3429c995f1197c2cb7900/users/1bf9cfc0c45e4af5964a18856863fba4/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:10.785706 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41053151-d146-4d3d-a4aa-5f773d6b9035 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:10.786365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41053151-d146-4d3d-a4aa-5f773d6b9035 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:10.787477 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41053151-d146-4d3d-a4aa-5f773d6b9035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:11.170310 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 814/1629] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:10 2022] PUT /identity/v3/projects/ded263158d0e4521a581958db136cb28/users/f88c9fdb481c4ff4ade52b69faa6cb73/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:11.172039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-41053151-d146-4d3d-a4aa-5f773d6b9035 None None] MFA Rules not processed for user `1bf9cfc0c45e4af5964a18856863fba4`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:11.172039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-41053151-d146-4d3d-a4aa-5f773d6b9035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:11.172481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ac7a7-ccd3-443f-aaf2-67e88a589f6f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:11.173378 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:11.173378 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 816/1630] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:10 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:11.173378 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41053151-d146-4d3d-a4aa-5f773d6b9035 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:11.176989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ac7a7-ccd3-443f-aaf2-67e88a589f6f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:11.176989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b707b-2a5b-433e-a023-f4053a88c58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:11.176989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b707b-2a5b-433e-a023-f4053a88c58c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:11.176989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b707b-2a5b-433e-a023-f4053a88c58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:11.178188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b707b-2a5b-433e-a023-f4053a88c58c admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:11.178188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b707b-2a5b-433e-a023-f4053a88c58c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:11.178188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b707b-2a5b-433e-a023-f4053a88c58c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:11.178188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 815/1631] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:11.178188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8b280-6788-4bdd-b58b-0e4ca7840bbf None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:11.178188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8b280-6788-4bdd-b58b-0e4ca7840bbf None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:11.178850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8b280-6788-4bdd-b58b-0e4ca7840bbf None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:11.178850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 816/1632] 10.222.0.76 () {54 vars in 912 bytes} [Mon Jul 18 16:51:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:51:11.178850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8b280-6788-4bdd-b58b-0e4ca7840bbf None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:11.178850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8b280-6788-4bdd-b58b-0e4ca7840bbf None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:11.180773 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e57abe-7f36-4bce-9e43-515ac914c03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:11.180773 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e57abe-7f36-4bce-9e43-515ac914c03c admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:11.180773 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e57abe-7f36-4bce-9e43-515ac914c03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:11.180773 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e57abe-7f36-4bce-9e43-515ac914c03c admin admin] PATH_INFO: `/v3/projects/ded263158d0e4521a581958db136cb28/users/f88c9fdb481c4ff4ade52b69faa6cb73/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:11.181550 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e57abe-7f36-4bce-9e43-515ac914c03c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded263158d0e4521a581958db136cb28, user_id=f88c9fdb481c4ff4ade52b69faa6cb73, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:11.181550 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e57abe-7f36-4bce-9e43-515ac914c03c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:11.181855 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41053151-d146-4d3d-a4aa-5f773d6b9035 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:11.197063 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 817/1633] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:11 2022] PUT /identity/v3/projects/ded263158d0e4521a581958db136cb28/users/f88c9fdb481c4ff4ade52b69faa6cb73/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:11.197063 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca36782-de0b-4a8f-a3d6-fbafbe355b20 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:11.197063 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca36782-de0b-4a8f-a3d6-fbafbe355b20 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:11.197063 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca36782-de0b-4a8f-a3d6-fbafbe355b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:11.255571 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-dca36782-de0b-4a8f-a3d6-fbafbe355b20 None None] MFA Rules not processed for user `381cf4381ce64379b285d75e2909813d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:11.259450 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-dca36782-de0b-4a8f-a3d6-fbafbe355b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:11.313336 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be803f93-50bb-44da-8e43-2aeb5cb3450e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:11.313778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be803f93-50bb-44da-8e43-2aeb5cb3450e service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:11.314016 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be803f93-50bb-44da-8e43-2aeb5cb3450e service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:11.314288 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be803f93-50bb-44da-8e43-2aeb5cb3450e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:11.394252 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be803f93-50bb-44da-8e43-2aeb5cb3450e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:11.396318 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be803f93-50bb-44da-8e43-2aeb5cb3450e service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:11.413685 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 817/1634] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:11.415315 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67d839-5a1f-4b12-a5e5-e55a1c2ce435 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:11.415614 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67d839-5a1f-4b12-a5e5-e55a1c2ce435 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:11.415894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67d839-5a1f-4b12-a5e5-e55a1c2ce435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:11.434116 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 818/1635] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 16:51:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:11.445397 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca36782-de0b-4a8f-a3d6-fbafbe355b20 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:11.448511 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-ab67d839-5a1f-4b12-a5e5-e55a1c2ce435 None None] MFA Rules not processed for user `f88c9fdb481c4ff4ade52b69faa6cb73`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:11.449776 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ab67d839-5a1f-4b12-a5e5-e55a1c2ce435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:11.455989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca36782-de0b-4a8f-a3d6-fbafbe355b20 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:11.471576 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb345d25-a702-4059-a1cf-761e6c1b5a8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:11.473429 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb345d25-a702-4059-a1cf-761e6c1b5a8d service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:11.473834 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb345d25-a702-4059-a1cf-761e6c1b5a8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:11.474221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb345d25-a702-4059-a1cf-761e6c1b5a8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:11.498158 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb345d25-a702-4059-a1cf-761e6c1b5a8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:11.500530 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb345d25-a702-4059-a1cf-761e6c1b5a8d service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:11.517977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 819/1636] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:51:11.539225 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 818/1637] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:11.594958 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:11.627898 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb345d25-a702-4059-a1cf-761e6c1b5a8d service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:11.640506 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb345d25-a702-4059-a1cf-761e6c1b5a8d service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:11.645208 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ddd49-a702-4e10-b772-07256f8da1ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:11.646030 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ddd49-a702-4e10-b772-07256f8da1ff service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:11.654572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ddd49-a702-4e10-b772-07256f8da1ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:11.654572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ddd49-a702-4e10-b772-07256f8da1ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:11.660002 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ddd49-a702-4e10-b772-07256f8da1ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:11.663128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ddd49-a702-4e10-b772-07256f8da1ff service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:11.684893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 820/1638] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:12.009542 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67d839-5a1f-4b12-a5e5-e55a1c2ce435 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:12.114002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67d839-5a1f-4b12-a5e5-e55a1c2ce435 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:12.129353 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f458b9-510f-4877-8d82-174b30faad34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:12.130577 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f458b9-510f-4877-8d82-174b30faad34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:12.131531 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f458b9-510f-4877-8d82-174b30faad34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:12.131791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f458b9-510f-4877-8d82-174b30faad34 admin admin] PATH_INFO: `/v3/users/176379d24f66484a84a18c8c41447521` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:12.133567 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f458b9-510f-4877-8d82-174b30faad34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=176379d24f66484a84a18c8c41447521)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:12.138907 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f458b9-510f-4877-8d82-174b30faad34 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:12.457845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a0f458b9-510f-4877-8d82-174b30faad34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '176379d24f66484a84a18c8c41447521'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:12.474381 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:12.589984 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a0f458b9-510f-4877-8d82-174b30faad34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '176379d24f66484a84a18c8c41447521'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:12.598841 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a0f458b9-510f-4877-8d82-174b30faad34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '176379d24f66484a84a18c8c41447521'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:12.599578 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a0f458b9-510f-4877-8d82-174b30faad34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '176379d24f66484a84a18c8c41447521'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:12.612971 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a0f458b9-510f-4877-8d82-174b30faad34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '176379d24f66484a84a18c8c41447521'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:12.619639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 819/1639] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:12 2022] DELETE /identity/v3/users/176379d24f66484a84a18c8c41447521 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:12.624640 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af8127-feb5-49d4-acd2-2427d0b4db68 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:12.625258 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af8127-feb5-49d4-acd2-2427d0b4db68 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:12.625950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2af8127-feb5-49d4-acd2-2427d0b4db68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:12.649403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f2af8127-feb5-49d4-acd2-2427d0b4db68 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:12.650613 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f2af8127-feb5-49d4-acd2-2427d0b4db68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:12.751701 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 821/1640] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:12.783704 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f458b9-510f-4877-8d82-174b30faad34 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:12.785404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a0f458b9-510f-4877-8d82-174b30faad34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:12.901875 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f458b9-510f-4877-8d82-174b30faad34 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:12.918211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b48bf-21c2-4856-a45f-1ed91cb89146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:12.919082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b48bf-21c2-4856-a45f-1ed91cb89146 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:12.919381 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b48bf-21c2-4856-a45f-1ed91cb89146 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:12.919668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b48bf-21c2-4856-a45f-1ed91cb89146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:12.951167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b48bf-21c2-4856-a45f-1ed91cb89146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:12.951167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b48bf-21c2-4856-a45f-1ed91cb89146 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:12.967188 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 820/1641] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:13.171149 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af8127-feb5-49d4-acd2-2427d0b4db68 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:13.198669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f2af8127-feb5-49d4-acd2-2427d0b4db68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:13.200802 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8f68b-d100-48f7-ae95-2db1ffee1755 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:13.201287 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8f68b-d100-48f7-ae95-2db1ffee1755 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:13.201398 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8f68b-d100-48f7-ae95-2db1ffee1755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:13.218264 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2af8127-feb5-49d4-acd2-2427d0b4db68 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:13.231860 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d7a02-33e6-4775-ae66-6816019a2459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:13.232989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d7a02-33e6-4775-ae66-6816019a2459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:13.234052 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d7a02-33e6-4775-ae66-6816019a2459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:13.234463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d7a02-33e6-4775-ae66-6816019a2459 admin admin] PATH_INFO: `/v3/users/9b3512558eda4faab26294e3da298311` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:13.248979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d7a02-33e6-4775-ae66-6816019a2459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b3512558eda4faab26294e3da298311)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:13.248979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: WARNING py.warnings [None req-001d7a02-33e6-4775-ae66-6816019a2459 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:51:13.248979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: warnings.warn(msg) Jul 18 16:51:13.248979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: Jul 18 16:51:13.248979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d7a02-33e6-4775-ae66-6816019a2459 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:13.263107 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-abc8f68b-d100-48f7-ae95-2db1ffee1755 None None] MFA Rules not processed for user `40df1fb3d4e14ee7bb5e38a03d3ad4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:13.264359 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-abc8f68b-d100-48f7-ae95-2db1ffee1755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:13.400875 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 821/1642] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:13.402623 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091eae1-8f12-442d-86dd-80e966fd9193 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:13.403076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091eae1-8f12-442d-86dd-80e966fd9193 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:13.403498 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8091eae1-8f12-442d-86dd-80e966fd9193 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:13.405999 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 822/1643] 10.222.0.76 () {54 vars in 962 bytes} [Mon Jul 18 16:51:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:51:13.406976 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091eae1-8f12-442d-86dd-80e966fd9193 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:13.408875 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8091eae1-8f12-442d-86dd-80e966fd9193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:13.427648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8091eae1-8f12-442d-86dd-80e966fd9193 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:13.433182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b4795-3e09-4671-9492-986b1fe1bb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:13.434650 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b4795-3e09-4671-9492-986b1fe1bb2b admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:13.435131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b4795-3e09-4671-9492-986b1fe1bb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:13.435415 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b4795-3e09-4671-9492-986b1fe1bb2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:13.436380 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b4795-3e09-4671-9492-986b1fe1bb2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:13.438544 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b4795-3e09-4671-9492-986b1fe1bb2b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:13.598662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 823/1644] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:13 2022] POST /identity/v3/projects => generated 405 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:13.600121 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5100a-230b-4f58-83ff-e13f10a0ced9 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:13.601219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5100a-230b-4f58-83ff-e13f10a0ced9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:13.601852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5100a-230b-4f58-83ff-e13f10a0ced9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:13.663175 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e8e5100a-230b-4f58-83ff-e13f10a0ced9 None None] MFA Rules not processed for user `381cf4381ce64379b285d75e2909813d`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:13.664050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-001d7a02-33e6-4775-ae66-6816019a2459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b3512558eda4faab26294e3da298311'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:13.666760 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e8e5100a-230b-4f58-83ff-e13f10a0ced9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:13.763778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-001d7a02-33e6-4775-ae66-6816019a2459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b3512558eda4faab26294e3da298311'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:13.778392 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:13.782296 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-001d7a02-33e6-4775-ae66-6816019a2459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b3512558eda4faab26294e3da298311'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:13.786834 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-001d7a02-33e6-4775-ae66-6816019a2459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b3512558eda4faab26294e3da298311'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:13.799136 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 824/1645] 10.222.0.76 () {58 vars in 1059 bytes} [Mon Jul 18 16:51:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:13.800469 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5100a-230b-4f58-83ff-e13f10a0ced9 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:13.845406 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-001d7a02-33e6-4775-ae66-6816019a2459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b3512558eda4faab26294e3da298311'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:13.863434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 822/1646] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:13 2022] DELETE /identity/v3/users/9b3512558eda4faab26294e3da298311 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:13.863919 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb59cc-1d49-4510-a18e-29a04207ca69 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:13.864018 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb59cc-1d49-4510-a18e-29a04207ca69 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:13.864276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb59cc-1d49-4510-a18e-29a04207ca69 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:13.872347 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 823/1647] 10.222.0.76 () {54 vars in 912 bytes} [Mon Jul 18 16:51:13 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:51:13.878201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8da93f-5887-4c4b-9f61-6fa67ffcefce None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:13.878502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8da93f-5887-4c4b-9f61-6fa67ffcefce None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:13.889659 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8da93f-5887-4c4b-9f61-6fa67ffcefce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:13.909373 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:13.925368 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-fb8da93f-5887-4c4b-9f61-6fa67ffcefce None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:13.926825 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fb8da93f-5887-4c4b-9f61-6fa67ffcefce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:14.002246 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5100a-230b-4f58-83ff-e13f10a0ced9 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:14.049635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 824/1648] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:14.051142 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8c74b-adc6-4e75-97aa-e4d486760b30 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:14.051655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8c74b-adc6-4e75-97aa-e4d486760b30 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:14.052012 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8c74b-adc6-4e75-97aa-e4d486760b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:14.100124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d7d8c74b-adc6-4e75-97aa-e4d486760b30 None None] MFA Rules not processed for user `381cf4381ce64379b285d75e2909813d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:14.103557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d7d8c74b-adc6-4e75-97aa-e4d486760b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:14.119988 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03a4ff-832c-436d-95ef-e49e7e62f32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:14.121091 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03a4ff-832c-436d-95ef-e49e7e62f32f admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:14.122922 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03a4ff-832c-436d-95ef-e49e7e62f32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:14.123485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea03a4ff-832c-436d-95ef-e49e7e62f32f admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:14.124685 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03a4ff-832c-436d-95ef-e49e7e62f32f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:14.127634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea03a4ff-832c-436d-95ef-e49e7e62f32f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:14.237990 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 825/1649] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:13 2022] POST /identity/v3/users => generated 309 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:14.238949 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03a4ff-832c-436d-95ef-e49e7e62f32f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:14.243469 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ea03a4ff-832c-436d-95ef-e49e7e62f32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:14.276611 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 825/1650] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 16:51:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:14.278869 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8c74b-adc6-4e75-97aa-e4d486760b30 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:14.281958 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d7d8c74b-adc6-4e75-97aa-e4d486760b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:14.312464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8c74b-adc6-4e75-97aa-e4d486760b30 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:14.325512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1549a2d-2fa7-4e64-afb0-c32b533f2c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:14.326219 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1549a2d-2fa7-4e64-afb0-c32b533f2c54 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:14.326510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1549a2d-2fa7-4e64-afb0-c32b533f2c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:14.327179 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1549a2d-2fa7-4e64-afb0-c32b533f2c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:14.327633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1549a2d-2fa7-4e64-afb0-c32b533f2c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:14.336872 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1549a2d-2fa7-4e64-afb0-c32b533f2c54 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:14.355320 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea03a4ff-832c-436d-95ef-e49e7e62f32f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:14.361968 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c9bde-da15-4373-a07b-4e7714cc6722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:14.362785 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c9bde-da15-4373-a07b-4e7714cc6722 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:14.363383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c9bde-da15-4373-a07b-4e7714cc6722 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:14.363672 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c9bde-da15-4373-a07b-4e7714cc6722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:14.367717 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 826/1651] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:14.370704 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1549a2d-2fa7-4e64-afb0-c32b533f2c54 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:14.375320 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c9bde-da15-4373-a07b-4e7714cc6722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:14.376842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d1549a2d-2fa7-4e64-afb0-c32b533f2c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:14.377609 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c9bde-da15-4373-a07b-4e7714cc6722 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:14.391791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 826/1652] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:14.392904 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c9bde-da15-4373-a07b-4e7714cc6722 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:14.405075 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c9bde-da15-4373-a07b-4e7714cc6722 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:14.411307 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a482986-5a19-4d92-b900-e1c94369b213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:14.412556 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a482986-5a19-4d92-b900-e1c94369b213 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:14.412849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a482986-5a19-4d92-b900-e1c94369b213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:14.413174 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a482986-5a19-4d92-b900-e1c94369b213 admin admin] PATH_INFO: `/v3/projects/eea356aa8115431cb0ed2e98de18a267/users/9730148319eb4071a709d920594661e2/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:14.434212 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a482986-5a19-4d92-b900-e1c94369b213 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea356aa8115431cb0ed2e98de18a267, user_id=9730148319eb4071a709d920594661e2, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:14.437883 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a482986-5a19-4d92-b900-e1c94369b213 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:14.517102 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1549a2d-2fa7-4e64-afb0-c32b533f2c54 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:14.522456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e75acb-28b9-465c-a986-b0ad72915a0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:14.523130 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e75acb-28b9-465c-a986-b0ad72915a0a service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:14.523413 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e75acb-28b9-465c-a986-b0ad72915a0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:14.524009 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e75acb-28b9-465c-a986-b0ad72915a0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:14.542121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e75acb-28b9-465c-a986-b0ad72915a0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:14.545103 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e75acb-28b9-465c-a986-b0ad72915a0a service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:14.570660 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 827/1653] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:14 2022] PUT /identity/v3/projects/eea356aa8115431cb0ed2e98de18a267/users/9730148319eb4071a709d920594661e2/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:14.575873 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a482986-5a19-4d92-b900-e1c94369b213 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:14.586312 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 827/1654] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:14.757867 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a482986-5a19-4d92-b900-e1c94369b213 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:14.766214 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e601d89-32c8-4460-98fb-a984cb7f202a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:14.768325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e601d89-32c8-4460-98fb-a984cb7f202a admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:14.768837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e601d89-32c8-4460-98fb-a984cb7f202a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:14.769385 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e601d89-32c8-4460-98fb-a984cb7f202a admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:14.770761 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e601d89-32c8-4460-98fb-a984cb7f202a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:14.774139 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e601d89-32c8-4460-98fb-a984cb7f202a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:14.790778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e75acb-28b9-465c-a986-b0ad72915a0a service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:14.793050 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 828/1655] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:51:14.793865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-24e75acb-28b9-465c-a986-b0ad72915a0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:14.798134 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e601d89-32c8-4460-98fb-a984cb7f202a admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:14.818773 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e75acb-28b9-465c-a986-b0ad72915a0a service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:14.826595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6a093-f3e8-43e5-9fa1-dcf6ed7578e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:14.836442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e601d89-32c8-4460-98fb-a984cb7f202a admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:14.840803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6a093-f3e8-43e5-9fa1-dcf6ed7578e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:14.841574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6a093-f3e8-43e5-9fa1-dcf6ed7578e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:14.842705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6a093-f3e8-43e5-9fa1-dcf6ed7578e5 admin admin] PATH_INFO: `/v3/projects/327c5b3892374a53992da1dc2e3b0e27` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:14.848149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487ca8b-7f92-4d07-91b4-7792683174cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:14.849423 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487ca8b-7f92-4d07-91b4-7792683174cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:14.852591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6a093-f3e8-43e5-9fa1-dcf6ed7578e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=327c5b3892374a53992da1dc2e3b0e27)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:14.852704 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487ca8b-7f92-4d07-91b4-7792683174cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:14.852704 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487ca8b-7f92-4d07-91b4-7792683174cd admin admin] PATH_INFO: `/v3/projects/eea356aa8115431cb0ed2e98de18a267/users/9730148319eb4071a709d920594661e2/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:14.862330 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6a093-f3e8-43e5-9fa1-dcf6ed7578e5 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:14.864215 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487ca8b-7f92-4d07-91b4-7792683174cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea356aa8115431cb0ed2e98de18a267, user_id=9730148319eb4071a709d920594661e2, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:14.872870 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a487ca8b-7f92-4d07-91b4-7792683174cd admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:14.902006 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 829/1656] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:14 2022] PUT /identity/v3/projects/eea356aa8115431cb0ed2e98de18a267/users/9730148319eb4071a709d920594661e2/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:15.087654 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-82d6a093-f3e8-43e5-9fa1-dcf6ed7578e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '327c5b3892374a53992da1dc2e3b0e27', 'request_id': 'req-82d6a093-f3e8-43e5-9fa1-dcf6ed7578e5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:15.105843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-82d6a093-f3e8-43e5-9fa1-dcf6ed7578e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '327c5b3892374a53992da1dc2e3b0e27', 'request_id': 'req-82d6a093-f3e8-43e5-9fa1-dcf6ed7578e5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:15.122623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-82d6a093-f3e8-43e5-9fa1-dcf6ed7578e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '327c5b3892374a53992da1dc2e3b0e27', 'request_id': 'req-82d6a093-f3e8-43e5-9fa1-dcf6ed7578e5'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:15.279289 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-82d6a093-f3e8-43e5-9fa1-dcf6ed7578e5 admin admin] The token cache is being invalidate because project 327c5b3892374a53992da1dc2e3b0e27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:15.279785 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-82d6a093-f3e8-43e5-9fa1-dcf6ed7578e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:15.282759 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-82d6a093-f3e8-43e5-9fa1-dcf6ed7578e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:15.284900 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 828/1657] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:14 2022] DELETE /identity/v3/projects/327c5b3892374a53992da1dc2e3b0e27 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:15.288874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487ca8b-7f92-4d07-91b4-7792683174cd admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:15.290665 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a487ca8b-7f92-4d07-91b4-7792683174cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:15.482387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a487ca8b-7f92-4d07-91b4-7792683174cd admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:15.568560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561f16d-51f0-45fd-8058-5bb8e62caeee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:15.569847 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561f16d-51f0-45fd-8058-5bb8e62caeee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:15.570172 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561f16d-51f0-45fd-8058-5bb8e62caeee admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:15.570449 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561f16d-51f0-45fd-8058-5bb8e62caeee admin admin] PATH_INFO: `/v3/users/f88c9fdb481c4ff4ade52b69faa6cb73` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:15.574446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561f16d-51f0-45fd-8058-5bb8e62caeee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f88c9fdb481c4ff4ade52b69faa6cb73)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:15.580133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561f16d-51f0-45fd-8058-5bb8e62caeee admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:15.808013 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6a093-f3e8-43e5-9fa1-dcf6ed7578e5 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:15.809598 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-82d6a093-f3e8-43e5-9fa1-dcf6ed7578e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:15.820380 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b561f16d-51f0-45fd-8058-5bb8e62caeee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f88c9fdb481c4ff4ade52b69faa6cb73'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:15.846325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6a093-f3e8-43e5-9fa1-dcf6ed7578e5 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:15.856802 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1707d-0977-4b06-a476-41e6d42e992a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:15.860237 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1707d-0977-4b06-a476-41e6d42e992a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:15.861083 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1707d-0977-4b06-a476-41e6d42e992a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:15.863783 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1707d-0977-4b06-a476-41e6d42e992a admin admin] PATH_INFO: `/v3/projects/3aaa2899e49e4a378ed0ef8d50eba4b0` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:15.866046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1707d-0977-4b06-a476-41e6d42e992a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aaa2899e49e4a378ed0ef8d50eba4b0)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:15.884553 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1707d-0977-4b06-a476-41e6d42e992a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:15.924761 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b561f16d-51f0-45fd-8058-5bb8e62caeee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f88c9fdb481c4ff4ade52b69faa6cb73'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:15.938482 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b561f16d-51f0-45fd-8058-5bb8e62caeee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f88c9fdb481c4ff4ade52b69faa6cb73'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:15.939370 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b561f16d-51f0-45fd-8058-5bb8e62caeee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f88c9fdb481c4ff4ade52b69faa6cb73'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:15.980391 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b561f16d-51f0-45fd-8058-5bb8e62caeee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f88c9fdb481c4ff4ade52b69faa6cb73'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:16.003231 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 830/1658] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:15 2022] DELETE /identity/v3/users/f88c9fdb481c4ff4ade52b69faa6cb73 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:16.180233 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-29b1707d-0977-4b06-a476-41e6d42e992a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aaa2899e49e4a378ed0ef8d50eba4b0', 'request_id': 'req-29b1707d-0977-4b06-a476-41e6d42e992a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:16.198989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-29b1707d-0977-4b06-a476-41e6d42e992a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aaa2899e49e4a378ed0ef8d50eba4b0', 'request_id': 'req-29b1707d-0977-4b06-a476-41e6d42e992a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:16.213665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-29b1707d-0977-4b06-a476-41e6d42e992a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aaa2899e49e4a378ed0ef8d50eba4b0', 'request_id': 'req-29b1707d-0977-4b06-a476-41e6d42e992a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:16.361999 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-29b1707d-0977-4b06-a476-41e6d42e992a admin admin] The token cache is being invalidate because project 3aaa2899e49e4a378ed0ef8d50eba4b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:16.361999 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-29b1707d-0977-4b06-a476-41e6d42e992a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:16.361999 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-29b1707d-0977-4b06-a476-41e6d42e992a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:16.364691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 829/1659] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:15 2022] DELETE /identity/v3/projects/3aaa2899e49e4a378ed0ef8d50eba4b0 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:16.369164 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561f16d-51f0-45fd-8058-5bb8e62caeee admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:16.370946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b561f16d-51f0-45fd-8058-5bb8e62caeee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:16.545049 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:16.610251 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561f16d-51f0-45fd-8058-5bb8e62caeee admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:16.626934 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:16.798507 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63475edd-39d5-405e-8f6a-61596310a884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:16.799274 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63475edd-39d5-405e-8f6a-61596310a884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:16.799569 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63475edd-39d5-405e-8f6a-61596310a884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:16.799851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63475edd-39d5-405e-8f6a-61596310a884 admin admin] PATH_INFO: `/v3/users/1bf9cfc0c45e4af5964a18856863fba4` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:16.802871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63475edd-39d5-405e-8f6a-61596310a884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bf9cfc0c45e4af5964a18856863fba4)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:16.805777 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63475edd-39d5-405e-8f6a-61596310a884 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:17.138711 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-63475edd-39d5-405e-8f6a-61596310a884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bf9cfc0c45e4af5964a18856863fba4'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:17.291596 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-63475edd-39d5-405e-8f6a-61596310a884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bf9cfc0c45e4af5964a18856863fba4'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:17.310411 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-63475edd-39d5-405e-8f6a-61596310a884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bf9cfc0c45e4af5964a18856863fba4'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:17.320145 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-63475edd-39d5-405e-8f6a-61596310a884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bf9cfc0c45e4af5964a18856863fba4'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:17.362000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-63475edd-39d5-405e-8f6a-61596310a884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bf9cfc0c45e4af5964a18856863fba4'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:17.377484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 831/1660] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:16 2022] DELETE /identity/v3/users/1bf9cfc0c45e4af5964a18856863fba4 => generated 0 bytes in 1008 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:17.603746 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396050-48ec-49fa-9b9a-a1531968ec9c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:17.604401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396050-48ec-49fa-9b9a-a1531968ec9c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:17.604602 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0396050-48ec-49fa-9b9a-a1531968ec9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:17.660644 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f0396050-48ec-49fa-9b9a-a1531968ec9c None None] MFA Rules not processed for user `d6df4c3768134ebeb90d5566624a7cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:17.662451 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f0396050-48ec-49fa-9b9a-a1531968ec9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:17.693974 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63475edd-39d5-405e-8f6a-61596310a884 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:17.698044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-63475edd-39d5-405e-8f6a-61596310a884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:17.814655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63475edd-39d5-405e-8f6a-61596310a884 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:17.829353 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 830/1661] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:17.829353 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0396050-48ec-49fa-9b9a-a1531968ec9c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:17.829353 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f0396050-48ec-49fa-9b9a-a1531968ec9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:17.829724 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6a78f-4eca-4b14-a2f5-ddb8eeaf7a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:17.829724 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6a78f-4eca-4b14-a2f5-ddb8eeaf7a5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:17.829724 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6a78f-4eca-4b14-a2f5-ddb8eeaf7a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:17.829724 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6a78f-4eca-4b14-a2f5-ddb8eeaf7a5a admin admin] PATH_INFO: `/v3/users/578ff2b62efc4e93ab2943954cf00b5f` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:17.831237 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6a78f-4eca-4b14-a2f5-ddb8eeaf7a5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=578ff2b62efc4e93ab2943954cf00b5f)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:17.838964 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6a78f-4eca-4b14-a2f5-ddb8eeaf7a5a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:17.854486 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0396050-48ec-49fa-9b9a-a1531968ec9c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:17.863348 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940a0c5-804a-49e7-a176-0ad8b020a624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:17.865196 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940a0c5-804a-49e7-a176-0ad8b020a624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:17.865496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940a0c5-804a-49e7-a176-0ad8b020a624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:17.865785 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940a0c5-804a-49e7-a176-0ad8b020a624 admin admin] PATH_INFO: `/v3/projects/ded263158d0e4521a581958db136cb28` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:17.867132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940a0c5-804a-49e7-a176-0ad8b020a624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ded263158d0e4521a581958db136cb28)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:17.869286 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4940a0c5-804a-49e7-a176-0ad8b020a624 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:17.924441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:18.065831 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:18.116805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4940a0c5-804a-49e7-a176-0ad8b020a624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ded263158d0e4521a581958db136cb28', 'request_id': 'req-4940a0c5-804a-49e7-a176-0ad8b020a624'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:18.129520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4940a0c5-804a-49e7-a176-0ad8b020a624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ded263158d0e4521a581958db136cb28', 'request_id': 'req-4940a0c5-804a-49e7-a176-0ad8b020a624'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:18.129804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-dcc6a78f-4eca-4b14-a2f5-ddb8eeaf7a5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '578ff2b62efc4e93ab2943954cf00b5f'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:18.142677 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4940a0c5-804a-49e7-a176-0ad8b020a624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ded263158d0e4521a581958db136cb28', 'request_id': 'req-4940a0c5-804a-49e7-a176-0ad8b020a624'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:18.226972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-dcc6a78f-4eca-4b14-a2f5-ddb8eeaf7a5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '578ff2b62efc4e93ab2943954cf00b5f'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:18.240917 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-dcc6a78f-4eca-4b14-a2f5-ddb8eeaf7a5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '578ff2b62efc4e93ab2943954cf00b5f'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:18.243198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-dcc6a78f-4eca-4b14-a2f5-ddb8eeaf7a5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '578ff2b62efc4e93ab2943954cf00b5f'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:18.311054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-dcc6a78f-4eca-4b14-a2f5-ddb8eeaf7a5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '578ff2b62efc4e93ab2943954cf00b5f'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:18.321933 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 832/1662] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:17 2022] DELETE /identity/v3/users/578ff2b62efc4e93ab2943954cf00b5f => generated 0 bytes in 628 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:18.325439 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917211a-8c1d-4d67-82dd-9ee691427078 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:18.325925 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917211a-8c1d-4d67-82dd-9ee691427078 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:18.326268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1917211a-8c1d-4d67-82dd-9ee691427078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:18.327035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4940a0c5-804a-49e7-a176-0ad8b020a624 admin admin] The token cache is being invalidate because project ded263158d0e4521a581958db136cb28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:18.328037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4940a0c5-804a-49e7-a176-0ad8b020a624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:18.329074 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-4940a0c5-804a-49e7-a176-0ad8b020a624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:18.330823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 831/1663] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:17 2022] DELETE /identity/v3/projects/ded263158d0e4521a581958db136cb28 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:18.340245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f4fda-4516-44f7-93cb-442f02f9aa86 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:18.343488 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f4fda-4516-44f7-93cb-442f02f9aa86 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:18.343488 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f4fda-4516-44f7-93cb-442f02f9aa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:18.357660 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-1917211a-8c1d-4d67-82dd-9ee691427078 None None] MFA Rules not processed for user `d6df4c3768134ebeb90d5566624a7cdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:18.360145 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1917211a-8c1d-4d67-82dd-9ee691427078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:18.392500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-cd1f4fda-4516-44f7-93cb-442f02f9aa86 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:18.393857 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cd1f4fda-4516-44f7-93cb-442f02f9aa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:18.511221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 833/1664] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:18.512720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605877d2-a7b6-464c-8efb-eb2f633c7a9c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:18.513115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605877d2-a7b6-464c-8efb-eb2f633c7a9c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:18.513467 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605877d2-a7b6-464c-8efb-eb2f633c7a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:18.519813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 832/1665] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:18.524915 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f4fda-4516-44f7-93cb-442f02f9aa86 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:18.527350 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cd1f4fda-4516-44f7-93cb-442f02f9aa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:18.559420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-605877d2-a7b6-464c-8efb-eb2f633c7a9c None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:18.562705 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-605877d2-a7b6-464c-8efb-eb2f633c7a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:18.600996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 834/1666] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:18.600996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605877d2-a7b6-464c-8efb-eb2f633c7a9c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:18.602025 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-605877d2-a7b6-464c-8efb-eb2f633c7a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:18.689790 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f4fda-4516-44f7-93cb-442f02f9aa86 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:18.697858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57053bad-20da-43fe-8d05-2f66dc4ed34c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:18.698909 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57053bad-20da-43fe-8d05-2f66dc4ed34c service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:18.699510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57053bad-20da-43fe-8d05-2f66dc4ed34c service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:18.699991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57053bad-20da-43fe-8d05-2f66dc4ed34c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:18.702226 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-57053bad-20da-43fe-8d05-2f66dc4ed34c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:18.718509 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57053bad-20da-43fe-8d05-2f66dc4ed34c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:18.720914 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57053bad-20da-43fe-8d05-2f66dc4ed34c service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:18.728176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605877d2-a7b6-464c-8efb-eb2f633c7a9c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:18.737265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aee638-43ce-46bc-bfe8-02b0917a70fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:18.739577 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aee638-43ce-46bc-bfe8-02b0917a70fb service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:18.740978 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 833/1667] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:18.743572 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aee638-43ce-46bc-bfe8-02b0917a70fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:18.744032 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aee638-43ce-46bc-bfe8-02b0917a70fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:18.747795 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbdad7-1ce8-4ab9-b726-d368d5d49732 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:18.748763 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbdad7-1ce8-4ab9-b726-d368d5d49732 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:18.750597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbdad7-1ce8-4ab9-b726-d368d5d49732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:18.778159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aee638-43ce-46bc-bfe8-02b0917a70fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:18.780928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aee638-43ce-46bc-bfe8-02b0917a70fb service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:18.804840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-bafbdad7-1ce8-4ab9-b726-d368d5d49732 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:18.806850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bafbdad7-1ce8-4ab9-b726-d368d5d49732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:18.814443 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 835/1668] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:18.816972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aee638-43ce-46bc-bfe8-02b0917a70fb service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:18.820025 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-67aee638-43ce-46bc-bfe8-02b0917a70fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:18.830521 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 834/1669] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:18.837376 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbdad7-1ce8-4ab9-b726-d368d5d49732 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:18.861679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aee638-43ce-46bc-bfe8-02b0917a70fb service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:18.865098 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbdad7-1ce8-4ab9-b726-d368d5d49732 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:18.881468 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586259d-f9f9-40b3-a8ae-3f0b0a5f7592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:18.899352 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586259d-f9f9-40b3-a8ae-3f0b0a5f7592 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:18.899652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586259d-f9f9-40b3-a8ae-3f0b0a5f7592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:18.899939 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586259d-f9f9-40b3-a8ae-3f0b0a5f7592 admin admin] PATH_INFO: `/v3/projects/84660825d3f3429c995f1197c2cb7900` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:18.901690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552a9af-816d-4fcd-a33c-23a67e6699a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:18.904044 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552a9af-816d-4fcd-a33c-23a67e6699a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:18.904342 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552a9af-816d-4fcd-a33c-23a67e6699a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:18.904622 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c552a9af-816d-4fcd-a33c-23a67e6699a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:18.905481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552a9af-816d-4fcd-a33c-23a67e6699a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:18.905809 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552a9af-816d-4fcd-a33c-23a67e6699a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:18.908329 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586259d-f9f9-40b3-a8ae-3f0b0a5f7592 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84660825d3f3429c995f1197c2cb7900)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:18.910840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: WARNING py.warnings [None req-6586259d-f9f9-40b3-a8ae-3f0b0a5f7592 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 18 16:51:18.910840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: warnings.warn(msg) Jul 18 16:51:18.910840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: Jul 18 16:51:18.912080 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586259d-f9f9-40b3-a8ae-3f0b0a5f7592 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:18.917285 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c552a9af-816d-4fcd-a33c-23a67e6699a6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:18.957536 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 835/1670] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:18.958489 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552a9af-816d-4fcd-a33c-23a67e6699a6 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:18.997953 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c552a9af-816d-4fcd-a33c-23a67e6699a6 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:19.012488 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad4d679-6a25-4bf2-88de-d328d746e138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:19.016148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4d679-6a25-4bf2-88de-d328d746e138 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:19.016148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4d679-6a25-4bf2-88de-d328d746e138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:19.016148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad4d679-6a25-4bf2-88de-d328d746e138 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:19.018535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4d679-6a25-4bf2-88de-d328d746e138 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:19.022490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad4d679-6a25-4bf2-88de-d328d746e138 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:19.153987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 836/1671] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:18 2022] POST /identity/v3/projects => generated 381 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:19.158759 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3f302-46b8-4c40-a7a2-a7870c345368 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:19.159263 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3f302-46b8-4c40-a7a2-a7870c345368 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:19.159705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3f302-46b8-4c40-a7a2-a7870c345368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:19.187985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6586259d-f9f9-40b3-a8ae-3f0b0a5f7592 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84660825d3f3429c995f1197c2cb7900', 'request_id': 'req-6586259d-f9f9-40b3-a8ae-3f0b0a5f7592'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:19.201780 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-12e3f302-46b8-4c40-a7a2-a7870c345368 None None] MFA Rules not processed for user `9730148319eb4071a709d920594661e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:19.205296 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-12e3f302-46b8-4c40-a7a2-a7870c345368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:19.206317 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6586259d-f9f9-40b3-a8ae-3f0b0a5f7592 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84660825d3f3429c995f1197c2cb7900', 'request_id': 'req-6586259d-f9f9-40b3-a8ae-3f0b0a5f7592'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:19.246315 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6586259d-f9f9-40b3-a8ae-3f0b0a5f7592 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84660825d3f3429c995f1197c2cb7900', 'request_id': 'req-6586259d-f9f9-40b3-a8ae-3f0b0a5f7592'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:19.273447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:19.311473 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 837/1672] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:19 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:19.312671 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3f302-46b8-4c40-a7a2-a7870c345368 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:19.405290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6586259d-f9f9-40b3-a8ae-3f0b0a5f7592 admin admin] The token cache is being invalidate because project 84660825d3f3429c995f1197c2cb7900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:19.413919 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6586259d-f9f9-40b3-a8ae-3f0b0a5f7592 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:19.413919 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6586259d-f9f9-40b3-a8ae-3f0b0a5f7592 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:19.416043 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 836/1673] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:18 2022] DELETE /identity/v3/projects/84660825d3f3429c995f1197c2cb7900 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:19.420307 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3f302-46b8-4c40-a7a2-a7870c345368 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:19.422701 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9e542-1105-4445-80d2-95c3d2bc1280 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:19.423166 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9e542-1105-4445-80d2-95c3d2bc1280 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:19.423620 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9e542-1105-4445-80d2-95c3d2bc1280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:19.427139 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a94246-2354-4712-a4d2-372129d2db2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:19.427916 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a94246-2354-4712-a4d2-372129d2db2a admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:19.428164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a94246-2354-4712-a4d2-372129d2db2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:19.428450 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a94246-2354-4712-a4d2-372129d2db2a admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:19.429256 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a94246-2354-4712-a4d2-372129d2db2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:19.432195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a94246-2354-4712-a4d2-372129d2db2a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:19.451975 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-76c9e542-1105-4445-80d2-95c3d2bc1280 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:19.453563 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-76c9e542-1105-4445-80d2-95c3d2bc1280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:19.476264 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 837/1674] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:19.478232 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713ba67-4826-462b-a1cd-068dcb0f8ce7 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:19.478531 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713ba67-4826-462b-a1cd-068dcb0f8ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:19.478817 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713ba67-4826-462b-a1cd-068dcb0f8ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:19.499659 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-5713ba67-4826-462b-a1cd-068dcb0f8ce7 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:19.502005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5713ba67-4826-462b-a1cd-068dcb0f8ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:19.515820 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 838/1675] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:19.517513 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713ba67-4826-462b-a1cd-068dcb0f8ce7 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:19.530196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713ba67-4826-462b-a1cd-068dcb0f8ce7 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:19.540120 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff7e6c-2e60-4bf6-93df-150a061119d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:19.546965 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 838/1676] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:19 2022] POST /identity/v3/users => generated 291 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:19.547149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff7e6c-2e60-4bf6-93df-150a061119d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:19.547149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff7e6c-2e60-4bf6-93df-150a061119d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:19.547149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff7e6c-2e60-4bf6-93df-150a061119d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:19.556770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff7e6c-2e60-4bf6-93df-150a061119d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:19.556770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff7e6c-2e60-4bf6-93df-150a061119d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:19.556770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff7e6c-2e60-4bf6-93df-150a061119d3 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:19.558305 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a94246-2354-4712-a4d2-372129d2db2a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:19.560296 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-11a94246-2354-4712-a4d2-372129d2db2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:19.569050 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 839/1677] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:19.575441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff7e6c-2e60-4bf6-93df-150a061119d3 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:19.586782 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a94246-2354-4712-a4d2-372129d2db2a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:19.595487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2df09-f8b4-4fbb-b19e-281e6c3292be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:19.596082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff7e6c-2e60-4bf6-93df-150a061119d3 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:19.596438 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2df09-f8b4-4fbb-b19e-281e6c3292be admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:19.596904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2df09-f8b4-4fbb-b19e-281e6c3292be admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:19.597335 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf2df09-f8b4-4fbb-b19e-281e6c3292be admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:19.598298 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2df09-f8b4-4fbb-b19e-281e6c3292be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:19.600182 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf2df09-f8b4-4fbb-b19e-281e6c3292be admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:19.610143 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75987a88-2045-4138-875e-6441ec3b28d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:19.611220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75987a88-2045-4138-875e-6441ec3b28d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:19.611657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75987a88-2045-4138-875e-6441ec3b28d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:19.612085 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75987a88-2045-4138-875e-6441ec3b28d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:19.615370 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75987a88-2045-4138-875e-6441ec3b28d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:19.617627 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75987a88-2045-4138-875e-6441ec3b28d9 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:19.628291 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 839/1678] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:19.629754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2df09-f8b4-4fbb-b19e-281e6c3292be admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:19.648795 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf2df09-f8b4-4fbb-b19e-281e6c3292be admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:19.656064 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d0135-669a-4567-a0ca-2af00f007ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:19.656933 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d0135-669a-4567-a0ca-2af00f007ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:19.657656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d0135-669a-4567-a0ca-2af00f007ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:19.658080 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d0135-669a-4567-a0ca-2af00f007ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:19.658966 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d0135-669a-4567-a0ca-2af00f007ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:19.667918 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d0135-669a-4567-a0ca-2af00f007ee0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:19.688460 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 840/1679] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:19.692568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d0135-669a-4567-a0ca-2af00f007ee0 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:19.713637 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d0135-669a-4567-a0ca-2af00f007ee0 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:19.723815 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122289b-c7f8-41fd-904c-9653ff32b01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:19.728722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122289b-c7f8-41fd-904c-9653ff32b01f admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:19.729750 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122289b-c7f8-41fd-904c-9653ff32b01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:19.730081 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122289b-c7f8-41fd-904c-9653ff32b01f admin admin] PATH_INFO: `/v3/projects/216c10cf772d47cda0ad82a4b191dd2e/users/d1c33d24bf504b93be8f22c093f8650a/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:19.754264 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122289b-c7f8-41fd-904c-9653ff32b01f admin admin] RBAC: Authorizing `identity:create_grant(project_id=216c10cf772d47cda0ad82a4b191dd2e, user_id=d1c33d24bf504b93be8f22c093f8650a, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:19.757523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122289b-c7f8-41fd-904c-9653ff32b01f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:19.770733 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 840/1680] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:19 2022] POST /identity/v3/projects => generated 363 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:19.775363 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75987a88-2045-4138-875e-6441ec3b28d9 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:19.893515 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 841/1681] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:19 2022] PUT /identity/v3/projects/216c10cf772d47cda0ad82a4b191dd2e/users/d1c33d24bf504b93be8f22c093f8650a/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:19.895393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc96f4-be74-4dac-a64a-69d4e6622b3c None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:19.895710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc96f4-be74-4dac-a64a-69d4e6622b3c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:19.895997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacc96f4-be74-4dac-a64a-69d4e6622b3c None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:19.897797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 842/1682] 10.222.0.76 () {54 vars in 912 bytes} [Mon Jul 18 16:51:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:51:19.899136 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c96b4-72be-4f5a-88ea-68524ff181f8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:19.899454 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c96b4-72be-4f5a-88ea-68524ff181f8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:19.899740 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c96b4-72be-4f5a-88ea-68524ff181f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:19.933229 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0c3c96b4-72be-4f5a-88ea-68524ff181f8 None None] MFA Rules not processed for user `d1c33d24bf504b93be8f22c093f8650a`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:19.934486 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0c3c96b4-72be-4f5a-88ea-68524ff181f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:19.942599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75987a88-2045-4138-875e-6441ec3b28d9 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:19.974121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:20.032085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 843/1683] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:20.038904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c1140-4dfd-45e8-8e8e-239afe72b80f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:20.039448 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c1140-4dfd-45e8-8e8e-239afe72b80f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:20.041816 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c1140-4dfd-45e8-8e8e-239afe72b80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:20.083367 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131abaeb-ceef-4574-abf6-9199ced07824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:20.084254 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131abaeb-ceef-4574-abf6-9199ced07824 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:20.084691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131abaeb-ceef-4574-abf6-9199ced07824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:20.084980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131abaeb-ceef-4574-abf6-9199ced07824 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:20.086810 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131abaeb-ceef-4574-abf6-9199ced07824 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:20.089466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131abaeb-ceef-4574-abf6-9199ced07824 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:20.132069 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b54c1140-4dfd-45e8-8e8e-239afe72b80f None None] MFA Rules not processed for user `e9dcca05df70446090cd525c0644cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:20.133949 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b54c1140-4dfd-45e8-8e8e-239afe72b80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:20.221732 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 844/1684] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 16:51:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:20.222607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c1140-4dfd-45e8-8e8e-239afe72b80f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:20.247939 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54c1140-4dfd-45e8-8e8e-239afe72b80f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:20.255303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cd817-5de5-49cc-995a-079d342257f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:20.256632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cd817-5de5-49cc-995a-079d342257f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:20.256932 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cd817-5de5-49cc-995a-079d342257f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:20.257241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815cd817-5de5-49cc-995a-079d342257f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:20.258909 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cd817-5de5-49cc-995a-079d342257f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:20.261688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815cd817-5de5-49cc-995a-079d342257f2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:20.281836 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 841/1685] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:19 2022] POST /identity/v3/users => generated 282 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:51:20.283754 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131abaeb-ceef-4574-abf6-9199ced07824 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:20.287250 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-131abaeb-ceef-4574-abf6-9199ced07824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:20.307190 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131abaeb-ceef-4574-abf6-9199ced07824 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:20.313586 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35b817-2d8a-4c0b-9001-0ba4eadd0cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:20.315381 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35b817-2d8a-4c0b-9001-0ba4eadd0cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:20.315728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35b817-2d8a-4c0b-9001-0ba4eadd0cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:20.316016 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35b817-2d8a-4c0b-9001-0ba4eadd0cca admin admin] PATH_INFO: `/v3/projects/6dd162a361304c32be37f76f2932ddf7` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:20.317550 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35b817-2d8a-4c0b-9001-0ba4eadd0cca admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dd162a361304c32be37f76f2932ddf7)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:20.323162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35b817-2d8a-4c0b-9001-0ba4eadd0cca admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:20.430435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 845/1686] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:20 2022] POST /identity/v3/projects => generated 381 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:20.431670 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cd817-5de5-49cc-995a-079d342257f2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:20.436784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-815cd817-5de5-49cc-995a-079d342257f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:20.485914 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7b35b817-2d8a-4c0b-9001-0ba4eadd0cca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dd162a361304c32be37f76f2932ddf7', 'request_id': 'req-7b35b817-2d8a-4c0b-9001-0ba4eadd0cca'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:20.497434 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7b35b817-2d8a-4c0b-9001-0ba4eadd0cca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dd162a361304c32be37f76f2932ddf7', 'request_id': 'req-7b35b817-2d8a-4c0b-9001-0ba4eadd0cca'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:20.508784 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7b35b817-2d8a-4c0b-9001-0ba4eadd0cca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dd162a361304c32be37f76f2932ddf7', 'request_id': 'req-7b35b817-2d8a-4c0b-9001-0ba4eadd0cca'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:20.550561 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815cd817-5de5-49cc-995a-079d342257f2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:20.617126 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7b35b817-2d8a-4c0b-9001-0ba4eadd0cca admin admin] The token cache is being invalidate because project 6dd162a361304c32be37f76f2932ddf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:20.618107 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7b35b817-2d8a-4c0b-9001-0ba4eadd0cca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:20.619091 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7b35b817-2d8a-4c0b-9001-0ba4eadd0cca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:20.624578 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 842/1687] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:20 2022] DELETE /identity/v3/projects/6dd162a361304c32be37f76f2932ddf7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:20.626723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35b817-2d8a-4c0b-9001-0ba4eadd0cca admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:20.629415 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7b35b817-2d8a-4c0b-9001-0ba4eadd0cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:20.697092 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b847b9f-f9aa-4b62-9f53-ced658bd625e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:20.697927 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b847b9f-f9aa-4b62-9f53-ced658bd625e service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:20.698712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b847b9f-f9aa-4b62-9f53-ced658bd625e service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:20.699037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b847b9f-f9aa-4b62-9f53-ced658bd625e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:20.705279 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3b847b9f-f9aa-4b62-9f53-ced658bd625e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:20.729286 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b847b9f-f9aa-4b62-9f53-ced658bd625e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:20.731962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b847b9f-f9aa-4b62-9f53-ced658bd625e service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:20.748128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 846/1688] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:20.749664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b847b9f-f9aa-4b62-9f53-ced658bd625e service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:20.752994 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3b847b9f-f9aa-4b62-9f53-ced658bd625e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:20.860705 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35b817-2d8a-4c0b-9001-0ba4eadd0cca admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:20.877501 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7b5cdc-6f05-4431-93e4-2b06fecbbcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:20.878239 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b5cdc-6f05-4431-93e4-2b06fecbbcfe admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:20.878635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b5cdc-6f05-4431-93e4-2b06fecbbcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:20.879013 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b5cdc-6f05-4431-93e4-2b06fecbbcfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:20.879866 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b5cdc-6f05-4431-93e4-2b06fecbbcfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:20.881641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7b5cdc-6f05-4431-93e4-2b06fecbbcfe admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:20.898491 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 843/1689] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:20.899467 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39ca77-c1cd-4f67-a651-c6139a00e89e None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:20.899865 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39ca77-c1cd-4f67-a651-c6139a00e89e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:20.900199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39ca77-c1cd-4f67-a651-c6139a00e89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:20.908918 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b847b9f-f9aa-4b62-9f53-ced658bd625e service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:20.912822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410f3d3-26c4-4c71-b938-86d30eb59fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:20.914616 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410f3d3-26c4-4c71-b938-86d30eb59fa4 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:20.914616 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410f3d3-26c4-4c71-b938-86d30eb59fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:20.914616 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410f3d3-26c4-4c71-b938-86d30eb59fa4 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:20.914953 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410f3d3-26c4-4c71-b938-86d30eb59fa4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:20.917030 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410f3d3-26c4-4c71-b938-86d30eb59fa4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:20.936323 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-cd39ca77-c1cd-4f67-a651-c6139a00e89e None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:20.939081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-cd39ca77-c1cd-4f67-a651-c6139a00e89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:20.948684 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 844/1690] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:20.949790 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39ca77-c1cd-4f67-a651-c6139a00e89e None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:20.960205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39ca77-c1cd-4f67-a651-c6139a00e89e None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:20.966038 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525e7a5-2bcf-48e9-ad96-c6aecf82154f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:20.966889 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525e7a5-2bcf-48e9-ad96-c6aecf82154f admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:20.967275 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525e7a5-2bcf-48e9-ad96-c6aecf82154f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:20.967656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525e7a5-2bcf-48e9-ad96-c6aecf82154f admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:20.969112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525e7a5-2bcf-48e9-ad96-c6aecf82154f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:20.971237 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525e7a5-2bcf-48e9-ad96-c6aecf82154f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:20.985691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 845/1691] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:20.987122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a646c-6004-4742-9251-ce0723b96b71 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:20.987521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a646c-6004-4742-9251-ce0723b96b71 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:20.987906 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a646c-6004-4742-9251-ce0723b96b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:21.023905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-2f4a646c-6004-4742-9251-ce0723b96b71 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:21.026450 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2f4a646c-6004-4742-9251-ce0723b96b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:21.041523 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 846/1692] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:21.045777 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 847/1693] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:20 2022] POST /identity/v3/users => generated 297 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:21.045777 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410f3d3-26c4-4c71-b938-86d30eb59fa4 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:21.048795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a646c-6004-4742-9251-ce0723b96b71 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:21.068110 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a646c-6004-4742-9251-ce0723b96b71 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:21.070107 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410f3d3-26c4-4c71-b938-86d30eb59fa4 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:21.075172 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde3c8d-033b-4fea-8b5c-80258e68bb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:21.076109 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde3c8d-033b-4fea-8b5c-80258e68bb49 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:21.076404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde3c8d-033b-4fea-8b5c-80258e68bb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:21.077255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde3c8d-033b-4fea-8b5c-80258e68bb49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:21.078547 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde3c8d-033b-4fea-8b5c-80258e68bb49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:21.082229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde3c8d-033b-4fea-8b5c-80258e68bb49 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:21.085294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e052515-286b-4194-88d8-41a7c8a32bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:21.085507 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e052515-286b-4194-88d8-41a7c8a32bff admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:21.086096 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e052515-286b-4194-88d8-41a7c8a32bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:21.086479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e052515-286b-4194-88d8-41a7c8a32bff admin admin] PATH_INFO: `/v3/projects/b738455a61a4461aa22d480bfcc314b9/users/1d9903eb726a41aba745f5190e33bd7e/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:21.106100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 847/1694] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:21.109784 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde3c8d-033b-4fea-8b5c-80258e68bb49 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:21.112229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:21.128309 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e052515-286b-4194-88d8-41a7c8a32bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=b738455a61a4461aa22d480bfcc314b9, user_id=1d9903eb726a41aba745f5190e33bd7e, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:21.129972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde3c8d-033b-4fea-8b5c-80258e68bb49 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:21.132280 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e052515-286b-4194-88d8-41a7c8a32bff admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:21.135707 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5907ed-063f-4755-a3c3-5a392461259e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:21.136531 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5907ed-063f-4755-a3c3-5a392461259e admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:21.136925 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5907ed-063f-4755-a3c3-5a392461259e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:21.148082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5907ed-063f-4755-a3c3-5a392461259e admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:21.148082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5907ed-063f-4755-a3c3-5a392461259e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:21.148082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5907ed-063f-4755-a3c3-5a392461259e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:21.148082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5907ed-063f-4755-a3c3-5a392461259e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:21.162802 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 848/1695] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:21.162802 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5907ed-063f-4755-a3c3-5a392461259e admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:21.175897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5907ed-063f-4755-a3c3-5a392461259e admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:21.185698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3a7e11-9636-4302-a78b-af25b2e2d00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:21.186845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a7e11-9636-4302-a78b-af25b2e2d00d admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:21.187235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a7e11-9636-4302-a78b-af25b2e2d00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:21.187633 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a7e11-9636-4302-a78b-af25b2e2d00d admin admin] PATH_INFO: `/v3/projects/4757f925bd3a471f9ecaf78711cdceaa/users/60e9f4a584564c15818dc9d543f1a07e/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:21.213296 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a7e11-9636-4302-a78b-af25b2e2d00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4757f925bd3a471f9ecaf78711cdceaa, user_id=60e9f4a584564c15818dc9d543f1a07e, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:21.216853 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3a7e11-9636-4302-a78b-af25b2e2d00d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:21.272680 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 848/1696] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:21 2022] PUT /identity/v3/projects/b738455a61a4461aa22d480bfcc314b9/users/1d9903eb726a41aba745f5190e33bd7e/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:21.273549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e052515-286b-4194-88d8-41a7c8a32bff admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:21.310592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 849/1697] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:21 2022] PUT /identity/v3/projects/4757f925bd3a471f9ecaf78711cdceaa/users/60e9f4a584564c15818dc9d543f1a07e/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:21.315772 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1ce83-4ce5-41c5-a030-016359826b9b None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:21.317862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1ce83-4ce5-41c5-a030-016359826b9b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:21.318528 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f1ce83-4ce5-41c5-a030-016359826b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:21.388042 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d6f1ce83-4ce5-41c5-a030-016359826b9b None None] MFA Rules not processed for user `1d9903eb726a41aba745f5190e33bd7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:21.389702 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d6f1ce83-4ce5-41c5-a030-016359826b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:21.413806 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e052515-286b-4194-88d8-41a7c8a32bff admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:21.552604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce12c29-ebc1-4a7a-a7a2-43dd427a4356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:21.553499 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce12c29-ebc1-4a7a-a7a2-43dd427a4356 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:21.553796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce12c29-ebc1-4a7a-a7a2-43dd427a4356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:21.554080 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce12c29-ebc1-4a7a-a7a2-43dd427a4356 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:21.559189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce12c29-ebc1-4a7a-a7a2-43dd427a4356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:21.570292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce12c29-ebc1-4a7a-a7a2-43dd427a4356 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:21.579899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 850/1698] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:21 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:21.580818 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1ce83-4ce5-41c5-a030-016359826b9b None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:21.610427 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f1ce83-4ce5-41c5-a030-016359826b9b None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:21.624336 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749254ef-bb74-4fdd-a2c8-4ea1bcc5ad1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:21.625301 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749254ef-bb74-4fdd-a2c8-4ea1bcc5ad1d admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:21.625686 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749254ef-bb74-4fdd-a2c8-4ea1bcc5ad1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:21.626063 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749254ef-bb74-4fdd-a2c8-4ea1bcc5ad1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:21.626901 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749254ef-bb74-4fdd-a2c8-4ea1bcc5ad1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:21.630268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749254ef-bb74-4fdd-a2c8-4ea1bcc5ad1d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:21.656391 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 851/1699] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:21.656391 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749254ef-bb74-4fdd-a2c8-4ea1bcc5ad1d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:21.669284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749254ef-bb74-4fdd-a2c8-4ea1bcc5ad1d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:21.675983 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c81d8-74b7-4d96-bd0e-8c58dacf8b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:21.676841 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c81d8-74b7-4d96-bd0e-8c58dacf8b7b admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:21.677347 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c81d8-74b7-4d96-bd0e-8c58dacf8b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:21.679038 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c81d8-74b7-4d96-bd0e-8c58dacf8b7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:21.680527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c81d8-74b7-4d96-bd0e-8c58dacf8b7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:21.682693 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2c81d8-74b7-4d96-bd0e-8c58dacf8b7b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:21.741078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 849/1700] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:21 2022] POST /identity/v3/projects => generated 391 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:21.742658 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce12c29-ebc1-4a7a-a7a2-43dd427a4356 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:21.856550 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce12c29-ebc1-4a7a-a7a2-43dd427a4356 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:21.865955 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f5c50-4d30-4c8c-9351-b113f075e006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:21.867111 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f5c50-4d30-4c8c-9351-b113f075e006 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:21.867547 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f5c50-4d30-4c8c-9351-b113f075e006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:21.867969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f5c50-4d30-4c8c-9351-b113f075e006 admin admin] PATH_INFO: `/v3/projects/4757f925bd3a471f9ecaf78711cdceaa/users/60e9f4a584564c15818dc9d543f1a07e/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:21.869329 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 852/1701] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:21 2022] POST /identity/v3/projects => generated 363 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:21.870084 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c81d8-74b7-4d96-bd0e-8c58dacf8b7b admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:21.871666 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f5c50-4d30-4c8c-9351-b113f075e006 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4757f925bd3a471f9ecaf78711cdceaa, user_id=60e9f4a584564c15818dc9d543f1a07e, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:21.876146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0f5c50-4d30-4c8c-9351-b113f075e006 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:21.919556 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 850/1702] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:21 2022] PUT /identity/v3/projects/4757f925bd3a471f9ecaf78711cdceaa/users/60e9f4a584564c15818dc9d543f1a07e/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:21.920730 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f5c50-4d30-4c8c-9351-b113f075e006 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:22.090379 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c81d8-74b7-4d96-bd0e-8c58dacf8b7b admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:22.098005 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f5c50-4d30-4c8c-9351-b113f075e006 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:22.111481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1fe9a-7836-4f63-aea3-f954b4c29001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:22.114344 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d72efc-1c8e-43f6-bfd0-8230c2f31698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:22.116394 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d72efc-1c8e-43f6-bfd0-8230c2f31698 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:22.116689 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d72efc-1c8e-43f6-bfd0-8230c2f31698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:22.116977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d72efc-1c8e-43f6-bfd0-8230c2f31698 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.120266 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1fe9a-7836-4f63-aea3-f954b4c29001 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:22.120657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1fe9a-7836-4f63-aea3-f954b4c29001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:22.120761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d72efc-1c8e-43f6-bfd0-8230c2f31698 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:22.121085 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1fe9a-7836-4f63-aea3-f954b4c29001 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.124273 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1fe9a-7836-4f63-aea3-f954b4c29001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:22.124404 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d72efc-1c8e-43f6-bfd0-8230c2f31698 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:22.132470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1fe9a-7836-4f63-aea3-f954b4c29001 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:22.283655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 853/1703] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:21 2022] POST /identity/v3/users => generated 296 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:22.283655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb097c7-1c91-4d7d-99a9-47e95ebd227e None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:22.283655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb097c7-1c91-4d7d-99a9-47e95ebd227e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:22.283655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb097c7-1c91-4d7d-99a9-47e95ebd227e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.287497 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 851/1704] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:21 2022] POST /identity/v3/users => generated 288 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:22.290022 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59f9bb-99ac-4aae-bddd-a8bcb4f6588b None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:22.290821 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59f9bb-99ac-4aae-bddd-a8bcb4f6588b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:22.291107 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59f9bb-99ac-4aae-bddd-a8bcb4f6588b None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.292738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 852/1705] 10.222.0.76 () {54 vars in 961 bytes} [Mon Jul 18 16:51:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:51:22.301320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59f9bb-99ac-4aae-bddd-a8bcb4f6588b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:22.328074 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59f9bb-99ac-4aae-bddd-a8bcb4f6588b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:22.345876 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0d528-6b30-4371-9e76-ea25ac8a3d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:22.346731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0d528-6b30-4371-9e76-ea25ac8a3d9c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:22.346970 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0d528-6b30-4371-9e76-ea25ac8a3d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:22.347246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0d528-6b30-4371-9e76-ea25ac8a3d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.347998 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c0d528-6b30-4371-9e76-ea25ac8a3d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:22.350262 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c0d528-6b30-4371-9e76-ea25ac8a3d9c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:22.373447 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:22.375109 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-ddb097c7-1c91-4d7d-99a9-47e95ebd227e None None] MFA Rules not processed for user `60e9f4a584564c15818dc9d543f1a07e`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:22.376380 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ddb097c7-1c91-4d7d-99a9-47e95ebd227e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:22.377122 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 853/1706] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:22.378037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0d528-6b30-4371-9e76-ea25ac8a3d9c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:22.399496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0d528-6b30-4371-9e76-ea25ac8a3d9c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:22.415355 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ed2c9-5df3-4a63-8634-a963475a4a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:22.416356 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ed2c9-5df3-4a63-8634-a963475a4a88 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:22.416752 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ed2c9-5df3-4a63-8634-a963475a4a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:22.417082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ed2c9-5df3-4a63-8634-a963475a4a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.417845 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ed2c9-5df3-4a63-8634-a963475a4a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:22.422478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ed2c9-5df3-4a63-8634-a963475a4a88 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:22.446988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 854/1707] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:22.450467 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c1d6e-292d-4353-9384-74b5d6c9921b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:22.450769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c1d6e-292d-4353-9384-74b5d6c9921b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:22.452333 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c1d6e-292d-4353-9384-74b5d6c9921b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.525368 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-592c1d6e-292d-4353-9384-74b5d6c9921b None None] MFA Rules not processed for user `9c8d6afb4ccd41a5972e3241a3eebc7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:22.531029 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-592c1d6e-292d-4353-9384-74b5d6c9921b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:22.618359 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 854/1708] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:22 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:22.619890 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb097c7-1c91-4d7d-99a9-47e95ebd227e None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:22.674961 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb097c7-1c91-4d7d-99a9-47e95ebd227e None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:22.682151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e615dc-312d-483b-ae93-c47dbb5854d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:22.692198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e615dc-312d-483b-ae93-c47dbb5854d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:22.693890 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e615dc-312d-483b-ae93-c47dbb5854d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:22.696154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e615dc-312d-483b-ae93-c47dbb5854d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.699807 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e615dc-312d-483b-ae93-c47dbb5854d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:22.701247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e615dc-312d-483b-ae93-c47dbb5854d5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:22.751138 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 855/1709] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:22.753595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e615dc-312d-483b-ae93-c47dbb5854d5 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:22.777628 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e615dc-312d-483b-ae93-c47dbb5854d5 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:22.789650 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fcce2-a2b2-4fcc-980a-2b38c846c59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:22.790573 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fcce2-a2b2-4fcc-980a-2b38c846c59a admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:22.790858 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fcce2-a2b2-4fcc-980a-2b38c846c59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:22.791136 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8fcce2-a2b2-4fcc-980a-2b38c846c59a admin admin] PATH_INFO: `/v3/projects/15e25b894be343b1ab79e7e4e2ae8333/users/7f64c27213ee49c0956a77f88120fb10/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.809172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 855/1710] 10.222.0.76 () {58 vars in 1058 bytes} [Mon Jul 18 16:51:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:22.819359 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fb24a-42a8-4e9b-95a9-0a339e4ed1aa None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:22.820251 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fb24a-42a8-4e9b-95a9-0a339e4ed1aa None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:22.820552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fb24a-42a8-4e9b-95a9-0a339e4ed1aa None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.835682 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 856/1711] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 16:51:22 2022] GET /identity => generated 270 bytes in 30 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:51:22.837954 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fb24a-42a8-4e9b-95a9-0a339e4ed1aa None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:22.846045 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d74fb24a-42a8-4e9b-95a9-0a339e4ed1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:22.856848 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8fcce2-a2b2-4fcc-980a-2b38c846c59a admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e25b894be343b1ab79e7e4e2ae8333, user_id=7f64c27213ee49c0956a77f88120fb10, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:22.864440 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8fcce2-a2b2-4fcc-980a-2b38c846c59a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:22.962602 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fb24a-42a8-4e9b-95a9-0a339e4ed1aa None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:22.967601 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22832b1f-0b35-443b-b9ed-59f600e9fe23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:22.968389 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22832b1f-0b35-443b-b9ed-59f600e9fe23 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:22.968741 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22832b1f-0b35-443b-b9ed-59f600e9fe23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:22.969154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22832b1f-0b35-443b-b9ed-59f600e9fe23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:22.995941 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22832b1f-0b35-443b-b9ed-59f600e9fe23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:22.997970 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22832b1f-0b35-443b-b9ed-59f600e9fe23 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:23.018356 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 856/1712] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:22 2022] PUT /identity/v3/projects/15e25b894be343b1ab79e7e4e2ae8333/users/7f64c27213ee49c0956a77f88120fb10/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:23.019248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fcce2-a2b2-4fcc-980a-2b38c846c59a admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:23.033071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 857/1713] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:23.033914 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22832b1f-0b35-443b-b9ed-59f600e9fe23 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:23.071238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22832b1f-0b35-443b-b9ed-59f600e9fe23 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:23.215622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8fcce2-a2b2-4fcc-980a-2b38c846c59a admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:23.229454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2447a-bfe6-4e49-a8c7-631f3baeebd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:23.230609 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2447a-bfe6-4e49-a8c7-631f3baeebd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:23.231592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2447a-bfe6-4e49-a8c7-631f3baeebd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:23.231844 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2447a-bfe6-4e49-a8c7-631f3baeebd4 admin admin] PATH_INFO: `/v3/projects/49ab79b2a8bb41f1a2e9ceeba5d21742/users/f4789ce37e674af8bcaa3ab1059bf65f/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:23.246375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b919f2-b061-448e-8f9c-08b54a82194b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c8d6afb4ccd41a5972e3241a3eebc7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:23.247050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b919f2-b061-448e-8f9c-08b54a82194b service placement] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:23.247341 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b919f2-b061-448e-8f9c-08b54a82194b service placement] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:23.250186 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b919f2-b061-448e-8f9c-08b54a82194b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:23.253637 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b1b919f2-b061-448e-8f9c-08b54a82194b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:23.273178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2447a-bfe6-4e49-a8c7-631f3baeebd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49ab79b2a8bb41f1a2e9ceeba5d21742, user_id=f4789ce37e674af8bcaa3ab1059bf65f, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:23.282581 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2447a-bfe6-4e49-a8c7-631f3baeebd4 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:23.284400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b919f2-b061-448e-8f9c-08b54a82194b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:23.286998 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b919f2-b061-448e-8f9c-08b54a82194b service placement] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:23.300022 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 858/1714] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:23.302089 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0c79c-9f01-44d0-af89-7e409d071449 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:23.302396 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0c79c-9f01-44d0-af89-7e409d071449 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:23.303359 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0c79c-9f01-44d0-af89-7e409d071449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:23.328805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f0f0c79c-9f01-44d0-af89-7e409d071449 None None] MFA Rules not processed for user `9c8d6afb4ccd41a5972e3241a3eebc7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:23.330241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f0f0c79c-9f01-44d0-af89-7e409d071449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:23.342190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 859/1715] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 16:51:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:23.343879 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0c79c-9f01-44d0-af89-7e409d071449 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:23.357309 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0c79c-9f01-44d0-af89-7e409d071449 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:23.382846 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 857/1716] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:23 2022] PUT /identity/v3/projects/49ab79b2a8bb41f1a2e9ceeba5d21742/users/f4789ce37e674af8bcaa3ab1059bf65f/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:23.384526 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51860e46-9cd2-433d-b241-5c759c62809e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:23.386075 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51860e46-9cd2-433d-b241-5c759c62809e admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:23.386428 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51860e46-9cd2-433d-b241-5c759c62809e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:23.386719 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51860e46-9cd2-433d-b241-5c759c62809e admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:23.387479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51860e46-9cd2-433d-b241-5c759c62809e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:23.390706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51860e46-9cd2-433d-b241-5c759c62809e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:23.393186 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9597b-ca66-4bd8-a267-7a1e64a41208 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:23.393601 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9597b-ca66-4bd8-a267-7a1e64a41208 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:23.393813 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9597b-ca66-4bd8-a267-7a1e64a41208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:23.430502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 860/1717] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:23.431765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51860e46-9cd2-433d-b241-5c759c62809e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:23.438612 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-51860e46-9cd2-433d-b241-5c759c62809e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:23.461853 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:23.463387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-9db9597b-ca66-4bd8-a267-7a1e64a41208 None None] MFA Rules not processed for user `f4789ce37e674af8bcaa3ab1059bf65f`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:23.466362 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9db9597b-ca66-4bd8-a267-7a1e64a41208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:23.482637 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51860e46-9cd2-433d-b241-5c759c62809e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:23.697789 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 858/1718] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:23.698572 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9597b-ca66-4bd8-a267-7a1e64a41208 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:23.706346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424de5c-c65e-40f0-b90a-5c978431c5f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c8d6afb4ccd41a5972e3241a3eebc7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:23.707038 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424de5c-c65e-40f0-b90a-5c978431c5f7 service placement] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:23.707427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424de5c-c65e-40f0-b90a-5c978431c5f7 service placement] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:23.707760 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2424de5c-c65e-40f0-b90a-5c978431c5f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:23.719774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424de5c-c65e-40f0-b90a-5c978431c5f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:23.721737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2424de5c-c65e-40f0-b90a-5c978431c5f7 service placement] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:23.737936 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 861/1719] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:23.738901 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424de5c-c65e-40f0-b90a-5c978431c5f7 service placement] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:23.836782 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2424de5c-c65e-40f0-b90a-5c978431c5f7 service placement] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:23.846197 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed647b6e-c12d-499e-ad68-d3c760377b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:23.846197 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed647b6e-c12d-499e-ad68-d3c760377b01 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:23.846197 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed647b6e-c12d-499e-ad68-d3c760377b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:23.846197 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed647b6e-c12d-499e-ad68-d3c760377b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:23.846518 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed647b6e-c12d-499e-ad68-d3c760377b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:23.847880 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed647b6e-c12d-499e-ad68-d3c760377b01 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:23.885688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9597b-ca66-4bd8-a267-7a1e64a41208 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:23.890837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91288ee9-2def-488c-8d8f-e1220ed1a84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:23.892003 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91288ee9-2def-488c-8d8f-e1220ed1a84a admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:23.892597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91288ee9-2def-488c-8d8f-e1220ed1a84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:23.893062 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91288ee9-2def-488c-8d8f-e1220ed1a84a admin admin] PATH_INFO: `/v3/projects/15e25b894be343b1ab79e7e4e2ae8333/users/7f64c27213ee49c0956a77f88120fb10/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:23.895848 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91288ee9-2def-488c-8d8f-e1220ed1a84a admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e25b894be343b1ab79e7e4e2ae8333, user_id=7f64c27213ee49c0956a77f88120fb10, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:23.898784 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91288ee9-2def-488c-8d8f-e1220ed1a84a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:23.945295 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 859/1720] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:23 2022] PUT /identity/v3/projects/15e25b894be343b1ab79e7e4e2ae8333/users/7f64c27213ee49c0956a77f88120fb10/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:23.955608 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d974e-a79d-431f-8095-271191dcb42d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:23.956403 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d974e-a79d-431f-8095-271191dcb42d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:23.957063 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d974e-a79d-431f-8095-271191dcb42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:24.016056 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:24.026184 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 862/1721] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:23 2022] POST /identity/v3/projects => generated 391 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:24.028869 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-df6d974e-a79d-431f-8095-271191dcb42d None None] MFA Rules not processed for user `7f64c27213ee49c0956a77f88120fb10`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:24.030233 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed647b6e-c12d-499e-ad68-d3c760377b01 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:24.035147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-df6d974e-a79d-431f-8095-271191dcb42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:24.178120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed647b6e-c12d-499e-ad68-d3c760377b01 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:24.184042 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647609d4-3429-4811-8f7a-5ccef0719cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:24.184908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647609d4-3429-4811-8f7a-5ccef0719cfc admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:24.185355 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647609d4-3429-4811-8f7a-5ccef0719cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:24.185769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647609d4-3429-4811-8f7a-5ccef0719cfc admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:24.187467 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647609d4-3429-4811-8f7a-5ccef0719cfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:24.189747 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647609d4-3429-4811-8f7a-5ccef0719cfc admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:24.242295 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 860/1722] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:23 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:24.252059 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d974e-a79d-431f-8095-271191dcb42d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:24.319554 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 863/1723] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:24 2022] POST /identity/v3/users => generated 302 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:24.321436 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647609d4-3429-4811-8f7a-5ccef0719cfc admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:24.362673 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647609d4-3429-4811-8f7a-5ccef0719cfc admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:24.387374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a75a14-4f0a-429d-be28-73d02b616974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:24.388700 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a75a14-4f0a-429d-be28-73d02b616974 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:24.390641 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a75a14-4f0a-429d-be28-73d02b616974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:24.390857 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a75a14-4f0a-429d-be28-73d02b616974 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:24.391630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a75a14-4f0a-429d-be28-73d02b616974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:24.394787 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a75a14-4f0a-429d-be28-73d02b616974 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:24.399058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d974e-a79d-431f-8095-271191dcb42d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:24.408034 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070a7d0-884e-40ee-8985-1afd8d03d5a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:24.411613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070a7d0-884e-40ee-8985-1afd8d03d5a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:24.411997 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070a7d0-884e-40ee-8985-1afd8d03d5a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:24.412348 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070a7d0-884e-40ee-8985-1afd8d03d5a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:24.420507 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 864/1724] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:24.421633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a75a14-4f0a-429d-be28-73d02b616974 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:24.446426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070a7d0-884e-40ee-8985-1afd8d03d5a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:24.450045 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070a7d0-884e-40ee-8985-1afd8d03d5a9 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:24.455607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a75a14-4f0a-429d-be28-73d02b616974 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:24.461033 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c5a48-eab2-4ce9-9a8f-109f44529131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:24.462857 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c5a48-eab2-4ce9-9a8f-109f44529131 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:24.462976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c5a48-eab2-4ce9-9a8f-109f44529131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:24.463221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c5a48-eab2-4ce9-9a8f-109f44529131 admin admin] PATH_INFO: `/v3/projects/6b46d937c1d94e2d868d6a1a3956482c/users/7de585ab4dc64abf861d9af84a0fc049/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:24.496560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 861/1725] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:24 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:24.501922 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c5a48-eab2-4ce9-9a8f-109f44529131 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b46d937c1d94e2d868d6a1a3956482c, user_id=7de585ab4dc64abf861d9af84a0fc049, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:24.504718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c5a48-eab2-4ce9-9a8f-109f44529131 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:24.636540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 865/1726] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:24 2022] PUT /identity/v3/projects/6b46d937c1d94e2d868d6a1a3956482c/users/7de585ab4dc64abf861d9af84a0fc049/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:24.637329 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070a7d0-884e-40ee-8985-1afd8d03d5a9 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:24.664713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070a7d0-884e-40ee-8985-1afd8d03d5a9 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:24.754703 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c5a48-eab2-4ce9-9a8f-109f44529131 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:24.883293 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb6b9c-c862-4985-ad3d-e7f387cf4062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:24.884222 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb6b9c-c862-4985-ad3d-e7f387cf4062 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:24.886163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb6b9c-c862-4985-ad3d-e7f387cf4062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:24.887246 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdb6b9c-c862-4985-ad3d-e7f387cf4062 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:24.888508 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb6b9c-c862-4985-ad3d-e7f387cf4062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:24.891802 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdb6b9c-c862-4985-ad3d-e7f387cf4062 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:24.926049 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 862/1727] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:51:24.927613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb6b9c-c862-4985-ad3d-e7f387cf4062 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:24.954657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdb6b9c-c862-4985-ad3d-e7f387cf4062 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:24.966964 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3120fd29-5e6f-4ae8-a7d5-919ad78c1b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:24.969228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120fd29-5e6f-4ae8-a7d5-919ad78c1b4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:24.969798 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120fd29-5e6f-4ae8-a7d5-919ad78c1b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:24.974179 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3120fd29-5e6f-4ae8-a7d5-919ad78c1b4f admin admin] PATH_INFO: `/v3/projects/6b46d937c1d94e2d868d6a1a3956482c/users/7de585ab4dc64abf861d9af84a0fc049/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:24.974305 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c5a48-eab2-4ce9-9a8f-109f44529131 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:24.974799 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120fd29-5e6f-4ae8-a7d5-919ad78c1b4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b46d937c1d94e2d868d6a1a3956482c, user_id=7de585ab4dc64abf861d9af84a0fc049, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:24.977942 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3120fd29-5e6f-4ae8-a7d5-919ad78c1b4f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:24.987932 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add10da3-597e-43b7-8306-ad4e023bda5f tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e9f4a584564c15818dc9d543f1a07e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4757f925bd3a471f9ecaf78711cdceaa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:24.988631 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add10da3-597e-43b7-8306-ad4e023bda5f tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:24.988929 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add10da3-597e-43b7-8306-ad4e023bda5f tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:24.989270 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add10da3-597e-43b7-8306-ad4e023bda5f tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:24.990221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add10da3-597e-43b7-8306-ad4e023bda5f tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:24.990539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add10da3-597e-43b7-8306-ad4e023bda5f tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:24.992252 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add10da3-597e-43b7-8306-ad4e023bda5f tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:25.025719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 863/1728] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:24 2022] PUT /identity/v3/projects/6b46d937c1d94e2d868d6a1a3956482c/users/7de585ab4dc64abf861d9af84a0fc049/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:25.027999 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91932279-135f-43d7-9c86-f0b71647926e None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:25.033140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91932279-135f-43d7-9c86-f0b71647926e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:25.034465 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91932279-135f-43d7-9c86-f0b71647926e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:25.037371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 866/1729] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:25.039545 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add10da3-597e-43b7-8306-ad4e023bda5f tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:25.070732 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add10da3-597e-43b7-8306-ad4e023bda5f tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:25.129222 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-91932279-135f-43d7-9c86-f0b71647926e None None] MFA Rules not processed for user `7de585ab4dc64abf861d9af84a0fc049`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:25.130503 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-91932279-135f-43d7-9c86-f0b71647926e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:25.224756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57040aa6-352a-4b6e-99d3-2343bf4aeca2 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e9f4a584564c15818dc9d543f1a07e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4757f925bd3a471f9ecaf78711cdceaa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:25.226186 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57040aa6-352a-4b6e-99d3-2343bf4aeca2 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:25.226589 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57040aa6-352a-4b6e-99d3-2343bf4aeca2 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:25.227323 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57040aa6-352a-4b6e-99d3-2343bf4aeca2 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:25.228572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57040aa6-352a-4b6e-99d3-2343bf4aeca2 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:25.230813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57040aa6-352a-4b6e-99d3-2343bf4aeca2 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:25.310411 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 864/1730] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:25.317818 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91932279-135f-43d7-9c86-f0b71647926e None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:25.355300 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 867/1731] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:25 2022] POST /identity/v3/projects => generated 353 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:25.358156 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57040aa6-352a-4b6e-99d3-2343bf4aeca2 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:25.461739 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91932279-135f-43d7-9c86-f0b71647926e None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:25.526631 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57040aa6-352a-4b6e-99d3-2343bf4aeca2 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:25.542681 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0071f8c-4faf-446b-a9b9-3269aa42be50 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e9f4a584564c15818dc9d543f1a07e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4757f925bd3a471f9ecaf78711cdceaa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:25.544167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb50f2f-cb64-4969-b64d-0e27797a87c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:25.544717 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0071f8c-4faf-446b-a9b9-3269aa42be50 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:25.545157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0071f8c-4faf-446b-a9b9-3269aa42be50 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:25.547175 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb50f2f-cb64-4969-b64d-0e27797a87c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:25.547709 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb50f2f-cb64-4969-b64d-0e27797a87c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:25.548178 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0071f8c-4faf-446b-a9b9-3269aa42be50 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:25.548373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb50f2f-cb64-4969-b64d-0e27797a87c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:25.549708 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0071f8c-4faf-446b-a9b9-3269aa42be50 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:25.550049 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0071f8c-4faf-446b-a9b9-3269aa42be50 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:25.553952 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0071f8c-4faf-446b-a9b9-3269aa42be50 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:25.577804 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 868/1732] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:25.663143 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb50f2f-cb64-4969-b64d-0e27797a87c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:25.663143 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb50f2f-cb64-4969-b64d-0e27797a87c5 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:25.668618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0071f8c-4faf-446b-a9b9-3269aa42be50 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:25.698488 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0071f8c-4faf-446b-a9b9-3269aa42be50 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:25.713966 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 865/1733] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:25.740509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12095ad5-865a-4f81-8df0-12fc5605f982 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:25.748074 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e15aa2-0c9f-4a97-a7e3-bf773622b3e6 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60e9f4a584564c15818dc9d543f1a07e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4757f925bd3a471f9ecaf78711cdceaa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:25.748982 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e15aa2-0c9f-4a97-a7e3-bf773622b3e6 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:25.750052 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12095ad5-865a-4f81-8df0-12fc5605f982 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:25.750830 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e15aa2-0c9f-4a97-a7e3-bf773622b3e6 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:25.752338 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12095ad5-865a-4f81-8df0-12fc5605f982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:25.753269 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e15aa2-0c9f-4a97-a7e3-bf773622b3e6 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] PATH_INFO: `/v3/projects/abd5f0062b644d7fa56aead14e18d74b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:25.761004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e15aa2-0c9f-4a97-a7e3-bf773622b3e6 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] RBAC: Authorizing `identity:delete_project(project_id=abd5f0062b644d7fa56aead14e18d74b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:25.782765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e15aa2-0c9f-4a97-a7e3-bf773622b3e6 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:25.902440 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-12095ad5-865a-4f81-8df0-12fc5605f982 None None] MFA Rules not processed for user `9faf38f2ccec4b60a3612648073d06d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:25.906033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-12095ad5-865a-4f81-8df0-12fc5605f982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:26.060430 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 866/1734] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:26.060430 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12095ad5-865a-4f81-8df0-12fc5605f982 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:26.077378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-40e15aa2-0c9f-4a97-a7e3-bf773622b3e6 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd5f0062b644d7fa56aead14e18d74b', 'request_id': 'req-40e15aa2-0c9f-4a97-a7e3-bf773622b3e6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:26.088836 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12095ad5-865a-4f81-8df0-12fc5605f982 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:26.112377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-40e15aa2-0c9f-4a97-a7e3-bf773622b3e6 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd5f0062b644d7fa56aead14e18d74b', 'request_id': 'req-40e15aa2-0c9f-4a97-a7e3-bf773622b3e6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:26.121296 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-40e15aa2-0c9f-4a97-a7e3-bf773622b3e6 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd5f0062b644d7fa56aead14e18d74b', 'request_id': 'req-40e15aa2-0c9f-4a97-a7e3-bf773622b3e6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:26.274829 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a930c-d367-4eaa-ae3a-b22271df52af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:26.277741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a930c-d367-4eaa-ae3a-b22271df52af service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:26.278458 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a930c-d367-4eaa-ae3a-b22271df52af service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:26.280244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a930c-d367-4eaa-ae3a-b22271df52af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:26.322710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-40e15aa2-0c9f-4a97-a7e3-bf773622b3e6 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] The token cache is being invalidate because project abd5f0062b644d7fa56aead14e18d74b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:26.323987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-40e15aa2-0c9f-4a97-a7e3-bf773622b3e6 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:26.325819 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-40e15aa2-0c9f-4a97-a7e3-bf773622b3e6 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:26.329851 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 869/1735] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:25 2022] DELETE /identity/v3/projects/abd5f0062b644d7fa56aead14e18d74b => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:26.336171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e15aa2-0c9f-4a97-a7e3-bf773622b3e6 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:26.338003 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-40e15aa2-0c9f-4a97-a7e3-bf773622b3e6 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:26.430979 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a930c-d367-4eaa-ae3a-b22271df52af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:26.432810 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a930c-d367-4eaa-ae3a-b22271df52af service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:26.479966 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 867/1736] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:26 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:26.544577 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a930c-d367-4eaa-ae3a-b22271df52af service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:26.579347 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:26.639321 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e15aa2-0c9f-4a97-a7e3-bf773622b3e6 tempest-VolumeQuotaClassesTest-2046968857 tempest-VolumeQuotaClassesTest-2046968857-project-admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:26.650844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006c0a1d-8b04-4bbf-9ae5-d24c8fe3862c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:26.651529 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c0a1d-8b04-4bbf-9ae5-d24c8fe3862c service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:26.651876 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c0a1d-8b04-4bbf-9ae5-d24c8fe3862c service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:26.652103 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006c0a1d-8b04-4bbf-9ae5-d24c8fe3862c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:26.659754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-006c0a1d-8b04-4bbf-9ae5-d24c8fe3862c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:26.752191 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c0a1d-8b04-4bbf-9ae5-d24c8fe3862c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:26.753873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006c0a1d-8b04-4bbf-9ae5-d24c8fe3862c service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:26.760979 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a930c-d367-4eaa-ae3a-b22271df52af service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:26.769733 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 870/1737] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:26 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:26.771715 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb009a1-4b32-44e8-adb3-4a476631d25a None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:26.772277 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb009a1-4b32-44e8-adb3-4a476631d25a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:26.772729 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb009a1-4b32-44e8-adb3-4a476631d25a None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:26.774904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 871/1738] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 16:51:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:51:26.781805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fe67b-12c6-4772-82af-6f7c9b73204a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:26.782136 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fe67b-12c6-4772-82af-6f7c9b73204a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:26.787893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fe67b-12c6-4772-82af-6f7c9b73204a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:26.788026 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb707d54-e085-4026-bc1d-e2062baba3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:26.788026 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb707d54-e085-4026-bc1d-e2062baba3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:26.788026 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb707d54-e085-4026-bc1d-e2062baba3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:26.788026 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb707d54-e085-4026-bc1d-e2062baba3e3 admin admin] PATH_INFO: `/v3/users/1d9903eb726a41aba745f5190e33bd7e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:26.788755 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb707d54-e085-4026-bc1d-e2062baba3e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d9903eb726a41aba745f5190e33bd7e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:26.791381 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb707d54-e085-4026-bc1d-e2062baba3e3 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:26.813782 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9a8fe67b-12c6-4772-82af-6f7c9b73204a None None] MFA Rules not processed for user `9c8d6afb4ccd41a5972e3241a3eebc7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:26.816479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9a8fe67b-12c6-4772-82af-6f7c9b73204a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:26.933040 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 872/1739] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 16:51:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:26.934390 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fe67b-12c6-4772-82af-6f7c9b73204a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:26.935755 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9a8fe67b-12c6-4772-82af-6f7c9b73204a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:26.993525 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fe67b-12c6-4772-82af-6f7c9b73204a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:27.004237 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5cd62-eda6-4f30-bc09-a34f13ae0778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:27.004237 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5cd62-eda6-4f30-bc09-a34f13ae0778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:27.004237 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5cd62-eda6-4f30-bc09-a34f13ae0778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:27.004237 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5cd62-eda6-4f30-bc09-a34f13ae0778 admin admin] PATH_INFO: `/v3/users/40df1fb3d4e14ee7bb5e38a03d3ad4a1` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:27.004509 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5cd62-eda6-4f30-bc09-a34f13ae0778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40df1fb3d4e14ee7bb5e38a03d3ad4a1)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:27.006074 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5cd62-eda6-4f30-bc09-a34f13ae0778 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:27.197341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-eb707d54-e085-4026-bc1d-e2062baba3e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d9903eb726a41aba745f5190e33bd7e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:27.299228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-eb707d54-e085-4026-bc1d-e2062baba3e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d9903eb726a41aba745f5190e33bd7e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:27.317620 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-eb707d54-e085-4026-bc1d-e2062baba3e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d9903eb726a41aba745f5190e33bd7e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:27.319914 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-eb707d54-e085-4026-bc1d-e2062baba3e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d9903eb726a41aba745f5190e33bd7e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:27.329116 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0db5cd62-eda6-4f30-bc09-a34f13ae0778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40df1fb3d4e14ee7bb5e38a03d3ad4a1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:27.334716 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:27.372625 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-eb707d54-e085-4026-bc1d-e2062baba3e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d9903eb726a41aba745f5190e33bd7e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:27.395790 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 868/1740] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:26 2022] DELETE /identity/v3/users/1d9903eb726a41aba745f5190e33bd7e => generated 0 bytes in 852 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:27.400505 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb707d54-e085-4026-bc1d-e2062baba3e3 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:27.408979 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-eb707d54-e085-4026-bc1d-e2062baba3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:27.418599 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0db5cd62-eda6-4f30-bc09-a34f13ae0778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40df1fb3d4e14ee7bb5e38a03d3ad4a1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:27.429094 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0db5cd62-eda6-4f30-bc09-a34f13ae0778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40df1fb3d4e14ee7bb5e38a03d3ad4a1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:27.433325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0db5cd62-eda6-4f30-bc09-a34f13ae0778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40df1fb3d4e14ee7bb5e38a03d3ad4a1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:27.494702 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0db5cd62-eda6-4f30-bc09-a34f13ae0778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40df1fb3d4e14ee7bb5e38a03d3ad4a1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:27.514312 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 873/1741] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:26 2022] DELETE /identity/v3/users/40df1fb3d4e14ee7bb5e38a03d3ad4a1 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:27.516665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bd989-bdca-4e73-ba8e-678d1c4a8760 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:27.517361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bd989-bdca-4e73-ba8e-678d1c4a8760 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:27.518723 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2bd989-bdca-4e73-ba8e-678d1c4a8760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:27.607600 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5f2bd989-bdca-4e73-ba8e-678d1c4a8760 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:27.619267 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5f2bd989-bdca-4e73-ba8e-678d1c4a8760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:27.696118 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb707d54-e085-4026-bc1d-e2062baba3e3 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:27.834047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 874/1742] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:27.835263 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bd989-bdca-4e73-ba8e-678d1c4a8760 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:27.856657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5f2bd989-bdca-4e73-ba8e-678d1c4a8760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:27.900451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7001204-ea35-4394-aef2-62870b282b94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c8d6afb4ccd41a5972e3241a3eebc7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:27.914265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7001204-ea35-4394-aef2-62870b282b94 service placement] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:27.914265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7001204-ea35-4394-aef2-62870b282b94 service placement] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:27.914265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7001204-ea35-4394-aef2-62870b282b94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:27.914265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a7001204-ea35-4394-aef2-62870b282b94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:27.914928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2bd989-bdca-4e73-ba8e-678d1c4a8760 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:27.920032 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc921ebc-4cf8-4727-af35-96a412d1a79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:27.921912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc921ebc-4cf8-4727-af35-96a412d1a79f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:27.922356 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc921ebc-4cf8-4727-af35-96a412d1a79f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:27.922779 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc921ebc-4cf8-4727-af35-96a412d1a79f admin admin] PATH_INFO: `/v3/users/d1c33d24bf504b93be8f22c093f8650a` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:27.924788 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc921ebc-4cf8-4727-af35-96a412d1a79f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1c33d24bf504b93be8f22c093f8650a)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:27.927855 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc921ebc-4cf8-4727-af35-96a412d1a79f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:27.928115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7001204-ea35-4394-aef2-62870b282b94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:27.931110 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7001204-ea35-4394-aef2-62870b282b94 service placement] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:27.957173 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 869/1743] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:27.958280 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7001204-ea35-4394-aef2-62870b282b94 service placement] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:27.961371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a7001204-ea35-4394-aef2-62870b282b94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:28.133496 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7001204-ea35-4394-aef2-62870b282b94 service placement] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:28.138182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851fc28-2d44-46c2-94ec-3ae98d46f8c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:28.139189 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851fc28-2d44-46c2-94ec-3ae98d46f8c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:28.139616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851fc28-2d44-46c2-94ec-3ae98d46f8c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:28.140711 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851fc28-2d44-46c2-94ec-3ae98d46f8c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:28.151936 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851fc28-2d44-46c2-94ec-3ae98d46f8c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:28.153923 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b851fc28-2d44-46c2-94ec-3ae98d46f8c8 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:28.186590 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 870/1744] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:28.258674 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851fc28-2d44-46c2-94ec-3ae98d46f8c8 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:28.260630 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b851fc28-2d44-46c2-94ec-3ae98d46f8c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:28.278809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851fc28-2d44-46c2-94ec-3ae98d46f8c8 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:28.284446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bc921ebc-4cf8-4727-af35-96a412d1a79f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1c33d24bf504b93be8f22c093f8650a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:28.286537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f88b6-49f9-4d4a-a1a3-c896af279aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:28.287664 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f88b6-49f9-4d4a-a1a3-c896af279aab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:28.288207 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f88b6-49f9-4d4a-a1a3-c896af279aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:28.288688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107f88b6-49f9-4d4a-a1a3-c896af279aab admin admin] PATH_INFO: `/v3/projects/98bfac9b8e9e431bab086afaf3d4c15f` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:28.290874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f88b6-49f9-4d4a-a1a3-c896af279aab admin admin] RBAC: Authorizing `identity:delete_project(project_id=98bfac9b8e9e431bab086afaf3d4c15f)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:28.293314 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107f88b6-49f9-4d4a-a1a3-c896af279aab admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:28.455460 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bc921ebc-4cf8-4727-af35-96a412d1a79f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1c33d24bf504b93be8f22c093f8650a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:28.471578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bc921ebc-4cf8-4727-af35-96a412d1a79f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1c33d24bf504b93be8f22c093f8650a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:28.473952 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bc921ebc-4cf8-4727-af35-96a412d1a79f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1c33d24bf504b93be8f22c093f8650a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:28.491486 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-107f88b6-49f9-4d4a-a1a3-c896af279aab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98bfac9b8e9e431bab086afaf3d4c15f', 'request_id': 'req-107f88b6-49f9-4d4a-a1a3-c896af279aab'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:28.509580 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-107f88b6-49f9-4d4a-a1a3-c896af279aab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98bfac9b8e9e431bab086afaf3d4c15f', 'request_id': 'req-107f88b6-49f9-4d4a-a1a3-c896af279aab'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:28.526181 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-107f88b6-49f9-4d4a-a1a3-c896af279aab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98bfac9b8e9e431bab086afaf3d4c15f', 'request_id': 'req-107f88b6-49f9-4d4a-a1a3-c896af279aab'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:28.542267 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bc921ebc-4cf8-4727-af35-96a412d1a79f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1c33d24bf504b93be8f22c093f8650a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:28.570581 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 875/1745] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:27 2022] DELETE /identity/v3/users/d1c33d24bf504b93be8f22c093f8650a => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:28.575963 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abcb88-f764-455c-b342-cb0a60929894 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:28.576260 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abcb88-f764-455c-b342-cb0a60929894 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:28.576552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62abcb88-f764-455c-b342-cb0a60929894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:28.619658 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-62abcb88-f764-455c-b342-cb0a60929894 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:28.627892 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-62abcb88-f764-455c-b342-cb0a60929894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:28.647450 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:28.694728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-107f88b6-49f9-4d4a-a1a3-c896af279aab admin admin] The token cache is being invalidate because project 98bfac9b8e9e431bab086afaf3d4c15f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:28.694728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-107f88b6-49f9-4d4a-a1a3-c896af279aab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:28.694728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-107f88b6-49f9-4d4a-a1a3-c896af279aab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:28.696971 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 871/1746] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:28 2022] DELETE /identity/v3/projects/98bfac9b8e9e431bab086afaf3d4c15f => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:28.707358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f88b6-49f9-4d4a-a1a3-c896af279aab admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:28.721604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-107f88b6-49f9-4d4a-a1a3-c896af279aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:28.783329 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 876/1747] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:28.818010 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abcb88-f764-455c-b342-cb0a60929894 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:28.820658 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-62abcb88-f764-455c-b342-cb0a60929894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:28.927242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107f88b6-49f9-4d4a-a1a3-c896af279aab admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:28.935386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d66baf-2d52-47e5-bca4-acded63b0b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:28.936607 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d66baf-2d52-47e5-bca4-acded63b0b7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:28.937043 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d66baf-2d52-47e5-bca4-acded63b0b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:28.937453 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d66baf-2d52-47e5-bca4-acded63b0b7d admin admin] PATH_INFO: `/v3/users/9730148319eb4071a709d920594661e2` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:28.939428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d66baf-2d52-47e5-bca4-acded63b0b7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9730148319eb4071a709d920594661e2)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:28.945814 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d66baf-2d52-47e5-bca4-acded63b0b7d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:28.988594 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62abcb88-f764-455c-b342-cb0a60929894 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:29.001558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca97a04-f7a3-481d-9ad7-9dcb358ac9e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:29.002446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca97a04-f7a3-481d-9ad7-9dcb358ac9e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:29.002755 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca97a04-f7a3-481d-9ad7-9dcb358ac9e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:29.003114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca97a04-f7a3-481d-9ad7-9dcb358ac9e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:29.028679 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca97a04-f7a3-481d-9ad7-9dcb358ac9e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:29.032985 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca97a04-f7a3-481d-9ad7-9dcb358ac9e9 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:29.045362 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 877/1748] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:51:29.246038 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c5d66baf-2d52-47e5-bca4-acded63b0b7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9730148319eb4071a709d920594661e2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:29.370186 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c5d66baf-2d52-47e5-bca4-acded63b0b7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9730148319eb4071a709d920594661e2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:29.382839 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c5d66baf-2d52-47e5-bca4-acded63b0b7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9730148319eb4071a709d920594661e2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:29.383759 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c5d66baf-2d52-47e5-bca4-acded63b0b7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9730148319eb4071a709d920594661e2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:29.393525 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dff93b-fd38-4f89-846b-3472d538f541 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:29.393863 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dff93b-fd38-4f89-846b-3472d538f541 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:29.394101 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dff93b-fd38-4f89-846b-3472d538f541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:29.411368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c5d66baf-2d52-47e5-bca4-acded63b0b7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9730148319eb4071a709d920594661e2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:29.439125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 872/1749] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:28 2022] DELETE /identity/v3/users/9730148319eb4071a709d920594661e2 => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:29.530007 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-25dff93b-fd38-4f89-846b-3472d538f541 None None] MFA Rules not processed for user `ff65e481807b4344897b1499cd450f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:29.536496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-25dff93b-fd38-4f89-846b-3472d538f541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:29.689442 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 878/1750] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 16:51:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:29.790527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d66baf-2d52-47e5-bca4-acded63b0b7d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:29.791993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c5d66baf-2d52-47e5-bca4-acded63b0b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:29.881873 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d66baf-2d52-47e5-bca4-acded63b0b7d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:29.892086 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12e971-6411-45e3-aa0f-e867ac718f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:29.893282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12e971-6411-45e3-aa0f-e867ac718f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:29.893782 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12e971-6411-45e3-aa0f-e867ac718f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:29.894376 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12e971-6411-45e3-aa0f-e867ac718f9b admin admin] PATH_INFO: `/v3/projects/b738455a61a4461aa22d480bfcc314b9` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:29.896140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12e971-6411-45e3-aa0f-e867ac718f9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b738455a61a4461aa22d480bfcc314b9)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:29.899715 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12e971-6411-45e3-aa0f-e867ac718f9b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:30.061558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dff93b-fd38-4f89-846b-3472d538f541 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:30.063766 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-25dff93b-fd38-4f89-846b-3472d538f541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:30.129660 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0c12e971-6411-45e3-aa0f-e867ac718f9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b738455a61a4461aa22d480bfcc314b9', 'request_id': 'req-0c12e971-6411-45e3-aa0f-e867ac718f9b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:30.140601 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0c12e971-6411-45e3-aa0f-e867ac718f9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b738455a61a4461aa22d480bfcc314b9', 'request_id': 'req-0c12e971-6411-45e3-aa0f-e867ac718f9b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:30.151084 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0c12e971-6411-45e3-aa0f-e867ac718f9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b738455a61a4461aa22d480bfcc314b9', 'request_id': 'req-0c12e971-6411-45e3-aa0f-e867ac718f9b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:30.219468 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dff93b-fd38-4f89-846b-3472d538f541 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:30.286532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0c12e971-6411-45e3-aa0f-e867ac718f9b admin admin] The token cache is being invalidate because project b738455a61a4461aa22d480bfcc314b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:30.286532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0c12e971-6411-45e3-aa0f-e867ac718f9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:30.286532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0c12e971-6411-45e3-aa0f-e867ac718f9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:30.286532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 873/1751] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:29 2022] DELETE /identity/v3/projects/b738455a61a4461aa22d480bfcc314b9 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:30.290430 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12e971-6411-45e3-aa0f-e867ac718f9b admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:30.293146 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0c12e971-6411-45e3-aa0f-e867ac718f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:30.400988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8a5a7-0fe3-49ff-ae5c-bb3d5b015e64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bc0fa34b414328a342d685bc1eaca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:30.402082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8a5a7-0fe3-49ff-ae5c-bb3d5b015e64 service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:30.402791 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8a5a7-0fe3-49ff-ae5c-bb3d5b015e64 service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:30.403256 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8a5a7-0fe3-49ff-ae5c-bb3d5b015e64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:30.405517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:30.409478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-24f8a5a7-0fe3-49ff-ae5c-bb3d5b015e64 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:30.433419 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:30.527106 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12e971-6411-45e3-aa0f-e867ac718f9b admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:30.535445 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881456b-3b0d-4ad2-9e48-4688d19a214b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:30.537534 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881456b-3b0d-4ad2-9e48-4688d19a214b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:30.538313 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881456b-3b0d-4ad2-9e48-4688d19a214b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:30.539273 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881456b-3b0d-4ad2-9e48-4688d19a214b admin admin] PATH_INFO: `/v3/users/7f64c27213ee49c0956a77f88120fb10` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:30.540904 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881456b-3b0d-4ad2-9e48-4688d19a214b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f64c27213ee49c0956a77f88120fb10)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:30.543122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881456b-3b0d-4ad2-9e48-4688d19a214b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:30.549600 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8a5a7-0fe3-49ff-ae5c-bb3d5b015e64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:30.551564 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8a5a7-0fe3-49ff-ae5c-bb3d5b015e64 service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:30.571019 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 879/1752] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 16:51:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:51:30.860227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8a5a7-0fe3-49ff-ae5c-bb3d5b015e64 service swift] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:30.861826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-24f8a5a7-0fe3-49ff-ae5c-bb3d5b015e64 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:30.893218 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8a5a7-0fe3-49ff-ae5c-bb3d5b015e64 service swift] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:30.903423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847717e-6c1a-43e7-a8aa-d034565e201a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:30.904356 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847717e-6c1a-43e7-a8aa-d034565e201a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:30.904747 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847717e-6c1a-43e7-a8aa-d034565e201a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:30.905308 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847717e-6c1a-43e7-a8aa-d034565e201a admin admin] PATH_INFO: `/v3/projects/eea356aa8115431cb0ed2e98de18a267` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:30.911481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847717e-6c1a-43e7-a8aa-d034565e201a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea356aa8115431cb0ed2e98de18a267)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:30.917060 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8847717e-6c1a-43e7-a8aa-d034565e201a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:31.035954 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4881456b-3b0d-4ad2-9e48-4688d19a214b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f64c27213ee49c0956a77f88120fb10'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.148148 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4881456b-3b0d-4ad2-9e48-4688d19a214b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f64c27213ee49c0956a77f88120fb10'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.162330 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4881456b-3b0d-4ad2-9e48-4688d19a214b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f64c27213ee49c0956a77f88120fb10'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.163533 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-8847717e-6c1a-43e7-a8aa-d034565e201a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea356aa8115431cb0ed2e98de18a267', 'request_id': 'req-8847717e-6c1a-43e7-a8aa-d034565e201a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.164224 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4881456b-3b0d-4ad2-9e48-4688d19a214b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f64c27213ee49c0956a77f88120fb10'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.190546 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-8847717e-6c1a-43e7-a8aa-d034565e201a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea356aa8115431cb0ed2e98de18a267', 'request_id': 'req-8847717e-6c1a-43e7-a8aa-d034565e201a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.223729 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4881456b-3b0d-4ad2-9e48-4688d19a214b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f64c27213ee49c0956a77f88120fb10'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.224960 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-8847717e-6c1a-43e7-a8aa-d034565e201a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea356aa8115431cb0ed2e98de18a267', 'request_id': 'req-8847717e-6c1a-43e7-a8aa-d034565e201a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.238395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 874/1753] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:30 2022] DELETE /identity/v3/users/7f64c27213ee49c0956a77f88120fb10 => generated 0 bytes in 949 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:31.239663 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881456b-3b0d-4ad2-9e48-4688d19a214b admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:31.241552 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4881456b-3b0d-4ad2-9e48-4688d19a214b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:31.261897 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:31.349201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-8847717e-6c1a-43e7-a8aa-d034565e201a admin admin] The token cache is being invalidate because project eea356aa8115431cb0ed2e98de18a267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:31.350455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-8847717e-6c1a-43e7-a8aa-d034565e201a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.351230 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-8847717e-6c1a-43e7-a8aa-d034565e201a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.361152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 880/1754] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:30 2022] DELETE /identity/v3/projects/eea356aa8115431cb0ed2e98de18a267 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:31.366893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27b9ac-bf9c-49b1-8108-1cfc2412653f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:31.367368 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27b9ac-bf9c-49b1-8108-1cfc2412653f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:31.367796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27b9ac-bf9c-49b1-8108-1cfc2412653f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:31.408365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881456b-3b0d-4ad2-9e48-4688d19a214b admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:31.425947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9e27b9ac-bf9c-49b1-8108-1cfc2412653f None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:31.444484 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9e27b9ac-bf9c-49b1-8108-1cfc2412653f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:31.447477 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a537b04-a071-4a3e-847e-88c74d5689e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:31.448714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a537b04-a071-4a3e-847e-88c74d5689e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:31.449219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a537b04-a071-4a3e-847e-88c74d5689e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:31.450779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a537b04-a071-4a3e-847e-88c74d5689e0 admin admin] PATH_INFO: `/v3/projects/216c10cf772d47cda0ad82a4b191dd2e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:31.452343 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a537b04-a071-4a3e-847e-88c74d5689e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=216c10cf772d47cda0ad82a4b191dd2e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:31.456320 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a537b04-a071-4a3e-847e-88c74d5689e0 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:31.475373 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 881/1755] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:31.479034 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a30723-e6df-4b2c-aa3c-05e79e53a0a8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:31.479625 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a30723-e6df-4b2c-aa3c-05e79e53a0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:31.481301 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a30723-e6df-4b2c-aa3c-05e79e53a0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:31.590344 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-85a30723-e6df-4b2c-aa3c-05e79e53a0a8 None None] MFA Rules not processed for user `4d27db5cdd9e453dbd93b862db694309`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:31.591613 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-85a30723-e6df-4b2c-aa3c-05e79e53a0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:31.782833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1a537b04-a071-4a3e-847e-88c74d5689e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '216c10cf772d47cda0ad82a4b191dd2e', 'request_id': 'req-1a537b04-a071-4a3e-847e-88c74d5689e0'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.794284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1a537b04-a071-4a3e-847e-88c74d5689e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '216c10cf772d47cda0ad82a4b191dd2e', 'request_id': 'req-1a537b04-a071-4a3e-847e-88c74d5689e0'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.837650 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1a537b04-a071-4a3e-847e-88c74d5689e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '216c10cf772d47cda0ad82a4b191dd2e', 'request_id': 'req-1a537b04-a071-4a3e-847e-88c74d5689e0'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.946299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1a537b04-a071-4a3e-847e-88c74d5689e0 admin admin] The token cache is being invalidate because project 216c10cf772d47cda0ad82a4b191dd2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:31.947077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1a537b04-a071-4a3e-847e-88c74d5689e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.957622 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 882/1756] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:31.959417 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1a537b04-a071-4a3e-847e-88c74d5689e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:31.962694 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 875/1757] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:31 2022] DELETE /identity/v3/projects/216c10cf772d47cda0ad82a4b191dd2e => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:31.969949 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a75e2a-d816-47e2-9c22-aba728a4f2e9 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:31.970389 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a75e2a-d816-47e2-9c22-aba728a4f2e9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:31.971686 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a75e2a-d816-47e2-9c22-aba728a4f2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:31.982890 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9bd3b-9b37-4f5b-ab4e-bd94c5defaf5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:31.985658 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9bd3b-9b37-4f5b-ab4e-bd94c5defaf5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:31.985982 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9bd3b-9b37-4f5b-ab4e-bd94c5defaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:32.042143 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d4a75e2a-d816-47e2-9c22-aba728a4f2e9 None None] MFA Rules not processed for user `4d27db5cdd9e453dbd93b862db694309`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:32.043563 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d4a75e2a-d816-47e2-9c22-aba728a4f2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:32.245669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-60d9bd3b-9b37-4f5b-ab4e-bd94c5defaf5 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:32.245669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-60d9bd3b-9b37-4f5b-ab4e-bd94c5defaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:32.475164 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 876/1758] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 379 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:32.475164 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a75e2a-d816-47e2-9c22-aba728a4f2e9 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:32.475164 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d4a75e2a-d816-47e2-9c22-aba728a4f2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:32.475808 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 883/1759] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:32.476420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a75e2a-d816-47e2-9c22-aba728a4f2e9 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:32.476420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de1ce8-3f21-4f70-8fa4-ee4b3afb7db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:32.476420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de1ce8-3f21-4f70-8fa4-ee4b3afb7db9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:32.476420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de1ce8-3f21-4f70-8fa4-ee4b3afb7db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:32.476690 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de1ce8-3f21-4f70-8fa4-ee4b3afb7db9 admin admin] PATH_INFO: `/v3/users/60e9f4a584564c15818dc9d543f1a07e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:32.476690 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de1ce8-3f21-4f70-8fa4-ee4b3afb7db9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60e9f4a584564c15818dc9d543f1a07e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:32.476690 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de1ce8-3f21-4f70-8fa4-ee4b3afb7db9 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:32.480108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9bd3b-9b37-4f5b-ab4e-bd94c5defaf5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:32.499165 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9bd3b-9b37-4f5b-ab4e-bd94c5defaf5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:32.553699 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dde69-8530-4576-8fb8-0b9f2cffcfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:32.553699 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dde69-8530-4576-8fb8-0b9f2cffcfe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:32.553699 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dde69-8530-4576-8fb8-0b9f2cffcfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:32.553699 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dde69-8530-4576-8fb8-0b9f2cffcfe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:32.555514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75dde69-8530-4576-8fb8-0b9f2cffcfe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:32.555514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75dde69-8530-4576-8fb8-0b9f2cffcfe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:32.555514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75dde69-8530-4576-8fb8-0b9f2cffcfe0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:32.577057 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 884/1760] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:32.581519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27631e02-fc46-4745-881d-08ccb3e47faa None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:32.582382 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27631e02-fc46-4745-881d-08ccb3e47faa None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:32.582827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27631e02-fc46-4745-881d-08ccb3e47faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:32.698583 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-27631e02-fc46-4745-881d-08ccb3e47faa None None] MFA Rules not processed for user `0cf277a2d03443c8af7a7bee2731d9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:32.700621 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-27631e02-fc46-4745-881d-08ccb3e47faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:32.822174 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-08de1ce8-3f21-4f70-8fa4-ee4b3afb7db9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60e9f4a584564c15818dc9d543f1a07e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:32.862520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 885/1761] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:32.864499 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27631e02-fc46-4745-881d-08ccb3e47faa None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:32.866214 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-27631e02-fc46-4745-881d-08ccb3e47faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:32.910884 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:32.913841 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-08de1ce8-3f21-4f70-8fa4-ee4b3afb7db9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60e9f4a584564c15818dc9d543f1a07e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:32.941949 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-08de1ce8-3f21-4f70-8fa4-ee4b3afb7db9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60e9f4a584564c15818dc9d543f1a07e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:32.943753 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-08de1ce8-3f21-4f70-8fa4-ee4b3afb7db9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60e9f4a584564c15818dc9d543f1a07e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:32.978325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-08de1ce8-3f21-4f70-8fa4-ee4b3afb7db9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60e9f4a584564c15818dc9d543f1a07e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:33.014820 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 877/1762] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:32 2022] DELETE /identity/v3/users/60e9f4a584564c15818dc9d543f1a07e => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:33.021870 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de1ce8-3f21-4f70-8fa4-ee4b3afb7db9 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:33.024840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-08de1ce8-3f21-4f70-8fa4-ee4b3afb7db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:33.158645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:33.195121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27631e02-fc46-4745-881d-08ccb3e47faa None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:33.320829 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de1ce8-3f21-4f70-8fa4-ee4b3afb7db9 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:33.342599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b520341-6bdd-4c9b-a289-16311d432c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:33.343476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b520341-6bdd-4c9b-a289-16311d432c9a admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:33.345687 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b520341-6bdd-4c9b-a289-16311d432c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:33.346097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b520341-6bdd-4c9b-a289-16311d432c9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:33.346936 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b520341-6bdd-4c9b-a289-16311d432c9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:33.357363 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b520341-6bdd-4c9b-a289-16311d432c9a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:33.460701 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79a2ab-ff21-4bb3-b7bd-e53a8b257db2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:33.462007 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79a2ab-ff21-4bb3-b7bd-e53a8b257db2 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:33.462512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79a2ab-ff21-4bb3-b7bd-e53a8b257db2 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:33.463633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d79a2ab-ff21-4bb3-b7bd-e53a8b257db2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:33.469316 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5d79a2ab-ff21-4bb3-b7bd-e53a8b257db2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:33.532498 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 878/1763] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:33 2022] POST /identity/v3/projects => generated 355 bytes in 515 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:33.537683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b520341-6bdd-4c9b-a289-16311d432c9a admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:33.543477 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6b520341-6bdd-4c9b-a289-16311d432c9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:33.720727 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79a2ab-ff21-4bb3-b7bd-e53a8b257db2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:33.724559 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d79a2ab-ff21-4bb3-b7bd-e53a8b257db2 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:33.783627 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 886/1764] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 919 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:33.784358 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79a2ab-ff21-4bb3-b7bd-e53a8b257db2 service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:33.834321 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d79a2ab-ff21-4bb3-b7bd-e53a8b257db2 service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:33.936370 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b520341-6bdd-4c9b-a289-16311d432c9a admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:33.984619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54039a4f-1113-4373-8b59-158d9d9da109 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:33.987547 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54039a4f-1113-4373-8b59-158d9d9da109 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:33.988752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54039a4f-1113-4373-8b59-158d9d9da109 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:33.995900 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54039a4f-1113-4373-8b59-158d9d9da109 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:33.996842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee718b0-d6fa-4d19-b909-87d6c79d0c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:33.996842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee718b0-d6fa-4d19-b909-87d6c79d0c18 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:33.996842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee718b0-d6fa-4d19-b909-87d6c79d0c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:33.996842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee718b0-d6fa-4d19-b909-87d6c79d0c18 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:33.997189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee718b0-d6fa-4d19-b909-87d6c79d0c18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:34.012658 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee718b0-d6fa-4d19-b909-87d6c79d0c18 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:34.014476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-54039a4f-1113-4373-8b59-158d9d9da109 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:34.144831 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 887/1765] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:33 2022] POST /identity/v3/users => generated 278 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:34.146756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066d054-af4a-4b09-a99c-daecce444a0b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:34.147856 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066d054-af4a-4b09-a99c-daecce444a0b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:34.153508 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066d054-af4a-4b09-a99c-daecce444a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:34.237828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f066d054-af4a-4b09-a99c-daecce444a0b None None] MFA Rules not processed for user `e9dcca05df70446090cd525c0644cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:34.243737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f066d054-af4a-4b09-a99c-daecce444a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:34.387414 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54039a4f-1113-4373-8b59-158d9d9da109 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:34.398777 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54039a4f-1113-4373-8b59-158d9d9da109 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:34.446545 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:34.447253 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 879/1766] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 914 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:34.449084 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54039a4f-1113-4373-8b59-158d9d9da109 service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:34.458671 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 888/1767] 10.222.0.49 () {58 vars in 1015 bytes} [Mon Jul 18 16:51:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:34.459999 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066d054-af4a-4b09-a99c-daecce444a0b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:34.471520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f066d054-af4a-4b09-a99c-daecce444a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:34.491817 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54039a4f-1113-4373-8b59-158d9d9da109 service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:34.510909 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ae0f9-c393-4cf1-aaa8-e73afb032b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:34.512179 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ae0f9-c393-4cf1-aaa8-e73afb032b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:34.512328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ae0f9-c393-4cf1-aaa8-e73afb032b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:34.512625 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ae0f9-c393-4cf1-aaa8-e73afb032b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:34.513591 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ae0f9-c393-4cf1-aaa8-e73afb032b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:34.519933 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ae0f9-c393-4cf1-aaa8-e73afb032b6e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:34.529308 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066d054-af4a-4b09-a99c-daecce444a0b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:34.542137 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453d1e2-8188-4b54-93bc-1a3aa7eaa6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:34.545509 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453d1e2-8188-4b54-93bc-1a3aa7eaa6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:34.545509 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453d1e2-8188-4b54-93bc-1a3aa7eaa6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:34.545509 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7453d1e2-8188-4b54-93bc-1a3aa7eaa6fd admin admin] PATH_INFO: `/v3/projects/4757f925bd3a471f9ecaf78711cdceaa` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:34.549858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453d1e2-8188-4b54-93bc-1a3aa7eaa6fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4757f925bd3a471f9ecaf78711cdceaa)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:34.550637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 880/1768] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:34.552057 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7453d1e2-8188-4b54-93bc-1a3aa7eaa6fd admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:34.555327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ae0f9-c393-4cf1-aaa8-e73afb032b6e admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:34.621455 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ae0f9-c393-4cf1-aaa8-e73afb032b6e admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:34.645765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19c9a9-69f9-4586-8f2f-9510ab2e21aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:34.646593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19c9a9-69f9-4586-8f2f-9510ab2e21aa admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:34.646890 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19c9a9-69f9-4586-8f2f-9510ab2e21aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:34.647178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e19c9a9-69f9-4586-8f2f-9510ab2e21aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:34.648502 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19c9a9-69f9-4586-8f2f-9510ab2e21aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:34.650033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e19c9a9-69f9-4586-8f2f-9510ab2e21aa admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:34.696243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 881/1769] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:34 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:34.697165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19c9a9-69f9-4586-8f2f-9510ab2e21aa admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:34.709547 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6e19c9a9-69f9-4586-8f2f-9510ab2e21aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:34.766675 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e19c9a9-69f9-4586-8f2f-9510ab2e21aa admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:34.788900 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4cc0f-cdff-4317-be04-2d5963abb8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:34.789832 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4cc0f-cdff-4317-be04-2d5963abb8d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:34.790121 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4cc0f-cdff-4317-be04-2d5963abb8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:34.790401 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c4cc0f-cdff-4317-be04-2d5963abb8d2 admin admin] PATH_INFO: `/v3/projects/15e25b894be343b1ab79e7e4e2ae8333` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:34.802288 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4cc0f-cdff-4317-be04-2d5963abb8d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15e25b894be343b1ab79e7e4e2ae8333)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:34.803296 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c4cc0f-cdff-4317-be04-2d5963abb8d2 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:34.870021 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7453d1e2-8188-4b54-93bc-1a3aa7eaa6fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4757f925bd3a471f9ecaf78711cdceaa', 'request_id': 'req-7453d1e2-8188-4b54-93bc-1a3aa7eaa6fd'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:34.912519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7453d1e2-8188-4b54-93bc-1a3aa7eaa6fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4757f925bd3a471f9ecaf78711cdceaa', 'request_id': 'req-7453d1e2-8188-4b54-93bc-1a3aa7eaa6fd'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:34.951157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7453d1e2-8188-4b54-93bc-1a3aa7eaa6fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4757f925bd3a471f9ecaf78711cdceaa', 'request_id': 'req-7453d1e2-8188-4b54-93bc-1a3aa7eaa6fd'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:35.070438 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e4c4cc0f-cdff-4317-be04-2d5963abb8d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15e25b894be343b1ab79e7e4e2ae8333', 'request_id': 'req-e4c4cc0f-cdff-4317-be04-2d5963abb8d2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:35.086983 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e4c4cc0f-cdff-4317-be04-2d5963abb8d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15e25b894be343b1ab79e7e4e2ae8333', 'request_id': 'req-e4c4cc0f-cdff-4317-be04-2d5963abb8d2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:35.097961 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7453d1e2-8188-4b54-93bc-1a3aa7eaa6fd admin admin] The token cache is being invalidate because project 4757f925bd3a471f9ecaf78711cdceaa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:35.098430 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7453d1e2-8188-4b54-93bc-1a3aa7eaa6fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:35.108585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7453d1e2-8188-4b54-93bc-1a3aa7eaa6fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:35.108585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 889/1770] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:34 2022] DELETE /identity/v3/projects/4757f925bd3a471f9ecaf78711cdceaa => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:35.108585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453d1e2-8188-4b54-93bc-1a3aa7eaa6fd admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:35.108585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7453d1e2-8188-4b54-93bc-1a3aa7eaa6fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:35.120273 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e4c4cc0f-cdff-4317-be04-2d5963abb8d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15e25b894be343b1ab79e7e4e2ae8333', 'request_id': 'req-e4c4cc0f-cdff-4317-be04-2d5963abb8d2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:35.294372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e4c4cc0f-cdff-4317-be04-2d5963abb8d2 admin admin] The token cache is being invalidate because project 15e25b894be343b1ab79e7e4e2ae8333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:35.294812 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e4c4cc0f-cdff-4317-be04-2d5963abb8d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:35.297108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e4c4cc0f-cdff-4317-be04-2d5963abb8d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:35.302567 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 882/1771] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:34 2022] DELETE /identity/v3/projects/15e25b894be343b1ab79e7e4e2ae8333 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:35.304603 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4cc0f-cdff-4317-be04-2d5963abb8d2 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:35.324394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e4c4cc0f-cdff-4317-be04-2d5963abb8d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:35.368369 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7453d1e2-8188-4b54-93bc-1a3aa7eaa6fd admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:35.497892 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad50ed4-cb9e-4c48-917e-bafe334e892d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:35.498577 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad50ed4-cb9e-4c48-917e-bafe334e892d service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:35.498801 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad50ed4-cb9e-4c48-917e-bafe334e892d service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:35.499082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad50ed4-cb9e-4c48-917e-bafe334e892d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:35.508472 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-dad50ed4-cb9e-4c48-917e-bafe334e892d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:35.558457 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad50ed4-cb9e-4c48-917e-bafe334e892d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:35.564768 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad50ed4-cb9e-4c48-917e-bafe334e892d service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:35.593289 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:35.627693 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 890/1772] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:35.630508 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535a139-fbbd-4bfa-95d3-f996f3bfb081 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:35.631048 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535a139-fbbd-4bfa-95d3-f996f3bfb081 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:35.631517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535a139-fbbd-4bfa-95d3-f996f3bfb081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:35.651366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c4cc0f-cdff-4317-be04-2d5963abb8d2 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:35.706786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bee899-3b07-45e0-b7d8-d735be07994a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:35.706786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bee899-3b07-45e0-b7d8-d735be07994a admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:35.706786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bee899-3b07-45e0-b7d8-d735be07994a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:35.706786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bee899-3b07-45e0-b7d8-d735be07994a admin admin] PATH_INFO: `/v3/projects/dad10c31a19e4c1cb36c835bbc13e91f/users/dd39c172892e4d1d8ba077b0f9d8da38/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:35.730342 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b535a139-fbbd-4bfa-95d3-f996f3bfb081 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:35.731598 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b535a139-fbbd-4bfa-95d3-f996f3bfb081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:35.757826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 891/1773] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:35.765681 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bee899-3b07-45e0-b7d8-d735be07994a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dad10c31a19e4c1cb36c835bbc13e91f, user_id=dd39c172892e4d1d8ba077b0f9d8da38, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:35.770350 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111ebd3-d9b1-4eed-8eff-e5eec114ed30 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:35.771176 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111ebd3-d9b1-4eed-8eff-e5eec114ed30 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:35.771176 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1111ebd3-d9b1-4eed-8eff-e5eec114ed30 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:35.772619 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 892/1774] 10.222.0.76 () {54 vars in 912 bytes} [Mon Jul 18 16:51:35 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:51:35.773885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803eb4d2-25e2-4d7f-82bc-709c5c069e76 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:35.774171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803eb4d2-25e2-4d7f-82bc-709c5c069e76 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:35.774452 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803eb4d2-25e2-4d7f-82bc-709c5c069e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:35.776895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bee899-3b07-45e0-b7d8-d735be07994a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:35.832570 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-803eb4d2-25e2-4d7f-82bc-709c5c069e76 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:35.833880 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-803eb4d2-25e2-4d7f-82bc-709c5c069e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:35.866894 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 893/1775] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:35.892009 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 883/1776] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:35 2022] PUT /identity/v3/projects/dad10c31a19e4c1cb36c835bbc13e91f/users/dd39c172892e4d1d8ba077b0f9d8da38/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:35.893746 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b544b-8347-4599-8445-8efb3071b3c6 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:35.894188 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b544b-8347-4599-8445-8efb3071b3c6 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:35.895573 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301fc90-66e4-4675-b86f-46b9c2fb24e7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:35.896420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b544b-8347-4599-8445-8efb3071b3c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:35.898510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301fc90-66e4-4675-b86f-46b9c2fb24e7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:35.899480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301fc90-66e4-4675-b86f-46b9c2fb24e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:35.954865 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-ba6b544b-8347-4599-8445-8efb3071b3c6 None None] MFA Rules not processed for user `e9dcca05df70446090cd525c0644cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:35.957213 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ba6b544b-8347-4599-8445-8efb3071b3c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:35.974357 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a301fc90-66e4-4675-b86f-46b9c2fb24e7 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:35.975662 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a301fc90-66e4-4675-b86f-46b9c2fb24e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:36.136931 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 884/1777] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 16:51:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:36.138441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f968848-d5bf-4a88-a756-172f1bc5b44a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:36.138737 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f968848-d5bf-4a88-a756-172f1bc5b44a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:36.139298 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f968848-d5bf-4a88-a756-172f1bc5b44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:36.199725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 894/1778] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:36.203568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ca575-93bf-443c-a9da-7c059893f2fb None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:36.205250 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ca575-93bf-443c-a9da-7c059893f2fb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:36.205572 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-7f968848-d5bf-4a88-a756-172f1bc5b44a None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:36.206401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ca575-93bf-443c-a9da-7c059893f2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:36.207013 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7f968848-d5bf-4a88-a756-172f1bc5b44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:36.246094 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 885/1779] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:36.250205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f968848-d5bf-4a88-a756-172f1bc5b44a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:36.256147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7f968848-d5bf-4a88-a756-172f1bc5b44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:36.261572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2a4ca575-93bf-443c-a9da-7c059893f2fb None None] MFA Rules not processed for user `dd39c172892e4d1d8ba077b0f9d8da38`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:36.263111 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2a4ca575-93bf-443c-a9da-7c059893f2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:36.308767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f968848-d5bf-4a88-a756-172f1bc5b44a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:36.329225 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5dcff-1d4b-4db6-ae77-7eee20d077c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:36.329832 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5dcff-1d4b-4db6-ae77-7eee20d077c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:36.330114 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5dcff-1d4b-4db6-ae77-7eee20d077c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:36.330390 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5dcff-1d4b-4db6-ae77-7eee20d077c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:36.357654 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5dcff-1d4b-4db6-ae77-7eee20d077c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:36.360201 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5dcff-1d4b-4db6-ae77-7eee20d077c6 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:36.382082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 895/1780] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:36 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:36.383597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ca575-93bf-443c-a9da-7c059893f2fb None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:36.392579 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 886/1781] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:36.398289 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ca575-93bf-443c-a9da-7c059893f2fb None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:36.399340 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5dcff-1d4b-4db6-ae77-7eee20d077c6 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:36.404569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ad033-83ac-4f4a-b1e8-7b38f875a494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:36.405691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ad033-83ac-4f4a-b1e8-7b38f875a494 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:36.408307 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ad033-83ac-4f4a-b1e8-7b38f875a494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:36.408878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ad033-83ac-4f4a-b1e8-7b38f875a494 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:36.409933 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ad033-83ac-4f4a-b1e8-7b38f875a494 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:36.410463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ad033-83ac-4f4a-b1e8-7b38f875a494 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:36.412851 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ad033-83ac-4f4a-b1e8-7b38f875a494 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:36.430597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 896/1782] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:36.431934 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ad033-83ac-4f4a-b1e8-7b38f875a494 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:36.444149 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ad033-83ac-4f4a-b1e8-7b38f875a494 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:36.452000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a1a6b-73f8-4d60-8ea4-c2171b0ce167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:36.454194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a1a6b-73f8-4d60-8ea4-c2171b0ce167 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:36.454498 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5dcff-1d4b-4db6-ae77-7eee20d077c6 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:36.454935 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a1a6b-73f8-4d60-8ea4-c2171b0ce167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:36.457002 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84a1a6b-73f8-4d60-8ea4-c2171b0ce167 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:36.457002 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a1a6b-73f8-4d60-8ea4-c2171b0ce167 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:36.459107 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84a1a6b-73f8-4d60-8ea4-c2171b0ce167 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:36.474475 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30365c-b38a-4dfa-8c3d-0fcd3d688550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:36.475182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30365c-b38a-4dfa-8c3d-0fcd3d688550 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:36.475471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30365c-b38a-4dfa-8c3d-0fcd3d688550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:36.475747 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30365c-b38a-4dfa-8c3d-0fcd3d688550 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:36.476558 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30365c-b38a-4dfa-8c3d-0fcd3d688550 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:36.476866 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30365c-b38a-4dfa-8c3d-0fcd3d688550 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:36.478901 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30365c-b38a-4dfa-8c3d-0fcd3d688550 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:36.516706 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 887/1783] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:36.517681 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30365c-b38a-4dfa-8c3d-0fcd3d688550 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:36.551174 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30365c-b38a-4dfa-8c3d-0fcd3d688550 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:36.557469 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:36.570975 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54e078-c283-482e-8dae-a8c84e38a68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:36.571895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54e078-c283-482e-8dae-a8c84e38a68c admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:36.572187 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54e078-c283-482e-8dae-a8c84e38a68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:36.572527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54e078-c283-482e-8dae-a8c84e38a68c admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:36.573286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54e078-c283-482e-8dae-a8c84e38a68c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:36.575351 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54e078-c283-482e-8dae-a8c84e38a68c admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:36.656836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 897/1784] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:36 2022] POST /identity/v3/projects => generated 357 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:36.656836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a1a6b-73f8-4d60-8ea4-c2171b0ce167 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:36.760657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 888/1785] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:36 2022] POST /identity/v3/projects => generated 399 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:36.760657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5ba54-e64f-4cf2-9b5b-7f1dfc0537fd None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:36.760657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5ba54-e64f-4cf2-9b5b-7f1dfc0537fd None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:36.760657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5ba54-e64f-4cf2-9b5b-7f1dfc0537fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:36.846430 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-23e5ba54-e64f-4cf2-9b5b-7f1dfc0537fd None None] MFA Rules not processed for user `9faf38f2ccec4b60a3612648073d06d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:36.850209 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-23e5ba54-e64f-4cf2-9b5b-7f1dfc0537fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:36.938521 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84a1a6b-73f8-4d60-8ea4-c2171b0ce167 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:36.983955 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 889/1786] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:36.985458 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5ba54-e64f-4cf2-9b5b-7f1dfc0537fd None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:37.232630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da6a1d-a739-469b-9333-b6323f123445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:37.239229 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da6a1d-a739-469b-9333-b6323f123445 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:37.239408 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da6a1d-a739-469b-9333-b6323f123445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:37.239596 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da6a1d-a739-469b-9333-b6323f123445 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:37.242937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da6a1d-a739-469b-9333-b6323f123445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:37.258299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da6a1d-a739-469b-9333-b6323f123445 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:37.317212 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5ba54-e64f-4cf2-9b5b-7f1dfc0537fd None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:37.361274 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec0193-dd35-48dc-9381-54f7ad9fea7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:37.361996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec0193-dd35-48dc-9381-54f7ad9fea7e admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:37.362281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec0193-dd35-48dc-9381-54f7ad9fea7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:37.362560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec0193-dd35-48dc-9381-54f7ad9fea7e admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:37.363320 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec0193-dd35-48dc-9381-54f7ad9fea7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:37.376690 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec0193-dd35-48dc-9381-54f7ad9fea7e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:37.493538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 898/1787] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:36 2022] POST /identity/v3/projects => generated 363 bytes in 838 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:37.498218 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da6a1d-a739-469b-9333-b6323f123445 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:37.533762 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 890/1788] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:36 2022] POST /identity/v3/users => generated 285 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:37.535752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec0193-dd35-48dc-9381-54f7ad9fea7e admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:37.545343 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ceec0193-dd35-48dc-9381-54f7ad9fea7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:37.604861 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec0193-dd35-48dc-9381-54f7ad9fea7e admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:37.773726 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da6a1d-a739-469b-9333-b6323f123445 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:37.795598 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcb0fd-f2e4-4dfa-b277-ef8b3c61e1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:37.798180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcb0fd-f2e4-4dfa-b277-ef8b3c61e1f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:37.798479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcb0fd-f2e4-4dfa-b277-ef8b3c61e1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:37.798764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcb0fd-f2e4-4dfa-b277-ef8b3c61e1f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:37.799494 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcb0fd-f2e4-4dfa-b277-ef8b3c61e1f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:37.809119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcb0fd-f2e4-4dfa-b277-ef8b3c61e1f7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:37.840186 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f099eb-1dde-437c-b695-cbf8ad27e33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:37.842226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f099eb-1dde-437c-b695-cbf8ad27e33d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:37.842908 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f099eb-1dde-437c-b695-cbf8ad27e33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:37.843651 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f099eb-1dde-437c-b695-cbf8ad27e33d admin admin] PATH_INFO: `/v3/users/f4789ce37e674af8bcaa3ab1059bf65f` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:37.846320 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f099eb-1dde-437c-b695-cbf8ad27e33d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4789ce37e674af8bcaa3ab1059bf65f)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:37.867873 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f099eb-1dde-437c-b695-cbf8ad27e33d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:38.015819 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 899/1789] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:37 2022] POST /identity/v3/users => generated 300 bytes in 521 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:38.018486 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcb0fd-f2e4-4dfa-b277-ef8b3c61e1f7 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:38.039427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcb0fd-f2e4-4dfa-b277-ef8b3c61e1f7 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:38.051699 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ba27e-966c-448d-99ad-31332f847387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:38.052401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ba27e-966c-448d-99ad-31332f847387 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:38.052694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ba27e-966c-448d-99ad-31332f847387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:38.052980 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ba27e-966c-448d-99ad-31332f847387 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:38.053721 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ba27e-966c-448d-99ad-31332f847387 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:38.055940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ba27e-966c-448d-99ad-31332f847387 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:38.214877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-90f099eb-1dde-437c-b695-cbf8ad27e33d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4789ce37e674af8bcaa3ab1059bf65f'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:38.278371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 900/1790] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:38 2022] POST /identity/v3/users => generated 282 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:38.278371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ba27e-966c-448d-99ad-31332f847387 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:38.308565 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ba27e-966c-448d-99ad-31332f847387 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:38.334552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c433d-d3f2-4004-87e5-503797ecc0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:38.335497 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c433d-d3f2-4004-87e5-503797ecc0ca admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:38.335952 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c433d-d3f2-4004-87e5-503797ecc0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:38.340896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c433d-d3f2-4004-87e5-503797ecc0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:38.341677 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c433d-d3f2-4004-87e5-503797ecc0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:38.345704 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c433d-d3f2-4004-87e5-503797ecc0ca admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:38.369953 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-90f099eb-1dde-437c-b695-cbf8ad27e33d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4789ce37e674af8bcaa3ab1059bf65f'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:38.384828 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-90f099eb-1dde-437c-b695-cbf8ad27e33d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4789ce37e674af8bcaa3ab1059bf65f'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:38.391848 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-90f099eb-1dde-437c-b695-cbf8ad27e33d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4789ce37e674af8bcaa3ab1059bf65f'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:38.419044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-90f099eb-1dde-437c-b695-cbf8ad27e33d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4789ce37e674af8bcaa3ab1059bf65f'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:38.439009 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 891/1791] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:37 2022] DELETE /identity/v3/users/f4789ce37e674af8bcaa3ab1059bf65f => generated 0 bytes in 904 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:38.441127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 901/1792] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:38.441316 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7286c-c576-4b9c-bc42-de5c9679aebb None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:38.441775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7286c-c576-4b9c-bc42-de5c9679aebb None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:38.442820 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b7286c-c576-4b9c-bc42-de5c9679aebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:38.443430 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c433d-d3f2-4004-87e5-503797ecc0ca admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:38.450522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-262c433d-d3f2-4004-87e5-503797ecc0ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:38.492682 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-89b7286c-c576-4b9c-bc42-de5c9679aebb None None] MFA Rules not processed for user `4d27db5cdd9e453dbd93b862db694309`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:38.492682 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-89b7286c-c576-4b9c-bc42-de5c9679aebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:38.542497 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c433d-d3f2-4004-87e5-503797ecc0ca admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:38.679444 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 892/1793] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:38.684915 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7286c-c576-4b9c-bc42-de5c9679aebb None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:38.691892 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-89b7286c-c576-4b9c-bc42-de5c9679aebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:38.801089 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a20eeb-091d-435f-8f14-76cb4b718437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:38.802222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a20eeb-091d-435f-8f14-76cb4b718437 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:38.802743 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a20eeb-091d-435f-8f14-76cb4b718437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:38.803114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a20eeb-091d-435f-8f14-76cb4b718437 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:38.803933 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a20eeb-091d-435f-8f14-76cb4b718437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:38.806366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a20eeb-091d-435f-8f14-76cb4b718437 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:38.809568 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b7286c-c576-4b9c-bc42-de5c9679aebb None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:38.817360 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c5e24-ab2b-45e5-92f7-28ca9489c509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:38.819473 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c5e24-ab2b-45e5-92f7-28ca9489c509 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:38.821147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c5e24-ab2b-45e5-92f7-28ca9489c509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:38.821542 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 902/1794] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:38.822005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c5e24-ab2b-45e5-92f7-28ca9489c509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:38.823248 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177080bd-9dc8-49ea-8441-5f7908ee4379 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:38.823618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177080bd-9dc8-49ea-8441-5f7908ee4379 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:38.824232 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177080bd-9dc8-49ea-8441-5f7908ee4379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:38.824596 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c5e24-ab2b-45e5-92f7-28ca9489c509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:38.828688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8c5e24-ab2b-45e5-92f7-28ca9489c509 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:38.849514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 893/1795] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:38.852803 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c5e24-ab2b-45e5-92f7-28ca9489c509 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:38.857947 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-cd8c5e24-ab2b-45e5-92f7-28ca9489c509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:38.881594 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8c5e24-ab2b-45e5-92f7-28ca9489c509 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:38.883969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-177080bd-9dc8-49ea-8441-5f7908ee4379 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:38.885257 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-177080bd-9dc8-49ea-8441-5f7908ee4379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:38.888591 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1de0f-29a7-4f3d-a26b-76ee946a1e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:38.889759 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1de0f-29a7-4f3d-a26b-76ee946a1e6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:38.890208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1de0f-29a7-4f3d-a26b-76ee946a1e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:38.890612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e1de0f-29a7-4f3d-a26b-76ee946a1e6d admin admin] PATH_INFO: `/v3/projects/590fd46f4e7b46eb9e250ee10955cec2/users/32a4ee6b5d794e43b795af512a46ff1f/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:38.899873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 903/1796] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:38.902918 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177080bd-9dc8-49ea-8441-5f7908ee4379 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:38.916482 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1de0f-29a7-4f3d-a26b-76ee946a1e6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=590fd46f4e7b46eb9e250ee10955cec2, user_id=32a4ee6b5d794e43b795af512a46ff1f, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:38.919646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e1de0f-29a7-4f3d-a26b-76ee946a1e6d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:38.930689 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177080bd-9dc8-49ea-8441-5f7908ee4379 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:38.952781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7f0e8-2270-4e8a-bad9-156263192f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:38.953643 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7f0e8-2270-4e8a-bad9-156263192f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:38.954264 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7f0e8-2270-4e8a-bad9-156263192f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:38.954264 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7f0e8-2270-4e8a-bad9-156263192f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:38.955273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7f0e8-2270-4e8a-bad9-156263192f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:38.957555 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7f0e8-2270-4e8a-bad9-156263192f43 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:39.000012 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 904/1797] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:39.001165 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7f0e8-2270-4e8a-bad9-156263192f43 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:39.025907 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 894/1798] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:38 2022] PUT /identity/v3/projects/590fd46f4e7b46eb9e250ee10955cec2/users/32a4ee6b5d794e43b795af512a46ff1f/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:39.028624 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1de0f-29a7-4f3d-a26b-76ee946a1e6d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:39.033441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7f0e8-2270-4e8a-bad9-156263192f43 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:39.036432 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b0e1de0f-29a7-4f3d-a26b-76ee946a1e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:39.201358 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2aa89-cffc-4c72-8f1f-86a326d4541b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:39.202367 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2aa89-cffc-4c72-8f1f-86a326d4541b admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:39.202988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2aa89-cffc-4c72-8f1f-86a326d4541b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:39.203718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a2aa89-cffc-4c72-8f1f-86a326d4541b admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:39.204635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2aa89-cffc-4c72-8f1f-86a326d4541b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:39.213957 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a2aa89-cffc-4c72-8f1f-86a326d4541b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:39.217908 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e1de0f-29a7-4f3d-a26b-76ee946a1e6d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:39.224278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855348f-53a8-4fff-8b03-c7b5b509a616 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:39.225914 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855348f-53a8-4fff-8b03-c7b5b509a616 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:39.226083 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855348f-53a8-4fff-8b03-c7b5b509a616 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:39.226381 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3855348f-53a8-4fff-8b03-c7b5b509a616 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:39.241783 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 905/1799] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:39.241969 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855348f-53a8-4fff-8b03-c7b5b509a616 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:39.242836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2aa89-cffc-4c72-8f1f-86a326d4541b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:39.244222 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3855348f-53a8-4fff-8b03-c7b5b509a616 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:39.265482 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a2aa89-cffc-4c72-8f1f-86a326d4541b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:39.273761 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 895/1800] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:39.274705 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855348f-53a8-4fff-8b03-c7b5b509a616 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:39.287668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3855348f-53a8-4fff-8b03-c7b5b509a616 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:39.295360 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d4d77-bb91-4da5-be77-dfc0c44117f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:39.298070 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d4d77-bb91-4da5-be77-dfc0c44117f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:39.298770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d4d77-bb91-4da5-be77-dfc0c44117f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:39.299005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d4d77-bb91-4da5-be77-dfc0c44117f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:39.299920 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d4d77-bb91-4da5-be77-dfc0c44117f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:39.302232 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d4d77-bb91-4da5-be77-dfc0c44117f1 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:39.302398 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0cb12-7d22-4f6f-80ae-4c9f2c43d089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:39.303130 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0cb12-7d22-4f6f-80ae-4c9f2c43d089 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:39.303420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0cb12-7d22-4f6f-80ae-4c9f2c43d089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:39.303709 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0cb12-7d22-4f6f-80ae-4c9f2c43d089 admin admin] PATH_INFO: `/v3/projects/474715b3e30749a7973b5df338806d3f/users/cc9698a3f3bd43718b676418d608ff17/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:39.318217 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 896/1801] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:39.319392 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d4d77-bb91-4da5-be77-dfc0c44117f1 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:39.343628 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0cb12-7d22-4f6f-80ae-4c9f2c43d089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=474715b3e30749a7973b5df338806d3f, user_id=cc9698a3f3bd43718b676418d608ff17, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:39.348294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0cb12-7d22-4f6f-80ae-4c9f2c43d089 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:39.365417 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d4d77-bb91-4da5-be77-dfc0c44117f1 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:39.397067 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa389b2f-e3c4-4f3a-8dca-0e1283d125fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:39.400914 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa389b2f-e3c4-4f3a-8dca-0e1283d125fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:39.401473 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa389b2f-e3c4-4f3a-8dca-0e1283d125fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:39.401748 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa389b2f-e3c4-4f3a-8dca-0e1283d125fc admin admin] PATH_INFO: `/v3/projects/a21db8b618384dc783c68358ab067721/users/7d935f848100472e9d308edea6c2b801/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:39.448561 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa389b2f-e3c4-4f3a-8dca-0e1283d125fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21db8b618384dc783c68358ab067721, user_id=7d935f848100472e9d308edea6c2b801, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:39.454231 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa389b2f-e3c4-4f3a-8dca-0e1283d125fc admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:39.541364 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 906/1802] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:39 2022] PUT /identity/v3/projects/474715b3e30749a7973b5df338806d3f/users/cc9698a3f3bd43718b676418d608ff17/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:39.542488 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0cb12-7d22-4f6f-80ae-4c9f2c43d089 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:39.573072 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 897/1803] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:39 2022] PUT /identity/v3/projects/a21db8b618384dc783c68358ab067721/users/7d935f848100472e9d308edea6c2b801/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:39.573072 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1871e2f-b762-4f65-adde-f9dbb0da22fb None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:39.576274 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1871e2f-b762-4f65-adde-f9dbb0da22fb None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:39.576597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1871e2f-b762-4f65-adde-f9dbb0da22fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:39.705851 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0cb12-7d22-4f6f-80ae-4c9f2c43d089 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:39.706888 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a1871e2f-b762-4f65-adde-f9dbb0da22fb None None] MFA Rules not processed for user `cc9698a3f3bd43718b676418d608ff17`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:39.709064 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a1871e2f-b762-4f65-adde-f9dbb0da22fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:39.740000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:39.815984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:39.922833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 898/1804] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:39.922833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d906f-d335-4889-8987-095f491efb98 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:39.922833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d906f-d335-4889-8987-095f491efb98 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:39.922833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d906f-d335-4889-8987-095f491efb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:39.972660 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02524f-030b-4f22-af7c-f6624fa334be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:39.973842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02524f-030b-4f22-af7c-f6624fa334be admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:39.974208 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02524f-030b-4f22-af7c-f6624fa334be admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:39.974706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02524f-030b-4f22-af7c-f6624fa334be admin admin] PATH_INFO: `/v3/projects/590fd46f4e7b46eb9e250ee10955cec2/users/32a4ee6b5d794e43b795af512a46ff1f/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:39.978801 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02524f-030b-4f22-af7c-f6624fa334be admin admin] RBAC: Authorizing `identity:create_grant(project_id=590fd46f4e7b46eb9e250ee10955cec2, user_id=32a4ee6b5d794e43b795af512a46ff1f, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:39.986328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d02524f-030b-4f22-af7c-f6624fa334be admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:40.041100 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 907/1805] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:39 2022] PUT /identity/v3/projects/590fd46f4e7b46eb9e250ee10955cec2/users/32a4ee6b5d794e43b795af512a46ff1f/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:40.058151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-8f4d906f-d335-4889-8987-095f491efb98 None None] MFA Rules not processed for user `7d935f848100472e9d308edea6c2b801`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:40.058325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e05d7-34ca-4e7a-8c08-944af64c231d None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:40.058325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e05d7-34ca-4e7a-8c08-944af64c231d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:40.058325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e05d7-34ca-4e7a-8c08-944af64c231d None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:40.058637 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8f4d906f-d335-4889-8987-095f491efb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:40.058730 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 908/1806] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 16:51:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:51:40.058730 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e05d7-34ca-4e7a-8c08-944af64c231d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:40.197123 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 899/1807] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:39 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:40.206533 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e05d7-34ca-4e7a-8c08-944af64c231d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:40.208654 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3c49f-1df8-4bf7-8275-1118fff4a8ae None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:40.208950 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3c49f-1df8-4bf7-8275-1118fff4a8ae None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:40.213239 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3c49f-1df8-4bf7-8275-1118fff4a8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:40.213432 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4cf71e-a49e-4e2c-920a-b989aa53533d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:40.213432 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cf71e-a49e-4e2c-920a-b989aa53533d admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:40.213432 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cf71e-a49e-4e2c-920a-b989aa53533d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:40.213432 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4cf71e-a49e-4e2c-920a-b989aa53533d admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:40.214143 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cf71e-a49e-4e2c-920a-b989aa53533d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:40.216180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4cf71e-a49e-4e2c-920a-b989aa53533d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:40.299477 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-7dc3c49f-1df8-4bf7-8275-1118fff4a8ae None None] MFA Rules not processed for user `32a4ee6b5d794e43b795af512a46ff1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:40.300881 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7dc3c49f-1df8-4bf7-8275-1118fff4a8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:40.406505 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 909/1808] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:40 2022] POST /identity/v3/projects => generated 401 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:40.412038 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13a73d-639c-432f-886c-0555211168bb None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:40.412550 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13a73d-639c-432f-886c-0555211168bb None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:40.412980 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13a73d-639c-432f-886c-0555211168bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:40.480699 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9b13a73d-639c-432f-886c-0555211168bb None None] MFA Rules not processed for user `381cf4381ce64379b285d75e2909813d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:40.482025 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9b13a73d-639c-432f-886c-0555211168bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:40.526488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 900/1809] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:40 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:40.528993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3c49f-1df8-4bf7-8275-1118fff4a8ae None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:40.558441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3c49f-1df8-4bf7-8275-1118fff4a8ae None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:40.712894 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 910/1810] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 16:51:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:40.713861 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13a73d-639c-432f-886c-0555211168bb None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:40.816712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae402d55-f04f-41c7-90f1-1e9a11d65b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:40.817874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae402d55-f04f-41c7-90f1-1e9a11d65b96 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:40.818368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae402d55-f04f-41c7-90f1-1e9a11d65b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:40.818851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae402d55-f04f-41c7-90f1-1e9a11d65b96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:40.819798 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae402d55-f04f-41c7-90f1-1e9a11d65b96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:40.822009 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae402d55-f04f-41c7-90f1-1e9a11d65b96 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:40.962368 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13a73d-639c-432f-886c-0555211168bb None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:40.970506 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e0c6d-32a4-4eae-975e-9de6593f497f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:40.971282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e0c6d-32a4-4eae-975e-9de6593f497f admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:40.971650 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e0c6d-32a4-4eae-975e-9de6593f497f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:40.971936 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e0c6d-32a4-4eae-975e-9de6593f497f admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:40.972695 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e0c6d-32a4-4eae-975e-9de6593f497f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:40.976199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 901/1811] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:40 2022] POST /identity/v3/projects => generated 363 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:40.976199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae402d55-f04f-41c7-90f1-1e9a11d65b96 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:40.976939 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e0c6d-32a4-4eae-975e-9de6593f497f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:40.978895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ae402d55-f04f-41c7-90f1-1e9a11d65b96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:41.088627 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae402d55-f04f-41c7-90f1-1e9a11d65b96 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:41.109710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4c76c-d647-4f0e-ab9a-3cc2f4bb7c35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:41.110975 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4c76c-d647-4f0e-ab9a-3cc2f4bb7c35 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:41.111431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4c76c-d647-4f0e-ab9a-3cc2f4bb7c35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:41.111861 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b4c76c-d647-4f0e-ab9a-3cc2f4bb7c35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:41.140657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 911/1812] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:40 2022] POST /identity/v3/users => generated 307 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:41.143890 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e0c6d-32a4-4eae-975e-9de6593f497f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:41.199856 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e0c6d-32a4-4eae-975e-9de6593f497f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:41.362463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4c76c-d647-4f0e-ab9a-3cc2f4bb7c35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:41.374102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b4c76c-d647-4f0e-ab9a-3cc2f4bb7c35 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:41.389651 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 902/1813] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:40 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:41.391987 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4c76c-d647-4f0e-ab9a-3cc2f4bb7c35 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:41.459781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ce1b6-689c-41cc-a645-9d0335678ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:41.460504 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ce1b6-689c-41cc-a645-9d0335678ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:41.460799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ce1b6-689c-41cc-a645-9d0335678ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:41.461111 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ce1b6-689c-41cc-a645-9d0335678ac2 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:41.469604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ce1b6-689c-41cc-a645-9d0335678ac2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:41.480729 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ce1b6-689c-41cc-a645-9d0335678ac2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:41.542708 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b4c76c-d647-4f0e-ab9a-3cc2f4bb7c35 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:41.564745 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31dc65-5a21-4bd3-ba35-65c0e34c4f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:41.565522 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31dc65-5a21-4bd3-ba35-65c0e34c4f8d admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:41.565991 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31dc65-5a21-4bd3-ba35-65c0e34c4f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:41.570704 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab31dc65-5a21-4bd3-ba35-65c0e34c4f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:41.571771 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31dc65-5a21-4bd3-ba35-65c0e34c4f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:41.574431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab31dc65-5a21-4bd3-ba35-65c0e34c4f8d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:41.606232 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 903/1814] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:41.607266 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31dc65-5a21-4bd3-ba35-65c0e34c4f8d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:41.609357 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ab31dc65-5a21-4bd3-ba35-65c0e34c4f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:41.769813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 912/1815] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:41 2022] POST /identity/v3/users => generated 288 bytes in 627 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:41.771620 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ce1b6-689c-41cc-a645-9d0335678ac2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:41.795346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ce1b6-689c-41cc-a645-9d0335678ac2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:41.796095 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab31dc65-5a21-4bd3-ba35-65c0e34c4f8d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:41.804641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b02d9-e1f3-4ec3-af43-2675a370ac59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:41.805395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b02d9-e1f3-4ec3-af43-2675a370ac59 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:41.805686 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b02d9-e1f3-4ec3-af43-2675a370ac59 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:41.805967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082b02d9-e1f3-4ec3-af43-2675a370ac59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:41.808082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904a8eb-b8ca-4f49-b5cd-8e3c10694a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:41.809158 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904a8eb-b8ca-4f49-b5cd-8e3c10694a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:41.809520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904a8eb-b8ca-4f49-b5cd-8e3c10694a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:41.809982 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c904a8eb-b8ca-4f49-b5cd-8e3c10694a74 admin admin] PATH_INFO: `/v3/projects/cc1f4361751348a69eb39f0b89814c08/users/ee166146ca294e708b938ed1cc629d09/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:41.817731 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b02d9-e1f3-4ec3-af43-2675a370ac59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:41.819501 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082b02d9-e1f3-4ec3-af43-2675a370ac59 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:41.834184 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 904/1816] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:41.835164 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b02d9-e1f3-4ec3-af43-2675a370ac59 service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:41.840001 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904a8eb-b8ca-4f49-b5cd-8e3c10694a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1f4361751348a69eb39f0b89814c08, user_id=ee166146ca294e708b938ed1cc629d09, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:41.844818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c904a8eb-b8ca-4f49-b5cd-8e3c10694a74 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:41.849162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082b02d9-e1f3-4ec3-af43-2675a370ac59 service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:41.862740 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b1d24-a8b2-4710-9460-b9f851bc9a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:41.863468 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b1d24-a8b2-4710-9460-b9f851bc9a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:41.864463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b1d24-a8b2-4710-9460-b9f851bc9a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:41.864463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b1d24-a8b2-4710-9460-b9f851bc9a27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:41.864858 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b1d24-a8b2-4710-9460-b9f851bc9a27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:41.866660 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b1d24-a8b2-4710-9460-b9f851bc9a27 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:41.898811 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 905/1817] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:41.903330 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b1d24-a8b2-4710-9460-b9f851bc9a27 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:41.925636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b1d24-a8b2-4710-9460-b9f851bc9a27 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:41.930162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de0a7c-257d-4161-8c39-bc6e30f71d34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:41.930643 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de0a7c-257d-4161-8c39-bc6e30f71d34 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:41.930938 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de0a7c-257d-4161-8c39-bc6e30f71d34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:41.931218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de0a7c-257d-4161-8c39-bc6e30f71d34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:41.933137 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c6de0a7c-257d-4161-8c39-bc6e30f71d34 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:41.943098 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 913/1818] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:41 2022] PUT /identity/v3/projects/cc1f4361751348a69eb39f0b89814c08/users/ee166146ca294e708b938ed1cc629d09/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:41.944256 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904a8eb-b8ca-4f49-b5cd-8e3c10694a74 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:41.956248 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c904a8eb-b8ca-4f49-b5cd-8e3c10694a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:42.147281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de0a7c-257d-4161-8c39-bc6e30f71d34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:42.148821 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de0a7c-257d-4161-8c39-bc6e30f71d34 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:42.165528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c904a8eb-b8ca-4f49-b5cd-8e3c10694a74 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:42.183635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b94eba-1ee1-4336-983a-b65092039125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:42.186723 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b94eba-1ee1-4336-983a-b65092039125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:42.187157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b94eba-1ee1-4336-983a-b65092039125 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:42.187592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b94eba-1ee1-4336-983a-b65092039125 admin admin] PATH_INFO: `/v3/projects/49ab79b2a8bb41f1a2e9ceeba5d21742` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:42.194480 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 906/1819] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:41 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:42.195761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b94eba-1ee1-4336-983a-b65092039125 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49ab79b2a8bb41f1a2e9ceeba5d21742)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:42.196836 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de0a7c-257d-4161-8c39-bc6e30f71d34 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:42.199194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b94eba-1ee1-4336-983a-b65092039125 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:42.225854 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de0a7c-257d-4161-8c39-bc6e30f71d34 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:42.247012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:42.254438 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74c537-6e3c-4e82-b740-8cd15a29a01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:42.255569 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74c537-6e3c-4e82-b740-8cd15a29a01e admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:42.256102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74c537-6e3c-4e82-b740-8cd15a29a01e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:42.256647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74c537-6e3c-4e82-b740-8cd15a29a01e admin admin] PATH_INFO: `/v3/projects/22c39ae7402a4c9ab44b6a1283265227/users/70772cff41bf4377ab5c1406881ec346/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:42.304245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74c537-6e3c-4e82-b740-8cd15a29a01e admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c39ae7402a4c9ab44b6a1283265227, user_id=70772cff41bf4377ab5c1406881ec346, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:42.313271 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74c537-6e3c-4e82-b740-8cd15a29a01e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:42.504160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 907/1820] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:42 2022] PUT /identity/v3/projects/22c39ae7402a4c9ab44b6a1283265227/users/70772cff41bf4377ab5c1406881ec346/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:42.518096 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74c537-6e3c-4e82-b740-8cd15a29a01e admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:42.541255 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-73b94eba-1ee1-4336-983a-b65092039125 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49ab79b2a8bb41f1a2e9ceeba5d21742', 'request_id': 'req-73b94eba-1ee1-4336-983a-b65092039125'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:42.552881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-73b94eba-1ee1-4336-983a-b65092039125 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49ab79b2a8bb41f1a2e9ceeba5d21742', 'request_id': 'req-73b94eba-1ee1-4336-983a-b65092039125'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:42.568746 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-73b94eba-1ee1-4336-983a-b65092039125 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49ab79b2a8bb41f1a2e9ceeba5d21742', 'request_id': 'req-73b94eba-1ee1-4336-983a-b65092039125'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:42.715552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-73b94eba-1ee1-4336-983a-b65092039125 admin admin] The token cache is being invalidate because project 49ab79b2a8bb41f1a2e9ceeba5d21742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:42.715963 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-73b94eba-1ee1-4336-983a-b65092039125 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:42.716679 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-73b94eba-1ee1-4336-983a-b65092039125 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:42.719206 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 914/1821] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:41 2022] DELETE /identity/v3/projects/49ab79b2a8bb41f1a2e9ceeba5d21742 => generated 0 bytes in 775 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:42.722121 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74c537-6e3c-4e82-b740-8cd15a29a01e admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:42.742432 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b94eba-1ee1-4336-983a-b65092039125 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:42.757458 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-73b94eba-1ee1-4336-983a-b65092039125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:42.857037 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d585a-2df6-4d5b-a70f-2a98de283f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:42.857893 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d585a-2df6-4d5b-a70f-2a98de283f75 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:42.858282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d585a-2df6-4d5b-a70f-2a98de283f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:42.858684 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d585a-2df6-4d5b-a70f-2a98de283f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:42.859592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d585a-2df6-4d5b-a70f-2a98de283f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:42.863329 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9d585a-2df6-4d5b-a70f-2a98de283f75 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:42.897415 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 908/1822] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:42.898513 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d585a-2df6-4d5b-a70f-2a98de283f75 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:42.901164 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3d9d585a-2df6-4d5b-a70f-2a98de283f75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:42.934558 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d585a-2df6-4d5b-a70f-2a98de283f75 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:42.960242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18362ee5-2079-4bd0-b751-c62ac31390c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:42.960242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18362ee5-2079-4bd0-b751-c62ac31390c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:42.960242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18362ee5-2079-4bd0-b751-c62ac31390c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:42.960242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18362ee5-2079-4bd0-b751-c62ac31390c8 admin admin] PATH_INFO: `/v3/users/7de585ab4dc64abf861d9af84a0fc049` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:42.961546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18362ee5-2079-4bd0-b751-c62ac31390c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7de585ab4dc64abf861d9af84a0fc049)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:42.961546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18362ee5-2079-4bd0-b751-c62ac31390c8 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:42.967321 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b94eba-1ee1-4336-983a-b65092039125 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:42.974874 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7af1fd-254e-4320-b01f-cd27737293fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:42.975688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7af1fd-254e-4320-b01f-cd27737293fc admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:42.976033 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7af1fd-254e-4320-b01f-cd27737293fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:42.976461 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7af1fd-254e-4320-b01f-cd27737293fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:42.982158 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7af1fd-254e-4320-b01f-cd27737293fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:42.992903 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7af1fd-254e-4320-b01f-cd27737293fc admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:43.026412 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 915/1823] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:43.029937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7af1fd-254e-4320-b01f-cd27737293fc admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:43.031111 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-fc7af1fd-254e-4320-b01f-cd27737293fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:43.115528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7af1fd-254e-4320-b01f-cd27737293fc admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:43.182389 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca6aec-39a4-454a-8fa0-051c6e0fe6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:43.183318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca6aec-39a4-454a-8fa0-051c6e0fe6d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:43.183855 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca6aec-39a4-454a-8fa0-051c6e0fe6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:43.184291 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca6aec-39a4-454a-8fa0-051c6e0fe6d4 admin admin] PATH_INFO: `/v3/projects/cc1f4361751348a69eb39f0b89814c08/users/ee166146ca294e708b938ed1cc629d09/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:43.189387 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca6aec-39a4-454a-8fa0-051c6e0fe6d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1f4361751348a69eb39f0b89814c08, user_id=ee166146ca294e708b938ed1cc629d09, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:43.198946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ca6aec-39a4-454a-8fa0-051c6e0fe6d4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:43.220482 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 916/1824] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:43 2022] PUT /identity/v3/projects/cc1f4361751348a69eb39f0b89814c08/users/ee166146ca294e708b938ed1cc629d09/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:43.221692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca6aec-39a4-454a-8fa0-051c6e0fe6d4 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:43.292078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-18362ee5-2079-4bd0-b751-c62ac31390c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7de585ab4dc64abf861d9af84a0fc049'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:43.342342 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ca6aec-39a4-454a-8fa0-051c6e0fe6d4 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:43.350375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cedab1-29e4-48af-8e7a-3aba97923ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:43.351602 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cedab1-29e4-48af-8e7a-3aba97923ee8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:43.352044 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cedab1-29e4-48af-8e7a-3aba97923ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:43.353186 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cedab1-29e4-48af-8e7a-3aba97923ee8 admin admin] PATH_INFO: `/v3/projects/22c39ae7402a4c9ab44b6a1283265227/users/70772cff41bf4377ab5c1406881ec346/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:43.361128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cedab1-29e4-48af-8e7a-3aba97923ee8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22c39ae7402a4c9ab44b6a1283265227, user_id=70772cff41bf4377ab5c1406881ec346, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:43.380848 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cedab1-29e4-48af-8e7a-3aba97923ee8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:43.396919 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:43.400936 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-18362ee5-2079-4bd0-b751-c62ac31390c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7de585ab4dc64abf861d9af84a0fc049'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:43.411617 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-18362ee5-2079-4bd0-b751-c62ac31390c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7de585ab4dc64abf861d9af84a0fc049'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:43.419363 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-18362ee5-2079-4bd0-b751-c62ac31390c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7de585ab4dc64abf861d9af84a0fc049'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:43.424202 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 917/1825] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:43 2022] PUT /identity/v3/projects/22c39ae7402a4c9ab44b6a1283265227/users/70772cff41bf4377ab5c1406881ec346/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:43.439505 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707ee59-30b6-4fd3-9ac9-fdb4ea778b4f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:43.446104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707ee59-30b6-4fd3-9ac9-fdb4ea778b4f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:43.446104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707ee59-30b6-4fd3-9ac9-fdb4ea778b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:43.467235 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:43.487653 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-18362ee5-2079-4bd0-b751-c62ac31390c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7de585ab4dc64abf861d9af84a0fc049'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:43.513730 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 909/1826] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:42 2022] DELETE /identity/v3/users/7de585ab4dc64abf861d9af84a0fc049 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:43.513730 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44133d5-34fc-4077-96d1-0c3ce2e2ceb1 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:43.513730 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44133d5-34fc-4077-96d1-0c3ce2e2ceb1 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:43.513730 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44133d5-34fc-4077-96d1-0c3ce2e2ceb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:43.576899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6707ee59-30b6-4fd3-9ac9-fdb4ea778b4f None None] MFA Rules not processed for user `ee166146ca294e708b938ed1cc629d09`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:43.581325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6707ee59-30b6-4fd3-9ac9-fdb4ea778b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:43.657646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c44133d5-34fc-4077-96d1-0c3ce2e2ceb1 None None] MFA Rules not processed for user `70772cff41bf4377ab5c1406881ec346`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:43.661623 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c44133d5-34fc-4077-96d1-0c3ce2e2ceb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:43.874250 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 910/1827] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:43 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:43.889257 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 918/1828] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:43 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:43.889448 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44133d5-34fc-4077-96d1-0c3ce2e2ceb1 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:43.890817 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c44133d5-34fc-4077-96d1-0c3ce2e2ceb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:43.899584 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707ee59-30b6-4fd3-9ac9-fdb4ea778b4f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:43.907299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6707ee59-30b6-4fd3-9ac9-fdb4ea778b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:44.071550 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44133d5-34fc-4077-96d1-0c3ce2e2ceb1 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:44.081207 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c9798-6abe-401d-9257-d6efe81fdfb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:44.082064 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c9798-6abe-401d-9257-d6efe81fdfb9 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:44.082461 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c9798-6abe-401d-9257-d6efe81fdfb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:44.082767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c9798-6abe-401d-9257-d6efe81fdfb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:44.087509 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707ee59-30b6-4fd3-9ac9-fdb4ea778b4f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:44.103581 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52045a0c-8deb-404c-94b8-d47adbbe1cbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:44.105697 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52045a0c-8deb-404c-94b8-d47adbbe1cbf service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:44.105995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52045a0c-8deb-404c-94b8-d47adbbe1cbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:44.108351 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52045a0c-8deb-404c-94b8-d47adbbe1cbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:44.114460 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c9798-6abe-401d-9257-d6efe81fdfb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:44.121129 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c9798-6abe-401d-9257-d6efe81fdfb9 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:44.132389 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52045a0c-8deb-404c-94b8-d47adbbe1cbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:44.134091 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52045a0c-8deb-404c-94b8-d47adbbe1cbf service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:44.154745 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 911/1829] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:43 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:44.169355 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 919/1830] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:43 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:44.588185 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3829a-2d96-4a7e-b451-1f4537e5480c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:44.588185 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3829a-2d96-4a7e-b451-1f4537e5480c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:44.588185 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3829a-2d96-4a7e-b451-1f4537e5480c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:44.589162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52045a0c-8deb-404c-94b8-d47adbbe1cbf service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:44.605310 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52045a0c-8deb-404c-94b8-d47adbbe1cbf service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:44.626824 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27e19a-f48c-4147-9932-5d3b3e78a815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:44.626824 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27e19a-f48c-4147-9932-5d3b3e78a815 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:44.626824 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27e19a-f48c-4147-9932-5d3b3e78a815 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:44.626824 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27e19a-f48c-4147-9932-5d3b3e78a815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:44.641777 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0b27e19a-f48c-4147-9932-5d3b3e78a815 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:44.649357 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a3c3829a-2d96-4a7e-b451-1f4537e5480c None None] MFA Rules not processed for user `0cf277a2d03443c8af7a7bee2731d9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:44.650618 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a3c3829a-2d96-4a7e-b451-1f4537e5480c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:44.739307 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 912/1831] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:44.804795 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27e19a-f48c-4147-9932-5d3b3e78a815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:44.813554 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27e19a-f48c-4147-9932-5d3b3e78a815 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:44.832078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 920/1832] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:44.846051 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3829a-2d96-4a7e-b451-1f4537e5480c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:44.847702 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a3c3829a-2d96-4a7e-b451-1f4537e5480c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:45.090441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3829a-2d96-4a7e-b451-1f4537e5480c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:45.098653 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd14697-e122-43ba-a795-42d2bb8d82a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:45.101243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd14697-e122-43ba-a795-42d2bb8d82a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:45.101952 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd14697-e122-43ba-a795-42d2bb8d82a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:45.102406 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd14697-e122-43ba-a795-42d2bb8d82a2 admin admin] PATH_INFO: `/v3/projects/6b46d937c1d94e2d868d6a1a3956482c` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:45.104763 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd14697-e122-43ba-a795-42d2bb8d82a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b46d937c1d94e2d868d6a1a3956482c)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:45.114646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd14697-e122-43ba-a795-42d2bb8d82a2 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:45.143575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27e19a-f48c-4147-9932-5d3b3e78a815 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:45.163110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27e19a-f48c-4147-9932-5d3b3e78a815 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:45.184478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bd0ce-2299-4f68-8b58-066b35f4eca9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:45.185295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bd0ce-2299-4f68-8b58-066b35f4eca9 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:45.185738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bd0ce-2299-4f68-8b58-066b35f4eca9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:45.186029 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bd0ce-2299-4f68-8b58-066b35f4eca9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:45.210216 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f49bd0ce-2299-4f68-8b58-066b35f4eca9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:45.383782 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bd0ce-2299-4f68-8b58-066b35f4eca9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:45.386052 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bd0ce-2299-4f68-8b58-066b35f4eca9 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:45.400254 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fcd14697-e122-43ba-a795-42d2bb8d82a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b46d937c1d94e2d868d6a1a3956482c', 'request_id': 'req-fcd14697-e122-43ba-a795-42d2bb8d82a2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:45.402046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 921/1833] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:45 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:45.426008 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fcd14697-e122-43ba-a795-42d2bb8d82a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b46d937c1d94e2d868d6a1a3956482c', 'request_id': 'req-fcd14697-e122-43ba-a795-42d2bb8d82a2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:45.470021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fcd14697-e122-43ba-a795-42d2bb8d82a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b46d937c1d94e2d868d6a1a3956482c', 'request_id': 'req-fcd14697-e122-43ba-a795-42d2bb8d82a2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:45.540332 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:45.573925 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fcd14697-e122-43ba-a795-42d2bb8d82a2 admin admin] The token cache is being invalidate because project 6b46d937c1d94e2d868d6a1a3956482c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:45.574275 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fcd14697-e122-43ba-a795-42d2bb8d82a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:45.575139 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fcd14697-e122-43ba-a795-42d2bb8d82a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:45.576982 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 913/1834] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:44 2022] DELETE /identity/v3/projects/6b46d937c1d94e2d868d6a1a3956482c => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:45.591482 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008fe7e-3e93-4bb4-904d-ee18dfd8fcde None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:45.592195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008fe7e-3e93-4bb4-904d-ee18dfd8fcde None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:45.593153 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7008fe7e-3e93-4bb4-904d-ee18dfd8fcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:45.646511 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-7008fe7e-3e93-4bb4-904d-ee18dfd8fcde None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:45.647962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7008fe7e-3e93-4bb4-904d-ee18dfd8fcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:45.757273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 922/1835] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:45.764745 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715c028-eec1-483e-b8b3-cdaef57ad071 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:45.765404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715c028-eec1-483e-b8b3-cdaef57ad071 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:45.765684 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8715c028-eec1-483e-b8b3-cdaef57ad071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:45.794922 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-8715c028-eec1-483e-b8b3-cdaef57ad071 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:45.798471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8715c028-eec1-483e-b8b3-cdaef57ad071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:45.820106 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 914/1836] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:45.824702 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008fe7e-3e93-4bb4-904d-ee18dfd8fcde None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:45.836341 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7008fe7e-3e93-4bb4-904d-ee18dfd8fcde None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:45.847378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacd45a-eb82-46f7-a6e4-e52634c4544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:45.847378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacd45a-eb82-46f7-a6e4-e52634c4544b admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:45.847378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacd45a-eb82-46f7-a6e4-e52634c4544b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:45.847378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beacd45a-eb82-46f7-a6e4-e52634c4544b admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:45.849218 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacd45a-eb82-46f7-a6e4-e52634c4544b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:45.849218 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacd45a-eb82-46f7-a6e4-e52634c4544b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:45.849218 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beacd45a-eb82-46f7-a6e4-e52634c4544b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:45.869864 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 923/1837] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:45.875021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715c028-eec1-483e-b8b3-cdaef57ad071 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:45.890166 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8715c028-eec1-483e-b8b3-cdaef57ad071 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:45.912768 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790cad3-1e45-4cee-8f9d-7ae356d7c330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:45.913926 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790cad3-1e45-4cee-8f9d-7ae356d7c330 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:45.914066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790cad3-1e45-4cee-8f9d-7ae356d7c330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:45.914429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790cad3-1e45-4cee-8f9d-7ae356d7c330 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:45.915291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790cad3-1e45-4cee-8f9d-7ae356d7c330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:45.917679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790cad3-1e45-4cee-8f9d-7ae356d7c330 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:46.071197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 915/1838] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:45 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:51:46.071819 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacd45a-eb82-46f7-a6e4-e52634c4544b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:46.109735 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beacd45a-eb82-46f7-a6e4-e52634c4544b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:46.275790 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c99590-c6e0-4b5d-914e-6caafdf18770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:46.276496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99590-c6e0-4b5d-914e-6caafdf18770 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:46.277120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99590-c6e0-4b5d-914e-6caafdf18770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:46.277407 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c99590-c6e0-4b5d-914e-6caafdf18770 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:46.278144 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c99590-c6e0-4b5d-914e-6caafdf18770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:46.280317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c99590-c6e0-4b5d-914e-6caafdf18770 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:46.408706 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:46.427996 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 924/1839] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:46 2022] POST /identity/v3/users => generated 290 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:46.431645 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790cad3-1e45-4cee-8f9d-7ae356d7c330 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:46.448137 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790cad3-1e45-4cee-8f9d-7ae356d7c330 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:46.460542 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83dcd4-d959-474c-aab0-e9be8968dfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:46.461309 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83dcd4-d959-474c-aab0-e9be8968dfc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:46.461594 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83dcd4-d959-474c-aab0-e9be8968dfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:46.461871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83dcd4-d959-474c-aab0-e9be8968dfc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:46.462605 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83dcd4-d959-474c-aab0-e9be8968dfc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:46.469405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83dcd4-d959-474c-aab0-e9be8968dfc4 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:46.500338 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 916/1840] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:46.505579 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c99590-c6e0-4b5d-914e-6caafdf18770 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:46.521911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c99590-c6e0-4b5d-914e-6caafdf18770 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:46.542736 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f55545-f4bf-47ec-b7ee-401dfaebf247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:46.543594 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f55545-f4bf-47ec-b7ee-401dfaebf247 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:46.544021 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f55545-f4bf-47ec-b7ee-401dfaebf247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:46.544436 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f55545-f4bf-47ec-b7ee-401dfaebf247 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:46.545540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f55545-f4bf-47ec-b7ee-401dfaebf247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:46.547487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f55545-f4bf-47ec-b7ee-401dfaebf247 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:46.578228 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 925/1841] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:46.579792 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83dcd4-d959-474c-aab0-e9be8968dfc4 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:46.596646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83dcd4-d959-474c-aab0-e9be8968dfc4 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:46.620621 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b631d3-ad53-4398-9e71-a676b316b70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:46.623789 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b631d3-ad53-4398-9e71-a676b316b70f admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:46.624311 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b631d3-ad53-4398-9e71-a676b316b70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:46.626159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b631d3-ad53-4398-9e71-a676b316b70f admin admin] PATH_INFO: `/v3/projects/95ae252e5e1844acbbed54a1e6717dab/users/322fb5d313534d6ea4fc6e9f43a6bd0b/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:46.648658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b631d3-ad53-4398-9e71-a676b316b70f admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ae252e5e1844acbbed54a1e6717dab, user_id=322fb5d313534d6ea4fc6e9f43a6bd0b, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:46.651158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b631d3-ad53-4398-9e71-a676b316b70f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:46.808366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 917/1842] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:46 2022] PUT /identity/v3/projects/95ae252e5e1844acbbed54a1e6717dab/users/322fb5d313534d6ea4fc6e9f43a6bd0b/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:46.822438 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b38408-9ca3-4c23-a3cd-39445484d537 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:46.822990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b38408-9ca3-4c23-a3cd-39445484d537 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:46.822990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b38408-9ca3-4c23-a3cd-39445484d537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:46.867850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-36b38408-9ca3-4c23-a3cd-39445484d537 None None] MFA Rules not processed for user `322fb5d313534d6ea4fc6e9f43a6bd0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:46.872216 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-36b38408-9ca3-4c23-a3cd-39445484d537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:46.949843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:46.989927 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 926/1843] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:46.994664 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b631d3-ad53-4398-9e71-a676b316b70f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:47.091077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b631d3-ad53-4398-9e71-a676b316b70f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:47.097179 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8c3b2-84a9-4dd3-8590-9bcf2b97b1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:47.098049 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8c3b2-84a9-4dd3-8590-9bcf2b97b1fa admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:47.098475 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8c3b2-84a9-4dd3-8590-9bcf2b97b1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:47.098975 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8c3b2-84a9-4dd3-8590-9bcf2b97b1fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:47.099825 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8c3b2-84a9-4dd3-8590-9bcf2b97b1fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:47.102300 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8c3b2-84a9-4dd3-8590-9bcf2b97b1fa admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:47.314820 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 918/1844] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:46 2022] POST /identity/v3/projects => generated 381 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:51:47.316471 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b38408-9ca3-4c23-a3cd-39445484d537 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:47.331804 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b38408-9ca3-4c23-a3cd-39445484d537 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:47.436818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d53d6f-a17a-45ce-b8ed-2d80b450839f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:47.438553 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d53d6f-a17a-45ce-b8ed-2d80b450839f admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:47.438882 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d53d6f-a17a-45ce-b8ed-2d80b450839f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:47.439231 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d53d6f-a17a-45ce-b8ed-2d80b450839f admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:47.439955 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d53d6f-a17a-45ce-b8ed-2d80b450839f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:47.441968 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d53d6f-a17a-45ce-b8ed-2d80b450839f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:47.935112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8c3b2-84a9-4dd3-8590-9bcf2b97b1fa admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:47.944553 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 927/1845] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:47 2022] POST /identity/v3/users => generated 297 bytes in 629 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:47.957135 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8c3b2-84a9-4dd3-8590-9bcf2b97b1fa admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:47.962331 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc69f55-c948-4a75-ac8a-40416077f88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:47.963016 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc69f55-c948-4a75-ac8a-40416077f88a admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:47.963299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc69f55-c948-4a75-ac8a-40416077f88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:47.963573 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc69f55-c948-4a75-ac8a-40416077f88a admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:47.964302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc69f55-c948-4a75-ac8a-40416077f88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:47.965931 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc69f55-c948-4a75-ac8a-40416077f88a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:47.978841 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 919/1846] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:47.982573 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d53d6f-a17a-45ce-b8ed-2d80b450839f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:47.993321 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d53d6f-a17a-45ce-b8ed-2d80b450839f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:47.998188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8b587-fc0a-45d5-9106-047f82f11616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:47.999103 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8b587-fc0a-45d5-9106-047f82f11616 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:47.999926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8b587-fc0a-45d5-9106-047f82f11616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:48.000253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a8b587-fc0a-45d5-9106-047f82f11616 admin admin] PATH_INFO: `/v3/projects/5587a6729f9b49b29cb61c64366ec9d5/users/17b89e92d7a24235ae9e7cb64b803c82/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:48.021799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8b587-fc0a-45d5-9106-047f82f11616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5587a6729f9b49b29cb61c64366ec9d5, user_id=17b89e92d7a24235ae9e7cb64b803c82, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:48.023050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a8b587-fc0a-45d5-9106-047f82f11616 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:48.192380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 928/1847] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:47 2022] PUT /identity/v3/projects/5587a6729f9b49b29cb61c64366ec9d5/users/17b89e92d7a24235ae9e7cb64b803c82/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:48.195029 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc69f55-c948-4a75-ac8a-40416077f88a admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:48.211550 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc69f55-c948-4a75-ac8a-40416077f88a admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:48.283799 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbb35a-bb71-4505-a356-9b6a4d4a0959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:48.284463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbb35a-bb71-4505-a356-9b6a4d4a0959 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:48.284761 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbb35a-bb71-4505-a356-9b6a4d4a0959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:48.285075 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbb35a-bb71-4505-a356-9b6a4d4a0959 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:48.286082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbb35a-bb71-4505-a356-9b6a4d4a0959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:48.305041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbb35a-bb71-4505-a356-9b6a4d4a0959 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:48.325884 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 920/1848] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:48.330207 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8b587-fc0a-45d5-9106-047f82f11616 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:48.342745 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a8b587-fc0a-45d5-9106-047f82f11616 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:48.349180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25763ef-570a-4ccf-89e0-59aa4eee521d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:48.350152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25763ef-570a-4ccf-89e0-59aa4eee521d admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:48.350595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25763ef-570a-4ccf-89e0-59aa4eee521d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:48.350881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25763ef-570a-4ccf-89e0-59aa4eee521d admin admin] PATH_INFO: `/v3/projects/5587a6729f9b49b29cb61c64366ec9d5/users/17b89e92d7a24235ae9e7cb64b803c82/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:48.353875 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25763ef-570a-4ccf-89e0-59aa4eee521d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5587a6729f9b49b29cb61c64366ec9d5, user_id=17b89e92d7a24235ae9e7cb64b803c82, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:48.357279 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25763ef-570a-4ccf-89e0-59aa4eee521d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:48.371921 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 929/1849] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:48 2022] PUT /identity/v3/projects/5587a6729f9b49b29cb61c64366ec9d5/users/17b89e92d7a24235ae9e7cb64b803c82/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:48.382919 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928e32a-5846-445b-8bf4-ff6a00d555fb None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:48.383187 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928e32a-5846-445b-8bf4-ff6a00d555fb None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:48.383488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928e32a-5846-445b-8bf4-ff6a00d555fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:48.424619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-9928e32a-5846-445b-8bf4-ff6a00d555fb None None] MFA Rules not processed for user `17b89e92d7a24235ae9e7cb64b803c82`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:48.426613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9928e32a-5846-445b-8bf4-ff6a00d555fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:48.505846 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 921/1850] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:48.695226 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25763ef-570a-4ccf-89e0-59aa4eee521d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:48.697319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b25763ef-570a-4ccf-89e0-59aa4eee521d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:48.788246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25763ef-570a-4ccf-89e0-59aa4eee521d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:48.795182 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68e3bf5-ac5a-438d-99e9-c943d95b6b1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:48.795813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e3bf5-ac5a-438d-99e9-c943d95b6b1e service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:48.796154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e3bf5-ac5a-438d-99e9-c943d95b6b1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:48.797049 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68e3bf5-ac5a-438d-99e9-c943d95b6b1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:48.811803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e3bf5-ac5a-438d-99e9-c943d95b6b1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:48.813715 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68e3bf5-ac5a-438d-99e9-c943d95b6b1e service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:48.825461 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 930/1851] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:49.555181 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928e32a-5846-445b-8bf4-ff6a00d555fb None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:49.621899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928e32a-5846-445b-8bf4-ff6a00d555fb None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:49.626965 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0b131-2edc-4a4b-a7ed-5b7434fa8f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:49.627852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0b131-2edc-4a4b-a7ed-5b7434fa8f04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:49.628164 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0b131-2edc-4a4b-a7ed-5b7434fa8f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:49.628448 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e0b131-2edc-4a4b-a7ed-5b7434fa8f04 admin admin] PATH_INFO: `/v3/users/322fb5d313534d6ea4fc6e9f43a6bd0b` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:49.629717 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0b131-2edc-4a4b-a7ed-5b7434fa8f04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=322fb5d313534d6ea4fc6e9f43a6bd0b)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:49.631761 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e0b131-2edc-4a4b-a7ed-5b7434fa8f04 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:49.934598 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d0e0b131-2edc-4a4b-a7ed-5b7434fa8f04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '322fb5d313534d6ea4fc6e9f43a6bd0b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:50.081244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d0e0b131-2edc-4a4b-a7ed-5b7434fa8f04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '322fb5d313534d6ea4fc6e9f43a6bd0b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:50.091288 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d0e0b131-2edc-4a4b-a7ed-5b7434fa8f04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '322fb5d313534d6ea4fc6e9f43a6bd0b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:50.094593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d0e0b131-2edc-4a4b-a7ed-5b7434fa8f04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '322fb5d313534d6ea4fc6e9f43a6bd0b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:50.126283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d0e0b131-2edc-4a4b-a7ed-5b7434fa8f04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '322fb5d313534d6ea4fc6e9f43a6bd0b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:50.142835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 922/1852] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:49 2022] DELETE /identity/v3/users/322fb5d313534d6ea4fc6e9f43a6bd0b => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:50.147751 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d11b7-eece-45a0-aa6c-329ab83f2198 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:50.148742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d11b7-eece-45a0-aa6c-329ab83f2198 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:50.149277 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d11b7-eece-45a0-aa6c-329ab83f2198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:50.183388 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e95d11b7-eece-45a0-aa6c-329ab83f2198 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:50.185413 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e95d11b7-eece-45a0-aa6c-329ab83f2198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:50.203560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:50.295023 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 931/1853] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:50.336497 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0b131-2edc-4a4b-a7ed-5b7434fa8f04 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:50.336497 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d0e0b131-2edc-4a4b-a7ed-5b7434fa8f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:50.433868 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:50.453201 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e0b131-2edc-4a4b-a7ed-5b7434fa8f04 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:50.462693 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70fcf1-f684-4730-919d-01665a99e185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:50.462693 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70fcf1-f684-4730-919d-01665a99e185 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:50.462693 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70fcf1-f684-4730-919d-01665a99e185 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:50.462693 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70fcf1-f684-4730-919d-01665a99e185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:50.473187 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70fcf1-f684-4730-919d-01665a99e185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:50.474954 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70fcf1-f684-4730-919d-01665a99e185 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:50.488919 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 923/1854] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:51.166014 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:51.377622 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d11b7-eece-45a0-aa6c-329ab83f2198 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:51.379016 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e95d11b7-eece-45a0-aa6c-329ab83f2198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:51.396184 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95d11b7-eece-45a0-aa6c-329ab83f2198 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:51.403358 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712edf4-6f8d-46c4-a5b4-fa269af3b88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:51.404471 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712edf4-6f8d-46c4-a5b4-fa269af3b88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:51.404957 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712edf4-6f8d-46c4-a5b4-fa269af3b88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:51.405450 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9712edf4-6f8d-46c4-a5b4-fa269af3b88d admin admin] PATH_INFO: `/v3/projects/95ae252e5e1844acbbed54a1e6717dab` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:51.408273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712edf4-6f8d-46c4-a5b4-fa269af3b88d admin admin] RBAC: Authorizing `identity:delete_project(project_id=95ae252e5e1844acbbed54a1e6717dab)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:51.410836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9712edf4-6f8d-46c4-a5b4-fa269af3b88d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:51.566137 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9712edf4-6f8d-46c4-a5b4-fa269af3b88d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95ae252e5e1844acbbed54a1e6717dab', 'request_id': 'req-9712edf4-6f8d-46c4-a5b4-fa269af3b88d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:51.573657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9712edf4-6f8d-46c4-a5b4-fa269af3b88d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95ae252e5e1844acbbed54a1e6717dab', 'request_id': 'req-9712edf4-6f8d-46c4-a5b4-fa269af3b88d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:51.588257 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9712edf4-6f8d-46c4-a5b4-fa269af3b88d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95ae252e5e1844acbbed54a1e6717dab', 'request_id': 'req-9712edf4-6f8d-46c4-a5b4-fa269af3b88d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:51.700092 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f891b5-5d86-4425-ab4a-061ddc6c563e None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:51.700602 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f891b5-5d86-4425-ab4a-061ddc6c563e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:51.700683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f891b5-5d86-4425-ab4a-061ddc6c563e None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:51.702120 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 924/1855] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 16:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:51:51.717159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba614e-9684-4b31-b163-991b13f04a68 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:51.717793 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba614e-9684-4b31-b163-991b13f04a68 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:51.718929 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bba614e-9684-4b31-b163-991b13f04a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:51.781291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-9bba614e-9684-4b31-b163-991b13f04a68 None None] MFA Rules not processed for user `381cf4381ce64379b285d75e2909813d`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:51.788351 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9bba614e-9684-4b31-b163-991b13f04a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:51.838944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9712edf4-6f8d-46c4-a5b4-fa269af3b88d admin admin] The token cache is being invalidate because project 95ae252e5e1844acbbed54a1e6717dab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:51.839307 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9712edf4-6f8d-46c4-a5b4-fa269af3b88d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:51.840094 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9712edf4-6f8d-46c4-a5b4-fa269af3b88d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:51.844674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 932/1856] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:51 2022] DELETE /identity/v3/projects/95ae252e5e1844acbbed54a1e6717dab => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:51.849330 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712edf4-6f8d-46c4-a5b4-fa269af3b88d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:51.854757 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9712edf4-6f8d-46c4-a5b4-fa269af3b88d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:51.925687 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 925/1857] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 16:51:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:51.975610 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9712edf4-6f8d-46c4-a5b4-fa269af3b88d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:51.990554 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e29e2f-d0a7-437b-b673-8c001951660d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:51.990554 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e29e2f-d0a7-437b-b673-8c001951660d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:51.990554 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e29e2f-d0a7-437b-b673-8c001951660d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:51.990554 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e29e2f-d0a7-437b-b673-8c001951660d admin admin] PATH_INFO: `/v3/users/17b89e92d7a24235ae9e7cb64b803c82` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:51.990991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e29e2f-d0a7-437b-b673-8c001951660d admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b89e92d7a24235ae9e7cb64b803c82)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:51.990991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e29e2f-d0a7-437b-b673-8c001951660d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:51.991838 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba614e-9684-4b31-b163-991b13f04a68 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:51.993775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9bba614e-9684-4b31-b163-991b13f04a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:52.011244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bba614e-9684-4b31-b163-991b13f04a68 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:52.020986 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c6ac9-2f09-42b7-8096-22e25a1b2285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:52.021978 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c6ac9-2f09-42b7-8096-22e25a1b2285 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:52.022540 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c6ac9-2f09-42b7-8096-22e25a1b2285 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:52.022812 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c6ac9-2f09-42b7-8096-22e25a1b2285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:52.034209 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c6ac9-2f09-42b7-8096-22e25a1b2285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:52.036027 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c6ac9-2f09-42b7-8096-22e25a1b2285 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:52.059837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 926/1858] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:51:52.276806 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-90e29e2f-d0a7-437b-b673-8c001951660d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b89e92d7a24235ae9e7cb64b803c82'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:52.317604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c6ac9-2f09-42b7-8096-22e25a1b2285 service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:52.319418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7d4c6ac9-2f09-42b7-8096-22e25a1b2285 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:52.342497 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c6ac9-2f09-42b7-8096-22e25a1b2285 service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:52.349543 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7903a8-5d72-49bb-9993-631ae2173e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:52.350351 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7903a8-5d72-49bb-9993-631ae2173e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:52.350641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7903a8-5d72-49bb-9993-631ae2173e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:52.350922 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7903a8-5d72-49bb-9993-631ae2173e5a admin admin] PATH_INFO: `/v3/users/cc9698a3f3bd43718b676418d608ff17` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:52.352199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7903a8-5d72-49bb-9993-631ae2173e5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc9698a3f3bd43718b676418d608ff17)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:52.355115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7903a8-5d72-49bb-9993-631ae2173e5a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:52.390667 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-90e29e2f-d0a7-437b-b673-8c001951660d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b89e92d7a24235ae9e7cb64b803c82'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:52.402469 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-90e29e2f-d0a7-437b-b673-8c001951660d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b89e92d7a24235ae9e7cb64b803c82'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:52.403232 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-90e29e2f-d0a7-437b-b673-8c001951660d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b89e92d7a24235ae9e7cb64b803c82'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:52.416250 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-90e29e2f-d0a7-437b-b673-8c001951660d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b89e92d7a24235ae9e7cb64b803c82'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:52.423718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 933/1859] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:51 2022] DELETE /identity/v3/users/17b89e92d7a24235ae9e7cb64b803c82 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:52.536612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:52.642282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7a7903a8-5d72-49bb-9993-631ae2173e5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc9698a3f3bd43718b676418d608ff17'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:53.856149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7a7903a8-5d72-49bb-9993-631ae2173e5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc9698a3f3bd43718b676418d608ff17'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:53.865708 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7a7903a8-5d72-49bb-9993-631ae2173e5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc9698a3f3bd43718b676418d608ff17'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:53.866479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7a7903a8-5d72-49bb-9993-631ae2173e5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc9698a3f3bd43718b676418d608ff17'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:53.873056 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e29e2f-d0a7-437b-b673-8c001951660d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:53.878590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-90e29e2f-d0a7-437b-b673-8c001951660d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:53.882436 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7a7903a8-5d72-49bb-9993-631ae2173e5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc9698a3f3bd43718b676418d608ff17'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:53.891269 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 927/1860] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:52 2022] DELETE /identity/v3/users/cc9698a3f3bd43718b676418d608ff17 => generated 0 bytes in 1574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:53.895980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e384f-26ae-4ab5-aef0-14046d702096 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:53.896428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e384f-26ae-4ab5-aef0-14046d702096 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:53.896720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e384f-26ae-4ab5-aef0-14046d702096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:53.947444 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-560e384f-26ae-4ab5-aef0-14046d702096 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:53.950719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-560e384f-26ae-4ab5-aef0-14046d702096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:54.049526 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e29e2f-d0a7-437b-b673-8c001951660d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:54.145682 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 928/1861] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:54.173127 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e384f-26ae-4ab5-aef0-14046d702096 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:54.174648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-560e384f-26ae-4ab5-aef0-14046d702096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:54.236845 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86c3605-40ba-44d0-ba50-3f7c13d1fa9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:54.238114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c3605-40ba-44d0-ba50-3f7c13d1fa9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:54.238564 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c3605-40ba-44d0-ba50-3f7c13d1fa9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:54.239014 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c3605-40ba-44d0-ba50-3f7c13d1fa9d admin admin] PATH_INFO: `/v3/projects/5587a6729f9b49b29cb61c64366ec9d5` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:54.242869 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c3605-40ba-44d0-ba50-3f7c13d1fa9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5587a6729f9b49b29cb61c64366ec9d5)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:54.244882 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86c3605-40ba-44d0-ba50-3f7c13d1fa9d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:54.320185 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e384f-26ae-4ab5-aef0-14046d702096 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:54.320185 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90270e6-9462-4480-95ac-e432767fca74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:54.320185 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90270e6-9462-4480-95ac-e432767fca74 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:54.320185 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90270e6-9462-4480-95ac-e432767fca74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:54.320537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90270e6-9462-4480-95ac-e432767fca74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:54.330441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90270e6-9462-4480-95ac-e432767fca74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:54.331911 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90270e6-9462-4480-95ac-e432767fca74 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:54.343215 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 929/1862] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:54.464740 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f86c3605-40ba-44d0-ba50-3f7c13d1fa9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5587a6729f9b49b29cb61c64366ec9d5', 'request_id': 'req-f86c3605-40ba-44d0-ba50-3f7c13d1fa9d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:54.475200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f86c3605-40ba-44d0-ba50-3f7c13d1fa9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5587a6729f9b49b29cb61c64366ec9d5', 'request_id': 'req-f86c3605-40ba-44d0-ba50-3f7c13d1fa9d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:54.510238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f86c3605-40ba-44d0-ba50-3f7c13d1fa9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5587a6729f9b49b29cb61c64366ec9d5', 'request_id': 'req-f86c3605-40ba-44d0-ba50-3f7c13d1fa9d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:54.611100 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f86c3605-40ba-44d0-ba50-3f7c13d1fa9d admin admin] The token cache is being invalidate because project 5587a6729f9b49b29cb61c64366ec9d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:54.611395 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f86c3605-40ba-44d0-ba50-3f7c13d1fa9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:54.614903 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f86c3605-40ba-44d0-ba50-3f7c13d1fa9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:54.617242 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 934/1863] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:53 2022] DELETE /identity/v3/projects/5587a6729f9b49b29cb61c64366ec9d5 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:54.622607 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c6617-c6da-4051-b0db-4bb28e223157 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:54.622900 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c6617-c6da-4051-b0db-4bb28e223157 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:54.623269 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c6617-c6da-4051-b0db-4bb28e223157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:54.654497 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-829c6617-c6da-4051-b0db-4bb28e223157 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:54.656269 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-829c6617-c6da-4051-b0db-4bb28e223157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:54.767225 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 930/1864] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:54.775320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d32c9-f8de-4e3b-b35d-dfb41aaa0af3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:54.775612 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d32c9-f8de-4e3b-b35d-dfb41aaa0af3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:54.775895 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d32c9-f8de-4e3b-b35d-dfb41aaa0af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:54.798391 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0b0d32c9-f8de-4e3b-b35d-dfb41aaa0af3 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:54.799635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0b0d32c9-f8de-4e3b-b35d-dfb41aaa0af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:54.811787 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 935/1865] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:54.814704 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c6617-c6da-4051-b0db-4bb28e223157 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:54.830040 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c6617-c6da-4051-b0db-4bb28e223157 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:54.835210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca3602-1f3a-46e7-a2c6-8f580933d4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:54.835901 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca3602-1f3a-46e7-a2c6-8f580933d4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:54.836335 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca3602-1f3a-46e7-a2c6-8f580933d4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:54.836619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecca3602-1f3a-46e7-a2c6-8f580933d4b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:54.837447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca3602-1f3a-46e7-a2c6-8f580933d4b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:54.837825 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca3602-1f3a-46e7-a2c6-8f580933d4b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:54.839375 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecca3602-1f3a-46e7-a2c6-8f580933d4b9 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:54.856977 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 931/1866] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:54.858132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d32c9-f8de-4e3b-b35d-dfb41aaa0af3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:54.868976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d32c9-f8de-4e3b-b35d-dfb41aaa0af3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:54.873559 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378845fb-cbd5-46ae-8217-ea3937c6970f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:54.874223 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378845fb-cbd5-46ae-8217-ea3937c6970f admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:54.875154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378845fb-cbd5-46ae-8217-ea3937c6970f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:54.875435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378845fb-cbd5-46ae-8217-ea3937c6970f admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:54.876148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378845fb-cbd5-46ae-8217-ea3937c6970f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:54.878131 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378845fb-cbd5-46ae-8217-ea3937c6970f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:55.005406 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 936/1867] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:54 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:51:55.009849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca3602-1f3a-46e7-a2c6-8f580933d4b9 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:55.020187 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecca3602-1f3a-46e7-a2c6-8f580933d4b9 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:55.033318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378845fb-cbd5-46ae-8217-ea3937c6970f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:55.035127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-378845fb-cbd5-46ae-8217-ea3937c6970f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:55.082190 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d1a8d-d7d8-49a2-bc77-dc8929b0e498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:55.082889 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d1a8d-d7d8-49a2-bc77-dc8929b0e498 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:55.083180 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d1a8d-d7d8-49a2-bc77-dc8929b0e498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:55.083459 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d1a8d-d7d8-49a2-bc77-dc8929b0e498 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:55.084312 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d1a8d-d7d8-49a2-bc77-dc8929b0e498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:55.086385 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d1a8d-d7d8-49a2-bc77-dc8929b0e498 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:55.105362 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378845fb-cbd5-46ae-8217-ea3937c6970f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:55.110742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e531d-1c8e-4bb7-ad41-ab7d3c23268e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:55.111653 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e531d-1c8e-4bb7-ad41-ab7d3c23268e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:55.111933 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e531d-1c8e-4bb7-ad41-ab7d3c23268e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:55.112239 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e531d-1c8e-4bb7-ad41-ab7d3c23268e admin admin] PATH_INFO: `/v3/projects/474715b3e30749a7973b5df338806d3f` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:55.113479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e531d-1c8e-4bb7-ad41-ab7d3c23268e admin admin] RBAC: Authorizing `identity:delete_project(project_id=474715b3e30749a7973b5df338806d3f)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:55.115460 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e531d-1c8e-4bb7-ad41-ab7d3c23268e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:55.166006 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 932/1868] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:55 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:55.167256 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d1a8d-d7d8-49a2-bc77-dc8929b0e498 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:55.178526 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d1a8d-d7d8-49a2-bc77-dc8929b0e498 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:55.183407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a0acd-530e-40c3-ab48-7e2cbb5b0881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:55.183955 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a0acd-530e-40c3-ab48-7e2cbb5b0881 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:55.184262 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a0acd-530e-40c3-ab48-7e2cbb5b0881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:55.184540 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2a0acd-530e-40c3-ab48-7e2cbb5b0881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:55.185316 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a0acd-530e-40c3-ab48-7e2cbb5b0881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:55.187596 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2a0acd-530e-40c3-ab48-7e2cbb5b0881 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:55.198418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 933/1869] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:51:55.202325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a0acd-530e-40c3-ab48-7e2cbb5b0881 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:55.212273 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2a0acd-530e-40c3-ab48-7e2cbb5b0881 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:55.216893 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff44aa3-9a66-4bf0-a945-9d024e69e08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:55.217636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff44aa3-9a66-4bf0-a945-9d024e69e08d admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:55.217927 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff44aa3-9a66-4bf0-a945-9d024e69e08d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:55.218290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff44aa3-9a66-4bf0-a945-9d024e69e08d admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:55.219037 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff44aa3-9a66-4bf0-a945-9d024e69e08d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:55.220624 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff44aa3-9a66-4bf0-a945-9d024e69e08d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:55.231508 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 934/1870] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:51:55.236163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff44aa3-9a66-4bf0-a945-9d024e69e08d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:55.246122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff44aa3-9a66-4bf0-a945-9d024e69e08d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:55.257757 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-921e531d-1c8e-4bb7-ad41-ab7d3c23268e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '474715b3e30749a7973b5df338806d3f', 'request_id': 'req-921e531d-1c8e-4bb7-ad41-ab7d3c23268e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.263924 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-921e531d-1c8e-4bb7-ad41-ab7d3c23268e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '474715b3e30749a7973b5df338806d3f', 'request_id': 'req-921e531d-1c8e-4bb7-ad41-ab7d3c23268e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.268608 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:55.272128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-921e531d-1c8e-4bb7-ad41-ab7d3c23268e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '474715b3e30749a7973b5df338806d3f', 'request_id': 'req-921e531d-1c8e-4bb7-ad41-ab7d3c23268e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.303616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a8f99-91c6-42b5-b766-07c3e0366717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:55.304528 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a8f99-91c6-42b5-b766-07c3e0366717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:55.304824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a8f99-91c6-42b5-b766-07c3e0366717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:55.305150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a8f99-91c6-42b5-b766-07c3e0366717 admin admin] PATH_INFO: `/v3/projects/ad3604d129e4415ebfc1cf7dfb840b4f/users/b9a19177208648c9979b870b0d2438bd/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:55.319921 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a8f99-91c6-42b5-b766-07c3e0366717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad3604d129e4415ebfc1cf7dfb840b4f, user_id=b9a19177208648c9979b870b0d2438bd, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:55.322736 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a8f99-91c6-42b5-b766-07c3e0366717 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:55.358609 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-921e531d-1c8e-4bb7-ad41-ab7d3c23268e admin admin] The token cache is being invalidate because project 474715b3e30749a7973b5df338806d3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:55.358941 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-921e531d-1c8e-4bb7-ad41-ab7d3c23268e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.360296 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-921e531d-1c8e-4bb7-ad41-ab7d3c23268e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.362034 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 937/1871] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:55 2022] DELETE /identity/v3/projects/474715b3e30749a7973b5df338806d3f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:55.366318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e531d-1c8e-4bb7-ad41-ab7d3c23268e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:55.367531 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-921e531d-1c8e-4bb7-ad41-ab7d3c23268e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:55.380513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e531d-1c8e-4bb7-ad41-ab7d3c23268e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:55.386499 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439aa7d-bfee-4e6a-b605-e0d05894ed6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:55.387379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439aa7d-bfee-4e6a-b605-e0d05894ed6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:55.387666 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439aa7d-bfee-4e6a-b605-e0d05894ed6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:55.387943 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5439aa7d-bfee-4e6a-b605-e0d05894ed6c admin admin] PATH_INFO: `/v3/users/ee166146ca294e708b938ed1cc629d09` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:55.389334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439aa7d-bfee-4e6a-b605-e0d05894ed6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee166146ca294e708b938ed1cc629d09)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:55.391338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5439aa7d-bfee-4e6a-b605-e0d05894ed6c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:55.482719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 935/1872] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:55 2022] PUT /identity/v3/projects/ad3604d129e4415ebfc1cf7dfb840b4f/users/b9a19177208648c9979b870b0d2438bd/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:55.494874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26a436-6fe1-43f9-94e4-7236feb22f4e None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:55.495152 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26a436-6fe1-43f9-94e4-7236feb22f4e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:55.495441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26a436-6fe1-43f9-94e4-7236feb22f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:55.523065 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-7a26a436-6fe1-43f9-94e4-7236feb22f4e None None] MFA Rules not processed for user `b9a19177208648c9979b870b0d2438bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:55.524529 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7a26a436-6fe1-43f9-94e4-7236feb22f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:55.606292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 936/1873] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:55.619152 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26a436-6fe1-43f9-94e4-7236feb22f4e None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:55.619152 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7a26a436-6fe1-43f9-94e4-7236feb22f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:55.699950 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26a436-6fe1-43f9-94e4-7236feb22f4e None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:55.706578 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acc60f-b265-49da-8859-1aa53a7755e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:55.707419 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acc60f-b265-49da-8859-1aa53a7755e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:55.707714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acc60f-b265-49da-8859-1aa53a7755e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:55.707996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acc60f-b265-49da-8859-1aa53a7755e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:55.709931 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acc60f-b265-49da-8859-1aa53a7755e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:55.711904 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acc60f-b265-49da-8859-1aa53a7755e7 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:55.714919 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5439aa7d-bfee-4e6a-b605-e0d05894ed6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee166146ca294e708b938ed1cc629d09'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.821917 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5439aa7d-bfee-4e6a-b605-e0d05894ed6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee166146ca294e708b938ed1cc629d09'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.830938 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5439aa7d-bfee-4e6a-b605-e0d05894ed6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee166146ca294e708b938ed1cc629d09'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.834341 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5439aa7d-bfee-4e6a-b605-e0d05894ed6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee166146ca294e708b938ed1cc629d09'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.841219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 937/1874] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:55 2022] POST /identity/v3/projects => generated 385 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:51:55.846005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acc60f-b265-49da-8859-1aa53a7755e7 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:55.848241 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-39acc60f-b265-49da-8859-1aa53a7755e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:55.853066 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5439aa7d-bfee-4e6a-b605-e0d05894ed6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee166146ca294e708b938ed1cc629d09'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:55.861518 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 938/1875] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:51:55 2022] DELETE /identity/v3/users/ee166146ca294e708b938ed1cc629d09 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:55.981192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acc60f-b265-49da-8859-1aa53a7755e7 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:56.048753 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18515eed-68c1-4ed4-b854-ad5ee4ed938e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:56.049484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18515eed-68c1-4ed4-b854-ad5ee4ed938e admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:56.049765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18515eed-68c1-4ed4-b854-ad5ee4ed938e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:56.050039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18515eed-68c1-4ed4-b854-ad5ee4ed938e admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:56.050748 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18515eed-68c1-4ed4-b854-ad5ee4ed938e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:56.052702 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18515eed-68c1-4ed4-b854-ad5ee4ed938e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:56.162336 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 938/1876] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:55 2022] POST /identity/v3/users => generated 299 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:51:56.164111 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439aa7d-bfee-4e6a-b605-e0d05894ed6c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:56.177591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5439aa7d-bfee-4e6a-b605-e0d05894ed6c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:56.184293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8761b20-3303-480d-97bd-70037634af99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:56.184987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8761b20-3303-480d-97bd-70037634af99 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:56.185325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8761b20-3303-480d-97bd-70037634af99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:56.185607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8761b20-3303-480d-97bd-70037634af99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:56.186391 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8761b20-3303-480d-97bd-70037634af99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:56.188947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8761b20-3303-480d-97bd-70037634af99 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:56.199558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 939/1877] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:56.204446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18515eed-68c1-4ed4-b854-ad5ee4ed938e admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:56.214680 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18515eed-68c1-4ed4-b854-ad5ee4ed938e admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:56.219742 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e19c84-1337-4bf9-8bac-e22ce157aa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:56.220648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e19c84-1337-4bf9-8bac-e22ce157aa65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:56.220939 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e19c84-1337-4bf9-8bac-e22ce157aa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:56.221251 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e19c84-1337-4bf9-8bac-e22ce157aa65 admin admin] PATH_INFO: `/v3/projects/6284aeb239e5449cb822bf0c3fecaa1b/users/802a2b8f19364b5a9c8d03a639618114/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:56.236989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e19c84-1337-4bf9-8bac-e22ce157aa65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6284aeb239e5449cb822bf0c3fecaa1b, user_id=802a2b8f19364b5a9c8d03a639618114, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:56.240040 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e19c84-1337-4bf9-8bac-e22ce157aa65 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:56.265755 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:56.359472 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 939/1878] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:56 2022] PUT /identity/v3/projects/6284aeb239e5449cb822bf0c3fecaa1b/users/802a2b8f19364b5a9c8d03a639618114/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:56.363627 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8761b20-3303-480d-97bd-70037634af99 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:56.373675 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8761b20-3303-480d-97bd-70037634af99 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:56.391066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e19c84-1337-4bf9-8bac-e22ce157aa65 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:56.395556 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c9e19c84-1337-4bf9-8bac-e22ce157aa65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:56.449938 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8ba73-17d4-404b-8c54-529d6ff1d8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:56.450641 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8ba73-17d4-404b-8c54-529d6ff1d8c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:56.450937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8ba73-17d4-404b-8c54-529d6ff1d8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:56.451222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8ba73-17d4-404b-8c54-529d6ff1d8c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:56.451968 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8ba73-17d4-404b-8c54-529d6ff1d8c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:56.453867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8ba73-17d4-404b-8c54-529d6ff1d8c5 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:56.464175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 940/1879] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:56 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:56.468398 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8ba73-17d4-404b-8c54-529d6ff1d8c5 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:56.480692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8ba73-17d4-404b-8c54-529d6ff1d8c5 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:56.485738 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e19c84-1337-4bf9-8bac-e22ce157aa65 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:56.486538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92faefb4-6cb0-43e8-a6cc-85192ffab24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:56.487446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faefb4-6cb0-43e8-a6cc-85192ffab24a admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:56.487738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faefb4-6cb0-43e8-a6cc-85192ffab24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:56.488016 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92faefb4-6cb0-43e8-a6cc-85192ffab24a admin admin] PATH_INFO: `/v3/projects/6284aeb239e5449cb822bf0c3fecaa1b/users/802a2b8f19364b5a9c8d03a639618114/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:56.490021 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92faefb4-6cb0-43e8-a6cc-85192ffab24a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6284aeb239e5449cb822bf0c3fecaa1b, user_id=802a2b8f19364b5a9c8d03a639618114, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:56.490756 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541bb1d0-f7cc-4716-b556-79303e7a3931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:56.491745 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bb1d0-f7cc-4716-b556-79303e7a3931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:56.492030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bb1d0-f7cc-4716-b556-79303e7a3931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:56.492303 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541bb1d0-f7cc-4716-b556-79303e7a3931 admin admin] PATH_INFO: `/v3/projects/cc1f4361751348a69eb39f0b89814c08` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:56.492770 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92faefb4-6cb0-43e8-a6cc-85192ffab24a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:56.493550 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bb1d0-f7cc-4716-b556-79303e7a3931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc1f4361751348a69eb39f0b89814c08)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:56.495534 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541bb1d0-f7cc-4716-b556-79303e7a3931 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:56.505895 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 941/1880] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:56 2022] PUT /identity/v3/projects/6284aeb239e5449cb822bf0c3fecaa1b/users/802a2b8f19364b5a9c8d03a639618114/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:56.517147 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebc58b-268b-4a65-861e-a005d1cae39a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:56.517461 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebc58b-268b-4a65-861e-a005d1cae39a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:56.519879 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ebc58b-268b-4a65-861e-a005d1cae39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:56.540106 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:56.544932 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-16ebc58b-268b-4a65-861e-a005d1cae39a None None] MFA Rules not processed for user `802a2b8f19364b5a9c8d03a639618114`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:56.546229 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-16ebc58b-268b-4a65-861e-a005d1cae39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:56.615364 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 942/1881] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:56.627057 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebc58b-268b-4a65-861e-a005d1cae39a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:56.628826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-16ebc58b-268b-4a65-861e-a005d1cae39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:56.643261 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-541bb1d0-f7cc-4716-b556-79303e7a3931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc1f4361751348a69eb39f0b89814c08', 'request_id': 'req-541bb1d0-f7cc-4716-b556-79303e7a3931'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:56.648968 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-541bb1d0-f7cc-4716-b556-79303e7a3931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc1f4361751348a69eb39f0b89814c08', 'request_id': 'req-541bb1d0-f7cc-4716-b556-79303e7a3931'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:56.655398 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-541bb1d0-f7cc-4716-b556-79303e7a3931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc1f4361751348a69eb39f0b89814c08', 'request_id': 'req-541bb1d0-f7cc-4716-b556-79303e7a3931'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:56.687406 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ebc58b-268b-4a65-861e-a005d1cae39a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:56.740215 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee90c2-c4c1-4011-9250-3adfb5e4f43b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:56.740878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee90c2-c4c1-4011-9250-3adfb5e4f43b service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:56.741268 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee90c2-c4c1-4011-9250-3adfb5e4f43b service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:56.741623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee90c2-c4c1-4011-9250-3adfb5e4f43b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:56.743519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b3ee90c2-c4c1-4011-9250-3adfb5e4f43b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:56.822749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-541bb1d0-f7cc-4716-b556-79303e7a3931 admin admin] The token cache is being invalidate because project cc1f4361751348a69eb39f0b89814c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:51:56.823148 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-541bb1d0-f7cc-4716-b556-79303e7a3931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:56.824734 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-541bb1d0-f7cc-4716-b556-79303e7a3931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:51:56.827651 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 940/1882] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:51:56 2022] DELETE /identity/v3/projects/cc1f4361751348a69eb39f0b89814c08 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:51:56.832975 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fd4b5-fea4-4ad9-9212-450cffcbfbc7 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:56.833376 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fd4b5-fea4-4ad9-9212-450cffcbfbc7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:56.833733 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fd4b5-fea4-4ad9-9212-450cffcbfbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:56.833865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee90c2-c4c1-4011-9250-3adfb5e4f43b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:56.835754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ee90c2-c4c1-4011-9250-3adfb5e4f43b service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:56.861136 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-644fd4b5-fea4-4ad9-9212-450cffcbfbc7 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:56.862503 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-644fd4b5-fea4-4ad9-9212-450cffcbfbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:56.869196 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 943/1883] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:51:56.946320 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 941/1884] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:51:56.952495 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6acdbb-3be6-457d-9691-23ed1d3f35a9 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:56.952495 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6acdbb-3be6-457d-9691-23ed1d3f35a9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:56.952495 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6acdbb-3be6-457d-9691-23ed1d3f35a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:56.968841 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ae6acdbb-3be6-457d-9691-23ed1d3f35a9 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:56.970191 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ae6acdbb-3be6-457d-9691-23ed1d3f35a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:56.981510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 944/1885] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:56.989887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fd4b5-fea4-4ad9-9212-450cffcbfbc7 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:57.001373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fd4b5-fea4-4ad9-9212-450cffcbfbc7 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:57.006198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d6ebe-0437-4cfe-97af-77d494f294ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:57.006883 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d6ebe-0437-4cfe-97af-77d494f294ad admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:57.007166 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d6ebe-0437-4cfe-97af-77d494f294ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:57.007443 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d6ebe-0437-4cfe-97af-77d494f294ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:57.008213 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d6ebe-0437-4cfe-97af-77d494f294ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:51:57.008559 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d6ebe-0437-4cfe-97af-77d494f294ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:57.010239 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d6ebe-0437-4cfe-97af-77d494f294ad admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:57.024196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 942/1886] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:51:57.029979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6acdbb-3be6-457d-9691-23ed1d3f35a9 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:57.040221 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6acdbb-3be6-457d-9691-23ed1d3f35a9 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:57.046163 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc1bbc-3748-4911-a37c-b6b74d4b6c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:57.047349 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc1bbc-3748-4911-a37c-b6b74d4b6c13 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:57.047747 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc1bbc-3748-4911-a37c-b6b74d4b6c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:57.048117 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc1bbc-3748-4911-a37c-b6b74d4b6c13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:57.048916 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc1bbc-3748-4911-a37c-b6b74d4b6c13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:57.051193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc1bbc-3748-4911-a37c-b6b74d4b6c13 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:57.184218 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 945/1887] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:57 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:57.189034 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d6ebe-0437-4cfe-97af-77d494f294ad admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:57.199280 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d6ebe-0437-4cfe-97af-77d494f294ad admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:57.261910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f51d5-a637-487b-a91b-3f250b1aa25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:57.262599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f51d5-a637-487b-a91b-3f250b1aa25c admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:57.262882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f51d5-a637-487b-a91b-3f250b1aa25c admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:57.263191 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14f51d5-a637-487b-a91b-3f250b1aa25c admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:57.263903 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f51d5-a637-487b-a91b-3f250b1aa25c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:57.266185 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14f51d5-a637-487b-a91b-3f250b1aa25c admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:57.368445 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 943/1888] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:57 2022] POST /identity/v3/users => generated 291 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:57.372567 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc1bbc-3748-4911-a37c-b6b74d4b6c13 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:57.383809 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc1bbc-3748-4911-a37c-b6b74d4b6c13 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:57.388406 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c94c7-983d-491f-9f4a-08bda11f802e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:57.389186 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c94c7-983d-491f-9f4a-08bda11f802e admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:57.389403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c94c7-983d-491f-9f4a-08bda11f802e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:57.389687 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43c94c7-983d-491f-9f4a-08bda11f802e admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:57.390588 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c94c7-983d-491f-9f4a-08bda11f802e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:57.392201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43c94c7-983d-491f-9f4a-08bda11f802e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:57.402257 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 946/1889] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:57.406996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f51d5-a637-487b-a91b-3f250b1aa25c admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:57.417068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14f51d5-a637-487b-a91b-3f250b1aa25c admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:57.422555 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80dc90-52f5-4e28-b748-26093e7c970e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:57.423220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80dc90-52f5-4e28-b748-26093e7c970e admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:57.423504 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80dc90-52f5-4e28-b748-26093e7c970e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:57.423783 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80dc90-52f5-4e28-b748-26093e7c970e admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:57.424505 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80dc90-52f5-4e28-b748-26093e7c970e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:57.426130 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80dc90-52f5-4e28-b748-26093e7c970e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:57.436060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 944/1890] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:51:57.441446 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c94c7-983d-491f-9f4a-08bda11f802e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:57.451488 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43c94c7-983d-491f-9f4a-08bda11f802e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:57.456497 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75b099-7dfb-40c2-981a-7dca2d00108c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:57.457707 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75b099-7dfb-40c2-981a-7dca2d00108c admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:57.457991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75b099-7dfb-40c2-981a-7dca2d00108c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:57.458298 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75b099-7dfb-40c2-981a-7dca2d00108c admin admin] PATH_INFO: `/v3/projects/2474d597bf7148a3a6d08d102aa26e30/users/e69486f8ef5844b7bea76332e798b515/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:57.474010 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75b099-7dfb-40c2-981a-7dca2d00108c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2474d597bf7148a3a6d08d102aa26e30, user_id=e69486f8ef5844b7bea76332e798b515, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:57.476729 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75b099-7dfb-40c2-981a-7dca2d00108c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:57.598889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 947/1891] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:57 2022] PUT /identity/v3/projects/2474d597bf7148a3a6d08d102aa26e30/users/e69486f8ef5844b7bea76332e798b515/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:57.611300 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f503ab7-7a1f-49a7-bbae-3f66a65d61f0 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:57.611706 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f503ab7-7a1f-49a7-bbae-3f66a65d61f0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:57.612171 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f503ab7-7a1f-49a7-bbae-3f66a65d61f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:57.639260 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-3f503ab7-7a1f-49a7-bbae-3f66a65d61f0 None None] MFA Rules not processed for user `e69486f8ef5844b7bea76332e798b515`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:57.640626 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3f503ab7-7a1f-49a7-bbae-3f66a65d61f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:57.706863 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 945/1892] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:57.711393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75b099-7dfb-40c2-981a-7dca2d00108c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:57.783540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75b099-7dfb-40c2-981a-7dca2d00108c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:57.788562 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ba5ec-f45c-487f-8de2-d4b2aec23c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:57.789333 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ba5ec-f45c-487f-8de2-d4b2aec23c70 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:57.789646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ba5ec-f45c-487f-8de2-d4b2aec23c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:57.789924 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ba5ec-f45c-487f-8de2-d4b2aec23c70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:57.790618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ba5ec-f45c-487f-8de2-d4b2aec23c70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:57.792651 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ba5ec-f45c-487f-8de2-d4b2aec23c70 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:57.914265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 948/1893] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:51:57 2022] POST /identity/v3/projects => generated 379 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:57.918074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f503ab7-7a1f-49a7-bbae-3f66a65d61f0 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:57.929886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f503ab7-7a1f-49a7-bbae-3f66a65d61f0 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:57.936279 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:57.989916 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4379e4-84fa-4b65-a9ae-7577fb42990d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:57.990652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4379e4-84fa-4b65-a9ae-7577fb42990d admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:57.995122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4379e4-84fa-4b65-a9ae-7577fb42990d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:57.995122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4379e4-84fa-4b65-a9ae-7577fb42990d admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:57.995122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4379e4-84fa-4b65-a9ae-7577fb42990d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:57.995122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4379e4-84fa-4b65-a9ae-7577fb42990d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:58.110214 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 946/1894] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:51:57 2022] POST /identity/v3/users => generated 296 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:51:58.114317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ba5ec-f45c-487f-8de2-d4b2aec23c70 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:58.128780 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ba5ec-f45c-487f-8de2-d4b2aec23c70 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:58.135231 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1629351-bcb7-4d6e-9d3e-82b83490d282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:58.135920 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1629351-bcb7-4d6e-9d3e-82b83490d282 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:58.136241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1629351-bcb7-4d6e-9d3e-82b83490d282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:58.136471 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1629351-bcb7-4d6e-9d3e-82b83490d282 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:58.137249 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1629351-bcb7-4d6e-9d3e-82b83490d282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:58.141642 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1629351-bcb7-4d6e-9d3e-82b83490d282 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:58.162848 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 949/1895] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:58.167098 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4379e4-84fa-4b65-a9ae-7577fb42990d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:58.178469 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4379e4-84fa-4b65-a9ae-7577fb42990d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:58.183385 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42178e9-abf0-4287-9e91-28d2722858c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:58.184362 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42178e9-abf0-4287-9e91-28d2722858c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:58.184641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42178e9-abf0-4287-9e91-28d2722858c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:58.185094 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42178e9-abf0-4287-9e91-28d2722858c1 admin admin] PATH_INFO: `/v3/projects/96b817db3f0342f8a9fd8e769d55fdd8/users/a78651b356fc42389c3b7ae87096b9b2/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:58.201036 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42178e9-abf0-4287-9e91-28d2722858c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b817db3f0342f8a9fd8e769d55fdd8, user_id=a78651b356fc42389c3b7ae87096b9b2, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:58.204925 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42178e9-abf0-4287-9e91-28d2722858c1 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:58.345532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 947/1896] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:58 2022] PUT /identity/v3/projects/96b817db3f0342f8a9fd8e769d55fdd8/users/a78651b356fc42389c3b7ae87096b9b2/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:58.349911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1629351-bcb7-4d6e-9d3e-82b83490d282 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:58.361097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1629351-bcb7-4d6e-9d3e-82b83490d282 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:58.425223 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70154857-115a-4a45-b97e-5fa30cfe2e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:58.425916 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70154857-115a-4a45-b97e-5fa30cfe2e0f admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:58.426201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70154857-115a-4a45-b97e-5fa30cfe2e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:58.426482 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70154857-115a-4a45-b97e-5fa30cfe2e0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:58.427224 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70154857-115a-4a45-b97e-5fa30cfe2e0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:58.428833 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70154857-115a-4a45-b97e-5fa30cfe2e0f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:58.440969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 950/1897] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:51:58.445105 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42178e9-abf0-4287-9e91-28d2722858c1 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:58.456645 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42178e9-abf0-4287-9e91-28d2722858c1 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:58.461527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76655828-7678-4fde-b79f-e5e9192e5f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:58.462430 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76655828-7678-4fde-b79f-e5e9192e5f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:58.462714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76655828-7678-4fde-b79f-e5e9192e5f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:58.462992 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76655828-7678-4fde-b79f-e5e9192e5f9f admin admin] PATH_INFO: `/v3/projects/96b817db3f0342f8a9fd8e769d55fdd8/users/a78651b356fc42389c3b7ae87096b9b2/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:58.464993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76655828-7678-4fde-b79f-e5e9192e5f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=96b817db3f0342f8a9fd8e769d55fdd8, user_id=a78651b356fc42389c3b7ae87096b9b2, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:58.467679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76655828-7678-4fde-b79f-e5e9192e5f9f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:58.479198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 948/1898] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:51:58 2022] PUT /identity/v3/projects/96b817db3f0342f8a9fd8e769d55fdd8/users/a78651b356fc42389c3b7ae87096b9b2/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:51:58.490720 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b8b17-65a7-4406-94f9-4841dc0e2ac1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:58.491051 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b8b17-65a7-4406-94f9-4841dc0e2ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:58.491304 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b8b17-65a7-4406-94f9-4841dc0e2ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:58.519566 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-985b8b17-65a7-4406-94f9-4841dc0e2ac1 None None] MFA Rules not processed for user `a78651b356fc42389c3b7ae87096b9b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:51:58.520827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-985b8b17-65a7-4406-94f9-4841dc0e2ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:58.596934 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 951/1899] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:51:58 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:51:58.608147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76655828-7678-4fde-b79f-e5e9192e5f9f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:58.611705 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-76655828-7678-4fde-b79f-e5e9192e5f9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:58.669111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76655828-7678-4fde-b79f-e5e9192e5f9f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:58.673342 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a50af8c-cd39-4947-9daa-8498452ee460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:58.674026 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50af8c-cd39-4947-9daa-8498452ee460 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:58.674307 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50af8c-cd39-4947-9daa-8498452ee460 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:58.674614 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50af8c-cd39-4947-9daa-8498452ee460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:58.683447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50af8c-cd39-4947-9daa-8498452ee460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:58.684864 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a50af8c-cd39-4947-9daa-8498452ee460 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:58.695431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 949/1900] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:58.800130 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b8b17-65a7-4406-94f9-4841dc0e2ac1 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:51:58.801723 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-985b8b17-65a7-4406-94f9-4841dc0e2ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:51:58.815282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b8b17-65a7-4406-94f9-4841dc0e2ac1 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:51:58.818986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c13def-8048-4b98-a1e5-64d65929a644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:51:58.819601 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c13def-8048-4b98-a1e5-64d65929a644 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:51:58.819894 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c13def-8048-4b98-a1e5-64d65929a644 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:51:58.820193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c13def-8048-4b98-a1e5-64d65929a644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:51:58.880135 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c13def-8048-4b98-a1e5-64d65929a644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:51:58.881673 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c13def-8048-4b98-a1e5-64d65929a644 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:51:58.890732 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 952/1901] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:51:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:51:58.916952 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:51:59.045283 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:01.443865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:02.435339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:03.202137 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c454a4a-a7bb-4e01-a11a-a54f3b589eac None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:03.203367 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c454a4a-a7bb-4e01-a11a-a54f3b589eac None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:03.204834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c454a4a-a7bb-4e01-a11a-a54f3b589eac None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:03.207176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 950/1902] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 16:52:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:52:03.241695 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6871e1d-0893-453a-8520-4b6685b0a1e4 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:03.242749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6871e1d-0893-453a-8520-4b6685b0a1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:03.243197 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6871e1d-0893-453a-8520-4b6685b0a1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:03.263489 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a6871e1d-0893-453a-8520-4b6685b0a1e4 None None] MFA Rules not processed for user `381cf4381ce64379b285d75e2909813d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:03.265897 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a6871e1d-0893-453a-8520-4b6685b0a1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:03.365190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 953/1903] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 16:52:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:03.378093 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c454a4a-a7bb-4e01-a11a-a54f3b589eac None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:03.380780 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2c454a4a-a7bb-4e01-a11a-a54f3b589eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:03.405583 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c454a4a-a7bb-4e01-a11a-a54f3b589eac None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:03.415896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c37d01-96f8-4668-a27b-73366f20b0c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:03.415896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c37d01-96f8-4668-a27b-73366f20b0c7 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:03.415896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c37d01-96f8-4668-a27b-73366f20b0c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:03.415896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c37d01-96f8-4668-a27b-73366f20b0c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:03.423919 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c37d01-96f8-4668-a27b-73366f20b0c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:03.425741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c37d01-96f8-4668-a27b-73366f20b0c7 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:03.436438 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 951/1904] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:04.553612 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:04.697220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6871e1d-0893-453a-8520-4b6685b0a1e4 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:04.763724 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6871e1d-0893-453a-8520-4b6685b0a1e4 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:04.768956 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f26779-e8e5-4b1e-babb-f7abfb148bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:04.769899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f26779-e8e5-4b1e-babb-f7abfb148bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:04.770076 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f26779-e8e5-4b1e-babb-f7abfb148bea admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:04.770680 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f26779-e8e5-4b1e-babb-f7abfb148bea admin admin] PATH_INFO: `/v3/users/e69486f8ef5844b7bea76332e798b515` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:04.771999 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f26779-e8e5-4b1e-babb-f7abfb148bea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e69486f8ef5844b7bea76332e798b515)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:04.773981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f26779-e8e5-4b1e-babb-f7abfb148bea admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:04.994447 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a1f26779-e8e5-4b1e-babb-f7abfb148bea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e69486f8ef5844b7bea76332e798b515'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:05.101850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a1f26779-e8e5-4b1e-babb-f7abfb148bea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e69486f8ef5844b7bea76332e798b515'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:05.110500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a1f26779-e8e5-4b1e-babb-f7abfb148bea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e69486f8ef5844b7bea76332e798b515'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:05.115091 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a1f26779-e8e5-4b1e-babb-f7abfb148bea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e69486f8ef5844b7bea76332e798b515'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:05.129174 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a1f26779-e8e5-4b1e-babb-f7abfb148bea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e69486f8ef5844b7bea76332e798b515'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:05.138195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 954/1905] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:04 2022] DELETE /identity/v3/users/e69486f8ef5844b7bea76332e798b515 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:05.143892 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3621d-0fdb-4d29-9c4b-f6e99f06b7dc None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:05.144299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3621d-0fdb-4d29-9c4b-f6e99f06b7dc None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:05.144456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a3621d-0fdb-4d29-9c4b-f6e99f06b7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:05.164321 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c7a3621d-0fdb-4d29-9c4b-f6e99f06b7dc None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:05.165876 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c7a3621d-0fdb-4d29-9c4b-f6e99f06b7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:05.239537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 952/1906] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:05.254892 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f26779-e8e5-4b1e-babb-f7abfb148bea admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:05.256558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a1f26779-e8e5-4b1e-babb-f7abfb148bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:05.316130 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f26779-e8e5-4b1e-babb-f7abfb148bea admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:05.320073 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f681c2-9407-42c5-b4d1-d4aa008b2804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:05.320463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f681c2-9407-42c5-b4d1-d4aa008b2804 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:05.320751 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f681c2-9407-42c5-b4d1-d4aa008b2804 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:05.321054 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f681c2-9407-42c5-b4d1-d4aa008b2804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:05.331778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f681c2-9407-42c5-b4d1-d4aa008b2804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:05.333251 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f681c2-9407-42c5-b4d1-d4aa008b2804 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:05.342855 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 955/1907] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:05.907334 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3621d-0fdb-4d29-9c4b-f6e99f06b7dc None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:05.908881 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c7a3621d-0fdb-4d29-9c4b-f6e99f06b7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:05.930871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a3621d-0fdb-4d29-9c4b-f6e99f06b7dc None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:05.937245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571e5f9-fd83-4053-9aa1-0c8fda1dfe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:05.938309 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571e5f9-fd83-4053-9aa1-0c8fda1dfe04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:05.938755 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571e5f9-fd83-4053-9aa1-0c8fda1dfe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:05.939192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f571e5f9-fd83-4053-9aa1-0c8fda1dfe04 admin admin] PATH_INFO: `/v3/projects/2474d597bf7148a3a6d08d102aa26e30` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:05.940578 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571e5f9-fd83-4053-9aa1-0c8fda1dfe04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2474d597bf7148a3a6d08d102aa26e30)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:05.943016 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f571e5f9-fd83-4053-9aa1-0c8fda1dfe04 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:06.149326 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f571e5f9-fd83-4053-9aa1-0c8fda1dfe04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2474d597bf7148a3a6d08d102aa26e30', 'request_id': 'req-f571e5f9-fd83-4053-9aa1-0c8fda1dfe04'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:06.155612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f571e5f9-fd83-4053-9aa1-0c8fda1dfe04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2474d597bf7148a3a6d08d102aa26e30', 'request_id': 'req-f571e5f9-fd83-4053-9aa1-0c8fda1dfe04'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:06.163090 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f571e5f9-fd83-4053-9aa1-0c8fda1dfe04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2474d597bf7148a3a6d08d102aa26e30', 'request_id': 'req-f571e5f9-fd83-4053-9aa1-0c8fda1dfe04'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:06.266856 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f571e5f9-fd83-4053-9aa1-0c8fda1dfe04 admin admin] The token cache is being invalidate because project 2474d597bf7148a3a6d08d102aa26e30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:06.274166 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f571e5f9-fd83-4053-9aa1-0c8fda1dfe04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:06.274166 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f571e5f9-fd83-4053-9aa1-0c8fda1dfe04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:06.274166 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 953/1908] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:05 2022] DELETE /identity/v3/projects/2474d597bf7148a3a6d08d102aa26e30 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:06.274963 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f681c2-9407-42c5-b4d1-d4aa008b2804 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:06.286100 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f681c2-9407-42c5-b4d1-d4aa008b2804 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:06.346353 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce49cb-91f3-4261-a41a-fb08d332e36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:06.347428 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce49cb-91f3-4261-a41a-fb08d332e36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:06.347785 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce49cb-91f3-4261-a41a-fb08d332e36a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:06.348128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ce49cb-91f3-4261-a41a-fb08d332e36a admin admin] PATH_INFO: `/v3/users/a78651b356fc42389c3b7ae87096b9b2` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:06.349453 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce49cb-91f3-4261-a41a-fb08d332e36a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a78651b356fc42389c3b7ae87096b9b2)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:06.351461 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ce49cb-91f3-4261-a41a-fb08d332e36a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:06.429047 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:06.589776 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-20ce49cb-91f3-4261-a41a-fb08d332e36a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a78651b356fc42389c3b7ae87096b9b2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:06.737098 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-20ce49cb-91f3-4261-a41a-fb08d332e36a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a78651b356fc42389c3b7ae87096b9b2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:06.753874 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-20ce49cb-91f3-4261-a41a-fb08d332e36a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a78651b356fc42389c3b7ae87096b9b2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:06.755340 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-20ce49cb-91f3-4261-a41a-fb08d332e36a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a78651b356fc42389c3b7ae87096b9b2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:06.783170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-20ce49cb-91f3-4261-a41a-fb08d332e36a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a78651b356fc42389c3b7ae87096b9b2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:06.795447 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 956/1909] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:06 2022] DELETE /identity/v3/users/a78651b356fc42389c3b7ae87096b9b2 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:07.805297 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571e5f9-fd83-4053-9aa1-0c8fda1dfe04 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:07.808354 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f571e5f9-fd83-4053-9aa1-0c8fda1dfe04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:07.897094 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f571e5f9-fd83-4053-9aa1-0c8fda1dfe04 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:07.960494 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b0135-0397-466f-86cd-649e70735d4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:07.961293 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b0135-0397-466f-86cd-649e70735d4d service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:07.961649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b0135-0397-466f-86cd-649e70735d4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:07.961998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07b0135-0397-466f-86cd-649e70735d4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:07.963908 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c07b0135-0397-466f-86cd-649e70735d4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:08.047236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b0135-0397-466f-86cd-649e70735d4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:08.048634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07b0135-0397-466f-86cd-649e70735d4d service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:08.062325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 954/1910] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:08.183493 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:08.532829 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce49cb-91f3-4261-a41a-fb08d332e36a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:08.534428 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-20ce49cb-91f3-4261-a41a-fb08d332e36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:08.613539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ce49cb-91f3-4261-a41a-fb08d332e36a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:08.618573 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d89699a-a17c-4474-af0e-5f98f9b4f677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:08.619287 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89699a-a17c-4474-af0e-5f98f9b4f677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:08.619569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89699a-a17c-4474-af0e-5f98f9b4f677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:08.619853 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d89699a-a17c-4474-af0e-5f98f9b4f677 admin admin] PATH_INFO: `/v3/projects/96b817db3f0342f8a9fd8e769d55fdd8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:08.621116 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89699a-a17c-4474-af0e-5f98f9b4f677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96b817db3f0342f8a9fd8e769d55fdd8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:08.623245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d89699a-a17c-4474-af0e-5f98f9b4f677 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:08.676990 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:08.840181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3d89699a-a17c-4474-af0e-5f98f9b4f677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96b817db3f0342f8a9fd8e769d55fdd8', 'request_id': 'req-3d89699a-a17c-4474-af0e-5f98f9b4f677'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:08.846836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3d89699a-a17c-4474-af0e-5f98f9b4f677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96b817db3f0342f8a9fd8e769d55fdd8', 'request_id': 'req-3d89699a-a17c-4474-af0e-5f98f9b4f677'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:08.852993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3d89699a-a17c-4474-af0e-5f98f9b4f677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96b817db3f0342f8a9fd8e769d55fdd8', 'request_id': 'req-3d89699a-a17c-4474-af0e-5f98f9b4f677'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:08.880982 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b0135-0397-466f-86cd-649e70735d4d service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:08.883133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c07b0135-0397-466f-86cd-649e70735d4d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:08.909200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07b0135-0397-466f-86cd-649e70735d4d service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:08.979689 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6888af-f772-40d6-bcf2-69cfec2d7bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:08.980766 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6888af-f772-40d6-bcf2-69cfec2d7bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:08.981249 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6888af-f772-40d6-bcf2-69cfec2d7bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:08.981703 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6888af-f772-40d6-bcf2-69cfec2d7bd1 admin admin] PATH_INFO: `/v3/users/7d935f848100472e9d308edea6c2b801` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:08.983176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6888af-f772-40d6-bcf2-69cfec2d7bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d935f848100472e9d308edea6c2b801)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:08.986522 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6888af-f772-40d6-bcf2-69cfec2d7bd1 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:08.989139 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3d89699a-a17c-4474-af0e-5f98f9b4f677 admin admin] The token cache is being invalidate because project 96b817db3f0342f8a9fd8e769d55fdd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:08.990020 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3d89699a-a17c-4474-af0e-5f98f9b4f677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:08.990979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3d89699a-a17c-4474-af0e-5f98f9b4f677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:08.994174 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 957/1911] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:08 2022] DELETE /identity/v3/projects/96b817db3f0342f8a9fd8e769d55fdd8 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:08.999240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42525576-a6ad-449f-bd73-a7abc96a599c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:09.003816 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42525576-a6ad-449f-bd73-a7abc96a599c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:09.003984 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42525576-a6ad-449f-bd73-a7abc96a599c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:09.037290 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-42525576-a6ad-449f-bd73-a7abc96a599c None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:09.038788 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-42525576-a6ad-449f-bd73-a7abc96a599c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:09.048717 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 958/1912] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:09.056763 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c08ec-3b7a-4410-aa43-f510212e8274 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:09.057080 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c08ec-3b7a-4410-aa43-f510212e8274 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:09.057363 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c08ec-3b7a-4410-aa43-f510212e8274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:09.084219 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0a8c08ec-3b7a-4410-aa43-f510212e8274 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:09.084219 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0a8c08ec-3b7a-4410-aa43-f510212e8274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:09.093191 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 959/1913] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:09.094812 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c08ec-3b7a-4410-aa43-f510212e8274 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:09.104804 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c08ec-3b7a-4410-aa43-f510212e8274 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:09.110105 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785ae39-4e44-4cc3-910e-a48b0b8662ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:09.110810 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785ae39-4e44-4cc3-910e-a48b0b8662ab admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:09.111099 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785ae39-4e44-4cc3-910e-a48b0b8662ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:09.111844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785ae39-4e44-4cc3-910e-a48b0b8662ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:09.112182 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785ae39-4e44-4cc3-910e-a48b0b8662ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:52:09.112494 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785ae39-4e44-4cc3-910e-a48b0b8662ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:09.114168 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785ae39-4e44-4cc3-910e-a48b0b8662ab admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:09.136027 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 960/1914] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:52:09.141901 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785ae39-4e44-4cc3-910e-a48b0b8662ab admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:09.152369 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785ae39-4e44-4cc3-910e-a48b0b8662ab admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:09.162162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08314b09-e5a0-4b31-afbf-27f15e68052f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:09.162162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08314b09-e5a0-4b31-afbf-27f15e68052f admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:09.162162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08314b09-e5a0-4b31-afbf-27f15e68052f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:09.162162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08314b09-e5a0-4b31-afbf-27f15e68052f admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:09.164228 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08314b09-e5a0-4b31-afbf-27f15e68052f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:09.164228 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08314b09-e5a0-4b31-afbf-27f15e68052f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:09.255224 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 961/1915] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:09 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:09.259124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08314b09-e5a0-4b31-afbf-27f15e68052f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:09.267819 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ee6888af-f772-40d6-bcf2-69cfec2d7bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d935f848100472e9d308edea6c2b801'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:09.345625 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08314b09-e5a0-4b31-afbf-27f15e68052f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:09.353342 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ee6888af-f772-40d6-bcf2-69cfec2d7bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d935f848100472e9d308edea6c2b801'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:09.353722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1467b-7802-4175-b310-cc8709029086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:09.354838 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1467b-7802-4175-b310-cc8709029086 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:09.355669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1467b-7802-4175-b310-cc8709029086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:09.356447 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f1467b-7802-4175-b310-cc8709029086 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:09.357413 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1467b-7802-4175-b310-cc8709029086 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:09.364392 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f1467b-7802-4175-b310-cc8709029086 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:09.364746 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ee6888af-f772-40d6-bcf2-69cfec2d7bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d935f848100472e9d308edea6c2b801'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:09.364746 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ee6888af-f772-40d6-bcf2-69cfec2d7bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d935f848100472e9d308edea6c2b801'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:09.379054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ee6888af-f772-40d6-bcf2-69cfec2d7bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d935f848100472e9d308edea6c2b801'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:09.386019 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 955/1916] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:08 2022] DELETE /identity/v3/users/7d935f848100472e9d308edea6c2b801 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:09.390510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c20b3-a3a2-4342-8e7b-eda5617d0b75 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:09.391708 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c20b3-a3a2-4342-8e7b-eda5617d0b75 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:09.392079 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c20b3-a3a2-4342-8e7b-eda5617d0b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:09.411356 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-2a8c20b3-a3a2-4342-8e7b-eda5617d0b75 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:09.412617 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2a8c20b3-a3a2-4342-8e7b-eda5617d0b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:09.482606 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 956/1917] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:09.488109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 962/1918] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:09 2022] POST /identity/v3/users => generated 293 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:09.489523 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c20b3-a3a2-4342-8e7b-eda5617d0b75 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:09.491375 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2a8c20b3-a3a2-4342-8e7b-eda5617d0b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:09.492814 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1467b-7802-4175-b310-cc8709029086 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:09.498141 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b1f1467b-7802-4175-b310-cc8709029086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:09.506220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c20b3-a3a2-4342-8e7b-eda5617d0b75 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:09.511559 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824133b2-fafa-4af1-9943-ebba21df909d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:09.512467 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824133b2-fafa-4af1-9943-ebba21df909d admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:09.512902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824133b2-fafa-4af1-9943-ebba21df909d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:09.513354 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824133b2-fafa-4af1-9943-ebba21df909d admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:09.514253 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824133b2-fafa-4af1-9943-ebba21df909d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:09.516760 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824133b2-fafa-4af1-9943-ebba21df909d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:09.532707 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 957/1919] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:09.533915 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824133b2-fafa-4af1-9943-ebba21df909d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:09.544738 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824133b2-fafa-4af1-9943-ebba21df909d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:09.550563 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cb49e-ea7d-4570-aff6-44d164efcdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:09.551475 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cb49e-ea7d-4570-aff6-44d164efcdcc admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:09.551910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cb49e-ea7d-4570-aff6-44d164efcdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:09.552332 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97cb49e-ea7d-4570-aff6-44d164efcdcc admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:09.553667 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97cb49e-ea7d-4570-aff6-44d164efcdcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:09.555576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97cb49e-ea7d-4570-aff6-44d164efcdcc admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:09.570676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 958/1920] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:09.571882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cb49e-ea7d-4570-aff6-44d164efcdcc admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:09.584792 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97cb49e-ea7d-4570-aff6-44d164efcdcc admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:09.600326 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3b015-43d8-4c00-a5c4-17a43cb12b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:09.601276 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3b015-43d8-4c00-a5c4-17a43cb12b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:09.601571 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3b015-43d8-4c00-a5c4-17a43cb12b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:09.601855 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c3b015-43d8-4c00-a5c4-17a43cb12b3c admin admin] PATH_INFO: `/v3/projects/0343e86ee40e499badc4764bc92a6107/users/70af437e76914ac58bf7a5d9488f50b2/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:09.608225 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f1467b-7802-4175-b310-cc8709029086 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:09.625595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3b015-43d8-4c00-a5c4-17a43cb12b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0343e86ee40e499badc4764bc92a6107, user_id=70af437e76914ac58bf7a5d9488f50b2, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:09.628476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c3b015-43d8-4c00-a5c4-17a43cb12b3c admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:09.672745 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff667c-aa41-4bdc-89d2-9ba3967021ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:09.673510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff667c-aa41-4bdc-89d2-9ba3967021ef service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:09.673786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff667c-aa41-4bdc-89d2-9ba3967021ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:09.674063 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff667c-aa41-4bdc-89d2-9ba3967021ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:09.684255 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff667c-aa41-4bdc-89d2-9ba3967021ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:09.686849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff667c-aa41-4bdc-89d2-9ba3967021ef service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:09.698606 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 963/1921] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:09.743095 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 959/1922] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:09 2022] PUT /identity/v3/projects/0343e86ee40e499badc4764bc92a6107/users/70af437e76914ac58bf7a5d9488f50b2/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:09.754733 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd956bf-d4bf-41b7-8140-217e7b2b668a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:09.755334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd956bf-d4bf-41b7-8140-217e7b2b668a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:09.755622 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd956bf-d4bf-41b7-8140-217e7b2b668a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:09.786462 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-cdd956bf-d4bf-41b7-8140-217e7b2b668a None None] MFA Rules not processed for user `70af437e76914ac58bf7a5d9488f50b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:09.787880 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cdd956bf-d4bf-41b7-8140-217e7b2b668a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:09.859428 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 964/1923] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:09.871370 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3b015-43d8-4c00-a5c4-17a43cb12b3c admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:09.873059 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-53c3b015-43d8-4c00-a5c4-17a43cb12b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:09.952618 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c3b015-43d8-4c00-a5c4-17a43cb12b3c admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:09.958898 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425a07e-6e1f-4b16-9586-3214f7cb197c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:09.960069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425a07e-6e1f-4b16-9586-3214f7cb197c service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:09.960641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425a07e-6e1f-4b16-9586-3214f7cb197c service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:09.961159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425a07e-6e1f-4b16-9586-3214f7cb197c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:09.977930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425a07e-6e1f-4b16-9586-3214f7cb197c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:09.981927 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425a07e-6e1f-4b16-9586-3214f7cb197c service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:10.004508 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 960/1924] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:10.226102 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:10.303930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd956bf-d4bf-41b7-8140-217e7b2b668a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:10.305461 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cdd956bf-d4bf-41b7-8140-217e7b2b668a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:10.394727 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd956bf-d4bf-41b7-8140-217e7b2b668a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:10.401505 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77805110-1fbb-4f87-b122-28b9afcee6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:10.402396 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77805110-1fbb-4f87-b122-28b9afcee6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:10.402684 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77805110-1fbb-4f87-b122-28b9afcee6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:10.402966 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77805110-1fbb-4f87-b122-28b9afcee6ac admin admin] PATH_INFO: `/v3/projects/a21db8b618384dc783c68358ab067721` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:10.404175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77805110-1fbb-4f87-b122-28b9afcee6ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=a21db8b618384dc783c68358ab067721)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:10.406210 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77805110-1fbb-4f87-b122-28b9afcee6ac admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:10.630262 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-77805110-1fbb-4f87-b122-28b9afcee6ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a21db8b618384dc783c68358ab067721', 'request_id': 'req-77805110-1fbb-4f87-b122-28b9afcee6ac'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:10.636955 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-77805110-1fbb-4f87-b122-28b9afcee6ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a21db8b618384dc783c68358ab067721', 'request_id': 'req-77805110-1fbb-4f87-b122-28b9afcee6ac'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:10.644116 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-77805110-1fbb-4f87-b122-28b9afcee6ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a21db8b618384dc783c68358ab067721', 'request_id': 'req-77805110-1fbb-4f87-b122-28b9afcee6ac'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:10.835403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-77805110-1fbb-4f87-b122-28b9afcee6ac admin admin] The token cache is being invalidate because project a21db8b618384dc783c68358ab067721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:10.835949 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-77805110-1fbb-4f87-b122-28b9afcee6ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:10.836825 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-77805110-1fbb-4f87-b122-28b9afcee6ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:10.842781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 965/1925] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:10 2022] DELETE /identity/v3/projects/a21db8b618384dc783c68358ab067721 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:10.843935 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425a07e-6e1f-4b16-9586-3214f7cb197c service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:10.857116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425a07e-6e1f-4b16-9586-3214f7cb197c service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:10.925963 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800001e-70bc-4c58-8439-1760105c8e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:10.926916 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800001e-70bc-4c58-8439-1760105c8e01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:10.927201 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800001e-70bc-4c58-8439-1760105c8e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:10.927480 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800001e-70bc-4c58-8439-1760105c8e01 admin admin] PATH_INFO: `/v3/users/70772cff41bf4377ab5c1406881ec346` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:10.929664 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800001e-70bc-4c58-8439-1760105c8e01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70772cff41bf4377ab5c1406881ec346)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:10.931655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800001e-70bc-4c58-8439-1760105c8e01 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:11.205484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8800001e-70bc-4c58-8439-1760105c8e01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70772cff41bf4377ab5c1406881ec346'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:11.328214 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8800001e-70bc-4c58-8439-1760105c8e01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70772cff41bf4377ab5c1406881ec346'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:11.338261 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8800001e-70bc-4c58-8439-1760105c8e01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70772cff41bf4377ab5c1406881ec346'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:11.339012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8800001e-70bc-4c58-8439-1760105c8e01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70772cff41bf4377ab5c1406881ec346'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:11.366822 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8800001e-70bc-4c58-8439-1760105c8e01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70772cff41bf4377ab5c1406881ec346'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:11.378097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 961/1926] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:10 2022] DELETE /identity/v3/users/70772cff41bf4377ab5c1406881ec346 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:11.659806 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:12.122898 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77805110-1fbb-4f87-b122-28b9afcee6ac admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:12.124722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-77805110-1fbb-4f87-b122-28b9afcee6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:12.181705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77805110-1fbb-4f87-b122-28b9afcee6ac admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:12.292100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:12.311465 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af1883-b175-4317-882d-5ba729c52973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:12.312532 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af1883-b175-4317-882d-5ba729c52973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:12.312883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af1883-b175-4317-882d-5ba729c52973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:12.313300 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af1883-b175-4317-882d-5ba729c52973 admin admin] PATH_INFO: `/v3/projects/22c39ae7402a4c9ab44b6a1283265227` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:12.315084 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af1883-b175-4317-882d-5ba729c52973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22c39ae7402a4c9ab44b6a1283265227)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:12.316907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63af1883-b175-4317-882d-5ba729c52973 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:12.481330 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-63af1883-b175-4317-882d-5ba729c52973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22c39ae7402a4c9ab44b6a1283265227', 'request_id': 'req-63af1883-b175-4317-882d-5ba729c52973'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:12.489159 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-63af1883-b175-4317-882d-5ba729c52973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22c39ae7402a4c9ab44b6a1283265227', 'request_id': 'req-63af1883-b175-4317-882d-5ba729c52973'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:12.495890 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-63af1883-b175-4317-882d-5ba729c52973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22c39ae7402a4c9ab44b6a1283265227', 'request_id': 'req-63af1883-b175-4317-882d-5ba729c52973'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:12.605160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-63af1883-b175-4317-882d-5ba729c52973 admin admin] The token cache is being invalidate because project 22c39ae7402a4c9ab44b6a1283265227 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:12.605451 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-63af1883-b175-4317-882d-5ba729c52973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:12.606091 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-63af1883-b175-4317-882d-5ba729c52973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:12.607686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 966/1927] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:12 2022] DELETE /identity/v3/projects/22c39ae7402a4c9ab44b6a1283265227 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:12.612562 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e9cc4-982a-4bd5-b9bb-7c74681b73ed None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:12.612884 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e9cc4-982a-4bd5-b9bb-7c74681b73ed None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:12.613190 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e9cc4-982a-4bd5-b9bb-7c74681b73ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:12.632438 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-378e9cc4-982a-4bd5-b9bb-7c74681b73ed None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:12.633701 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-378e9cc4-982a-4bd5-b9bb-7c74681b73ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:12.704650 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 962/1928] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:12.712207 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589f3c2-7319-4a64-8aaa-d8c4216964c7 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:12.712773 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589f3c2-7319-4a64-8aaa-d8c4216964c7 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:12.712912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589f3c2-7319-4a64-8aaa-d8c4216964c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:12.734962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5589f3c2-7319-4a64-8aaa-d8c4216964c7 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:12.736275 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5589f3c2-7319-4a64-8aaa-d8c4216964c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:12.750601 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 967/1929] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:12.759521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e9cc4-982a-4bd5-b9bb-7c74681b73ed None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:12.770848 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e9cc4-982a-4bd5-b9bb-7c74681b73ed None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:12.775476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2aca15-1bac-49af-a728-9455574ca3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:12.776160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2aca15-1bac-49af-a728-9455574ca3dc admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:12.776451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2aca15-1bac-49af-a728-9455574ca3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:12.776732 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2aca15-1bac-49af-a728-9455574ca3dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:12.777515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2aca15-1bac-49af-a728-9455574ca3dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:52:12.777829 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2aca15-1bac-49af-a728-9455574ca3dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:12.779451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2aca15-1bac-49af-a728-9455574ca3dc admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:12.796034 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 963/1930] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:52:12.799377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589f3c2-7319-4a64-8aaa-d8c4216964c7 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:12.810934 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589f3c2-7319-4a64-8aaa-d8c4216964c7 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:12.817410 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71872883-0cb0-4dc8-b25b-f08afcb9ee83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:12.818245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71872883-0cb0-4dc8-b25b-f08afcb9ee83 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:12.818674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71872883-0cb0-4dc8-b25b-f08afcb9ee83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:12.819245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71872883-0cb0-4dc8-b25b-f08afcb9ee83 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:12.819814 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71872883-0cb0-4dc8-b25b-f08afcb9ee83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:12.821822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71872883-0cb0-4dc8-b25b-f08afcb9ee83 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:12.939723 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 968/1931] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:12 2022] POST /identity/v3/projects => generated 387 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:12.945289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2aca15-1bac-49af-a728-9455574ca3dc admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:12.956091 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2aca15-1bac-49af-a728-9455574ca3dc admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:13.014736 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0b064-4936-43bc-831f-ddf5443d77c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:13.015448 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0b064-4936-43bc-831f-ddf5443d77c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:13.015737 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0b064-4936-43bc-831f-ddf5443d77c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:13.016018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e0b064-4936-43bc-831f-ddf5443d77c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:13.016717 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e0b064-4936-43bc-831f-ddf5443d77c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:13.018708 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e0b064-4936-43bc-831f-ddf5443d77c3 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:13.153964 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 964/1932] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:12 2022] POST /identity/v3/users => generated 294 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:13.155925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71872883-0cb0-4dc8-b25b-f08afcb9ee83 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:13.170334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71872883-0cb0-4dc8-b25b-f08afcb9ee83 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:13.178317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21942141-91bb-44ab-8d96-ef99724f1765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:13.179142 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21942141-91bb-44ab-8d96-ef99724f1765 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:13.179499 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21942141-91bb-44ab-8d96-ef99724f1765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:13.179848 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21942141-91bb-44ab-8d96-ef99724f1765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:13.180666 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21942141-91bb-44ab-8d96-ef99724f1765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:13.182406 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21942141-91bb-44ab-8d96-ef99724f1765 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:13.197673 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 969/1933] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:13.198971 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0b064-4936-43bc-831f-ddf5443d77c3 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:13.211027 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e0b064-4936-43bc-831f-ddf5443d77c3 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:13.216099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f388ba7-964c-4674-9001-71fcf04809e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:13.216877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f388ba7-964c-4674-9001-71fcf04809e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:13.217260 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f388ba7-964c-4674-9001-71fcf04809e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:13.217712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f388ba7-964c-4674-9001-71fcf04809e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:13.218546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f388ba7-964c-4674-9001-71fcf04809e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:13.220342 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f388ba7-964c-4674-9001-71fcf04809e6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:13.232652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 965/1934] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:13.237732 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21942141-91bb-44ab-8d96-ef99724f1765 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:13.248294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21942141-91bb-44ab-8d96-ef99724f1765 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:13.254238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32a183-a00b-47e4-a704-559fc2e79b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:13.255362 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32a183-a00b-47e4-a704-559fc2e79b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:13.255745 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32a183-a00b-47e4-a704-559fc2e79b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:13.256116 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32a183-a00b-47e4-a704-559fc2e79b71 admin admin] PATH_INFO: `/v3/projects/c69c9b5255e44e20ad679c5958b911c8/users/38b19da9e17d455092681d908ccb221c/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:13.276925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32a183-a00b-47e4-a704-559fc2e79b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c69c9b5255e44e20ad679c5958b911c8, user_id=38b19da9e17d455092681d908ccb221c, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:13.278514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32a183-a00b-47e4-a704-559fc2e79b71 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:13.394434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 970/1935] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:13 2022] PUT /identity/v3/projects/c69c9b5255e44e20ad679c5958b911c8/users/38b19da9e17d455092681d908ccb221c/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:13.404980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff50ad-9038-44f8-a5e7-7ad7115ed83d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:13.405476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff50ad-9038-44f8-a5e7-7ad7115ed83d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:13.405589 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff50ad-9038-44f8-a5e7-7ad7115ed83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:13.442423 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-b2ff50ad-9038-44f8-a5e7-7ad7115ed83d None None] MFA Rules not processed for user `38b19da9e17d455092681d908ccb221c`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:13.443649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b2ff50ad-9038-44f8-a5e7-7ad7115ed83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:13.518994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 966/1936] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:13.525733 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32a183-a00b-47e4-a704-559fc2e79b71 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:13.622908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32a183-a00b-47e4-a704-559fc2e79b71 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:13.629930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9c2e4-ed26-47c2-b86e-aa17981e507d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:13.630910 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9c2e4-ed26-47c2-b86e-aa17981e507d admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:13.631279 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9c2e4-ed26-47c2-b86e-aa17981e507d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:13.631701 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9c2e4-ed26-47c2-b86e-aa17981e507d admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:13.632675 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9c2e4-ed26-47c2-b86e-aa17981e507d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:13.634975 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9c2e4-ed26-47c2-b86e-aa17981e507d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:13.833992 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 971/1937] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:13 2022] POST /identity/v3/projects => generated 385 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:13.835196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff50ad-9038-44f8-a5e7-7ad7115ed83d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:13.847244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ff50ad-9038-44f8-a5e7-7ad7115ed83d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:13.930272 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa7b2c-f66c-402a-9354-12a4d8d11baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:13.931315 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa7b2c-f66c-402a-9354-12a4d8d11baf admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:13.931605 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa7b2c-f66c-402a-9354-12a4d8d11baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:13.932118 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa7b2c-f66c-402a-9354-12a4d8d11baf admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:13.932916 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa7b2c-f66c-402a-9354-12a4d8d11baf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:13.935022 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa7b2c-f66c-402a-9354-12a4d8d11baf admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:13.983420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:14.123212 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 967/1938] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:13 2022] POST /identity/v3/users => generated 293 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:14.124580 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9c2e4-ed26-47c2-b86e-aa17981e507d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:14.135679 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9c2e4-ed26-47c2-b86e-aa17981e507d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:14.141041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987a1e5-c403-4cce-8658-d4ccd699acc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:14.141734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987a1e5-c403-4cce-8658-d4ccd699acc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:14.142023 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987a1e5-c403-4cce-8658-d4ccd699acc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:14.142300 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987a1e5-c403-4cce-8658-d4ccd699acc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:14.143044 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987a1e5-c403-4cce-8658-d4ccd699acc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:14.144707 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987a1e5-c403-4cce-8658-d4ccd699acc2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:14.156646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 972/1939] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:14.160912 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa7b2c-f66c-402a-9354-12a4d8d11baf admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:14.172546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa7b2c-f66c-402a-9354-12a4d8d11baf admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:14.177487 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e766f72-5b7f-48bc-854d-60c57f34af96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:14.178167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e766f72-5b7f-48bc-854d-60c57f34af96 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:14.180078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e766f72-5b7f-48bc-854d-60c57f34af96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:14.180078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e766f72-5b7f-48bc-854d-60c57f34af96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:14.180078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e766f72-5b7f-48bc-854d-60c57f34af96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:14.181219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e766f72-5b7f-48bc-854d-60c57f34af96 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:14.192100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 968/1940] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:14.196490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987a1e5-c403-4cce-8658-d4ccd699acc2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:14.207107 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987a1e5-c403-4cce-8658-d4ccd699acc2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:14.211910 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece5a47-be06-40f8-8c33-d3bb8fdda352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:14.212872 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece5a47-be06-40f8-8c33-d3bb8fdda352 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:14.213243 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece5a47-be06-40f8-8c33-d3bb8fdda352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:14.213523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bece5a47-be06-40f8-8c33-d3bb8fdda352 admin admin] PATH_INFO: `/v3/projects/4595e302c5e54c1191a87c9985da6ffc/users/a43faf1abd2d4103a447350914cd4199/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:14.229820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece5a47-be06-40f8-8c33-d3bb8fdda352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4595e302c5e54c1191a87c9985da6ffc, user_id=a43faf1abd2d4103a447350914cd4199, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:14.232469 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bece5a47-be06-40f8-8c33-d3bb8fdda352 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:14.371709 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 973/1941] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:14 2022] PUT /identity/v3/projects/4595e302c5e54c1191a87c9985da6ffc/users/a43faf1abd2d4103a447350914cd4199/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:14.383568 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed14c4-4576-42ae-b251-33d3c9ae1818 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:14.383864 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed14c4-4576-42ae-b251-33d3c9ae1818 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:14.384145 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ed14c4-4576-42ae-b251-33d3c9ae1818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:14.413487 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d1ed14c4-4576-42ae-b251-33d3c9ae1818 None None] MFA Rules not processed for user `a43faf1abd2d4103a447350914cd4199`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:14.414696 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d1ed14c4-4576-42ae-b251-33d3c9ae1818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:14.485290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 969/1942] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:14.489858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece5a47-be06-40f8-8c33-d3bb8fdda352 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:14.569956 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bece5a47-be06-40f8-8c33-d3bb8fdda352 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:14.589479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3820da-7cb5-4cd6-aa27-c0c200b448d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:14.590296 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3820da-7cb5-4cd6-aa27-c0c200b448d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:14.591699 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3820da-7cb5-4cd6-aa27-c0c200b448d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:14.592958 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3820da-7cb5-4cd6-aa27-c0c200b448d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:14.594774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3820da-7cb5-4cd6-aa27-c0c200b448d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:14.595843 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:14.596744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3820da-7cb5-4cd6-aa27-c0c200b448d2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:14.597393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed14c4-4576-42ae-b251-33d3c9ae1818 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:14.599002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d1ed14c4-4576-42ae-b251-33d3c9ae1818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:14.615488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ed14c4-4576-42ae-b251-33d3c9ae1818 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:14.620239 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4538c1bc-b171-4c28-b6ab-8176b468d6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:14.621126 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538c1bc-b171-4c28-b6ab-8176b468d6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:14.621408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538c1bc-b171-4c28-b6ab-8176b468d6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:14.621825 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4538c1bc-b171-4c28-b6ab-8176b468d6fb admin admin] PATH_INFO: `/v3/users/70af437e76914ac58bf7a5d9488f50b2` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:14.623060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538c1bc-b171-4c28-b6ab-8176b468d6fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=70af437e76914ac58bf7a5d9488f50b2)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:14.625447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4538c1bc-b171-4c28-b6ab-8176b468d6fb admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:14.773000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 974/1943] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:14 2022] POST /identity/v3/projects => generated 387 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:14.776597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3820da-7cb5-4cd6-aa27-c0c200b448d2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:14.840378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3820da-7cb5-4cd6-aa27-c0c200b448d2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:14.845523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31056f1-c523-4da1-a5ce-9c3a692c551f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:14.846197 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31056f1-c523-4da1-a5ce-9c3a692c551f admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:14.846483 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31056f1-c523-4da1-a5ce-9c3a692c551f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:14.846761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31056f1-c523-4da1-a5ce-9c3a692c551f admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:14.847458 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31056f1-c523-4da1-a5ce-9c3a692c551f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:14.849642 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31056f1-c523-4da1-a5ce-9c3a692c551f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:15.024241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 975/1944] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:14 2022] POST /identity/v3/users => generated 300 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:15.025431 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31056f1-c523-4da1-a5ce-9c3a692c551f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:15.034271 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4538c1bc-b171-4c28-b6ab-8176b468d6fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70af437e76914ac58bf7a5d9488f50b2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:15.041156 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31056f1-c523-4da1-a5ce-9c3a692c551f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:15.057209 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ece25-0855-4e04-a3cc-d952ae8cd4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:15.058254 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ece25-0855-4e04-a3cc-d952ae8cd4e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:15.058553 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ece25-0855-4e04-a3cc-d952ae8cd4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:15.058868 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ece25-0855-4e04-a3cc-d952ae8cd4e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:15.059683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ece25-0855-4e04-a3cc-d952ae8cd4e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:15.061434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ece25-0855-4e04-a3cc-d952ae8cd4e9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:15.076692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 976/1945] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:15.082816 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ece25-0855-4e04-a3cc-d952ae8cd4e9 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:15.099748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ece25-0855-4e04-a3cc-d952ae8cd4e9 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:15.108765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930aac7-281a-4c64-a988-ad94bdbf33b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:15.110209 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930aac7-281a-4c64-a988-ad94bdbf33b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:15.110651 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930aac7-281a-4c64-a988-ad94bdbf33b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:15.111060 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930aac7-281a-4c64-a988-ad94bdbf33b7 admin admin] PATH_INFO: `/v3/projects/26ba2bd22eb049e5b4345ddfb2248f9b/users/231eb3b32c924e62b99c1e95195935b2/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:15.152151 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930aac7-281a-4c64-a988-ad94bdbf33b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ba2bd22eb049e5b4345ddfb2248f9b, user_id=231eb3b32c924e62b99c1e95195935b2, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:15.154957 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930aac7-281a-4c64-a988-ad94bdbf33b7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:15.159964 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4538c1bc-b171-4c28-b6ab-8176b468d6fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70af437e76914ac58bf7a5d9488f50b2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:15.172329 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4538c1bc-b171-4c28-b6ab-8176b468d6fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70af437e76914ac58bf7a5d9488f50b2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:15.172329 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4538c1bc-b171-4c28-b6ab-8176b468d6fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70af437e76914ac58bf7a5d9488f50b2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:15.188496 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4538c1bc-b171-4c28-b6ab-8176b468d6fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70af437e76914ac58bf7a5d9488f50b2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:15.195607 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 970/1946] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:14 2022] DELETE /identity/v3/users/70af437e76914ac58bf7a5d9488f50b2 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:15.199896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a9c44-1dd8-4d1a-a94d-98ba271595a4 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:15.200365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a9c44-1dd8-4d1a-a94d-98ba271595a4 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:15.200713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2a9c44-1dd8-4d1a-a94d-98ba271595a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:15.220620 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-ab2a9c44-1dd8-4d1a-a94d-98ba271595a4 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:15.222276 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ab2a9c44-1dd8-4d1a-a94d-98ba271595a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:15.284666 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 977/1947] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:15 2022] PUT /identity/v3/projects/26ba2bd22eb049e5b4345ddfb2248f9b/users/231eb3b32c924e62b99c1e95195935b2/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:15.288698 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930aac7-281a-4c64-a988-ad94bdbf33b7 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:15.291569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2930aac7-281a-4c64-a988-ad94bdbf33b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:15.296223 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 971/1948] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:15.309267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a9c44-1dd8-4d1a-a94d-98ba271595a4 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:15.314628 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ab2a9c44-1dd8-4d1a-a94d-98ba271595a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:15.371314 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930aac7-281a-4c64-a988-ad94bdbf33b7 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:15.378597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad637d-322b-4f2d-98f5-0ee2d52b531a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:15.379230 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad637d-322b-4f2d-98f5-0ee2d52b531a admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:15.379519 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2a9c44-1dd8-4d1a-a94d-98ba271595a4 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:15.379647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad637d-322b-4f2d-98f5-0ee2d52b531a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:15.379811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ad637d-322b-4f2d-98f5-0ee2d52b531a admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:15.380543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad637d-322b-4f2d-98f5-0ee2d52b531a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:15.382355 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ad637d-322b-4f2d-98f5-0ee2d52b531a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:15.393780 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 978/1949] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:52:15.398620 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad637d-322b-4f2d-98f5-0ee2d52b531a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:15.421959 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ad637d-322b-4f2d-98f5-0ee2d52b531a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:15.427851 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78150808-ae3c-480b-93db-90c5a452d11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:15.428771 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78150808-ae3c-480b-93db-90c5a452d11c admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:15.429577 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78150808-ae3c-480b-93db-90c5a452d11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:15.429868 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78150808-ae3c-480b-93db-90c5a452d11c admin admin] PATH_INFO: `/v3/projects/26ba2bd22eb049e5b4345ddfb2248f9b/users/231eb3b32c924e62b99c1e95195935b2/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:15.432287 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78150808-ae3c-480b-93db-90c5a452d11c admin admin] RBAC: Authorizing `identity:create_grant(project_id=26ba2bd22eb049e5b4345ddfb2248f9b, user_id=231eb3b32c924e62b99c1e95195935b2, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:15.435849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78150808-ae3c-480b-93db-90c5a452d11c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:15.442508 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63390d27-6eff-4f1d-9578-d25e9ddaf6eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:15.443488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63390d27-6eff-4f1d-9578-d25e9ddaf6eb service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:15.443488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63390d27-6eff-4f1d-9578-d25e9ddaf6eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:15.443779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63390d27-6eff-4f1d-9578-d25e9ddaf6eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:15.447525 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 979/1950] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:15 2022] PUT /identity/v3/projects/26ba2bd22eb049e5b4345ddfb2248f9b/users/231eb3b32c924e62b99c1e95195935b2/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:15.453818 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63390d27-6eff-4f1d-9578-d25e9ddaf6eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:15.455337 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63390d27-6eff-4f1d-9578-d25e9ddaf6eb service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:15.459205 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05609e3-9250-4905-98d9-6c27b9ef2c21 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:15.459501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05609e3-9250-4905-98d9-6c27b9ef2c21 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:15.459782 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05609e3-9250-4905-98d9-6c27b9ef2c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:15.466039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 972/1951] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:15.493430 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e05609e3-9250-4905-98d9-6c27b9ef2c21 None None] MFA Rules not processed for user `231eb3b32c924e62b99c1e95195935b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:15.494923 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e05609e3-9250-4905-98d9-6c27b9ef2c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:15.569102 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 980/1952] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:15.582085 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63390d27-6eff-4f1d-9578-d25e9ddaf6eb service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:15.583793 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-63390d27-6eff-4f1d-9578-d25e9ddaf6eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:15.664666 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63390d27-6eff-4f1d-9578-d25e9ddaf6eb service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:15.724284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57469120-b04d-47c0-91f5-c4f14b9ee862 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:15.724960 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57469120-b04d-47c0-91f5-c4f14b9ee862 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:15.725272 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57469120-b04d-47c0-91f5-c4f14b9ee862 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:15.725550 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57469120-b04d-47c0-91f5-c4f14b9ee862 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:15.737265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57469120-b04d-47c0-91f5-c4f14b9ee862 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:15.739370 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57469120-b04d-47c0-91f5-c4f14b9ee862 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:15.752144 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 973/1953] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:16.098048 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05609e3-9250-4905-98d9-6c27b9ef2c21 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:16.099536 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e05609e3-9250-4905-98d9-6c27b9ef2c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:16.181495 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05609e3-9250-4905-98d9-6c27b9ef2c21 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:16.199907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d9d7a-b9f4-4dd4-bc0e-3d8fcd407c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:16.201979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d9d7a-b9f4-4dd4-bc0e-3d8fcd407c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:16.202279 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d9d7a-b9f4-4dd4-bc0e-3d8fcd407c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:16.202560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d9d7a-b9f4-4dd4-bc0e-3d8fcd407c42 admin admin] PATH_INFO: `/v3/projects/0343e86ee40e499badc4764bc92a6107` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:16.204295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d9d7a-b9f4-4dd4-bc0e-3d8fcd407c42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0343e86ee40e499badc4764bc92a6107)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:16.206668 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d9d7a-b9f4-4dd4-bc0e-3d8fcd407c42 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:16.240653 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57469120-b04d-47c0-91f5-c4f14b9ee862 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:16.242093 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-57469120-b04d-47c0-91f5-c4f14b9ee862 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:16.268249 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57469120-b04d-47c0-91f5-c4f14b9ee862 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:16.289064 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b8206e-563d-49a5-9889-aaf125fa33ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:16.291576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8206e-563d-49a5-9889-aaf125fa33ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:16.306683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8206e-563d-49a5-9889-aaf125fa33ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:16.306683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b8206e-563d-49a5-9889-aaf125fa33ab admin admin] PATH_INFO: `/v3/users/b9a19177208648c9979b870b0d2438bd` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:16.306683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8206e-563d-49a5-9889-aaf125fa33ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9a19177208648c9979b870b0d2438bd)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:16.306683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b8206e-563d-49a5-9889-aaf125fa33ab admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:16.576477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ee4d9d7a-b9f4-4dd4-bc0e-3d8fcd407c42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0343e86ee40e499badc4764bc92a6107', 'request_id': 'req-ee4d9d7a-b9f4-4dd4-bc0e-3d8fcd407c42'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:16.579789 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-24b8206e-563d-49a5-9889-aaf125fa33ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9a19177208648c9979b870b0d2438bd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:16.584127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ee4d9d7a-b9f4-4dd4-bc0e-3d8fcd407c42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0343e86ee40e499badc4764bc92a6107', 'request_id': 'req-ee4d9d7a-b9f4-4dd4-bc0e-3d8fcd407c42'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:16.592231 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ee4d9d7a-b9f4-4dd4-bc0e-3d8fcd407c42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0343e86ee40e499badc4764bc92a6107', 'request_id': 'req-ee4d9d7a-b9f4-4dd4-bc0e-3d8fcd407c42'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:16.771665 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-24b8206e-563d-49a5-9889-aaf125fa33ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9a19177208648c9979b870b0d2438bd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:16.780895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-24b8206e-563d-49a5-9889-aaf125fa33ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9a19177208648c9979b870b0d2438bd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:16.781775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-24b8206e-563d-49a5-9889-aaf125fa33ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9a19177208648c9979b870b0d2438bd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:16.795756 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-24b8206e-563d-49a5-9889-aaf125fa33ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9a19177208648c9979b870b0d2438bd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:16.805879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 974/1954] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:16 2022] DELETE /identity/v3/users/b9a19177208648c9979b870b0d2438bd => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:16.814286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4475bf-52b6-429f-989a-c2550d335303 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:16.814581 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4475bf-52b6-429f-989a-c2550d335303 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:16.814859 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4475bf-52b6-429f-989a-c2550d335303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:16.835728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:16.838069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-ee4475bf-52b6-429f-989a-c2550d335303 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:16.839625 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ee4475bf-52b6-429f-989a-c2550d335303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:16.892744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ee4d9d7a-b9f4-4dd4-bc0e-3d8fcd407c42 admin admin] The token cache is being invalidate because project 0343e86ee40e499badc4764bc92a6107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:16.892981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ee4d9d7a-b9f4-4dd4-bc0e-3d8fcd407c42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:16.893913 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ee4d9d7a-b9f4-4dd4-bc0e-3d8fcd407c42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:16.897071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 981/1955] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:16 2022] DELETE /identity/v3/projects/0343e86ee40e499badc4764bc92a6107 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:16.901272 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e6a1b-88ca-476b-808a-c795ece564f4 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:16.901729 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e6a1b-88ca-476b-808a-c795ece564f4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:16.902198 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e6a1b-88ca-476b-808a-c795ece564f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:16.914647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 975/1956] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:16.926810 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4475bf-52b6-429f-989a-c2550d335303 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:16.928871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ee4475bf-52b6-429f-989a-c2550d335303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:16.932260 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b93e6a1b-88ca-476b-808a-c795ece564f4 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:16.933669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b93e6a1b-88ca-476b-808a-c795ece564f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:16.953172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 982/1957] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:16.963630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015815e-9965-4b61-b12d-1b65e6cbec06 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:16.963630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015815e-9965-4b61-b12d-1b65e6cbec06 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:16.963630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5015815e-9965-4b61-b12d-1b65e6cbec06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:16.994217 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5015815e-9965-4b61-b12d-1b65e6cbec06 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:16.995467 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5015815e-9965-4b61-b12d-1b65e6cbec06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:17.008884 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 983/1958] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:17.010067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015815e-9965-4b61-b12d-1b65e6cbec06 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:17.014870 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5015815e-9965-4b61-b12d-1b65e6cbec06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:17.028407 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5015815e-9965-4b61-b12d-1b65e6cbec06 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:17.034209 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e03e8e-d97a-45cf-b373-2c59ec9ceb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:17.035750 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e03e8e-d97a-45cf-b373-2c59ec9ceb46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:17.036207 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e03e8e-d97a-45cf-b373-2c59ec9ceb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:17.036642 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e03e8e-d97a-45cf-b373-2c59ec9ceb46 admin admin] PATH_INFO: `/v3/users/dd39c172892e4d1d8ba077b0f9d8da38` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:17.038485 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e03e8e-d97a-45cf-b373-2c59ec9ceb46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd39c172892e4d1d8ba077b0f9d8da38)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:17.042640 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e03e8e-d97a-45cf-b373-2c59ec9ceb46 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:17.049888 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4475bf-52b6-429f-989a-c2550d335303 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:17.056733 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93198184-1b37-483f-a3fc-7492a636f00b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:17.059207 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93198184-1b37-483f-a3fc-7492a636f00b service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:17.059207 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93198184-1b37-483f-a3fc-7492a636f00b service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:17.059207 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93198184-1b37-483f-a3fc-7492a636f00b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:17.073177 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93198184-1b37-483f-a3fc-7492a636f00b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:17.075420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93198184-1b37-483f-a3fc-7492a636f00b service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:17.089487 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 976/1959] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:52:17.090709 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93198184-1b37-483f-a3fc-7492a636f00b service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:17.106628 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93198184-1b37-483f-a3fc-7492a636f00b service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:17.113785 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632836ea-dc1d-48c5-9f05-393f043a2335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:17.114850 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632836ea-dc1d-48c5-9f05-393f043a2335 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:17.115141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632836ea-dc1d-48c5-9f05-393f043a2335 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:17.115413 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632836ea-dc1d-48c5-9f05-393f043a2335 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:17.116158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632836ea-dc1d-48c5-9f05-393f043a2335 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:52:17.116467 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632836ea-dc1d-48c5-9f05-393f043a2335 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:17.118233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632836ea-dc1d-48c5-9f05-393f043a2335 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:17.133877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 977/1960] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:52:17.138504 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632836ea-dc1d-48c5-9f05-393f043a2335 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:17.155336 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632836ea-dc1d-48c5-9f05-393f043a2335 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:17.162444 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5ad3b-e773-413f-b6f3-8260cac4d920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:17.163473 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5ad3b-e773-413f-b6f3-8260cac4d920 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:17.163473 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5ad3b-e773-413f-b6f3-8260cac4d920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:17.164264 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac5ad3b-e773-413f-b6f3-8260cac4d920 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:17.165030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5ad3b-e773-413f-b6f3-8260cac4d920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:17.173679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac5ad3b-e773-413f-b6f3-8260cac4d920 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:17.367262 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 978/1961] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:17 2022] POST /identity/v3/projects => generated 371 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:17.368888 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5ad3b-e773-413f-b6f3-8260cac4d920 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:17.393757 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:17.429668 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f0e03e8e-d97a-45cf-b373-2c59ec9ceb46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd39c172892e4d1d8ba077b0f9d8da38'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:17.514816 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac5ad3b-e773-413f-b6f3-8260cac4d920 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:17.522796 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89384b03-c5a3-43be-b633-531a0c262d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:17.524449 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89384b03-c5a3-43be-b633-531a0c262d16 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:17.526427 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89384b03-c5a3-43be-b633-531a0c262d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:17.526427 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89384b03-c5a3-43be-b633-531a0c262d16 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:17.526427 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89384b03-c5a3-43be-b633-531a0c262d16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:17.528941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89384b03-c5a3-43be-b633-531a0c262d16 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:17.580469 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f0e03e8e-d97a-45cf-b373-2c59ec9ceb46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd39c172892e4d1d8ba077b0f9d8da38'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:17.590552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f0e03e8e-d97a-45cf-b373-2c59ec9ceb46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd39c172892e4d1d8ba077b0f9d8da38'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:17.591696 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f0e03e8e-d97a-45cf-b373-2c59ec9ceb46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd39c172892e4d1d8ba077b0f9d8da38'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:17.608024 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f0e03e8e-d97a-45cf-b373-2c59ec9ceb46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd39c172892e4d1d8ba077b0f9d8da38'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:17.616773 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 984/1962] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:17 2022] DELETE /identity/v3/users/dd39c172892e4d1d8ba077b0f9d8da38 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:17.618070 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e03e8e-d97a-45cf-b373-2c59ec9ceb46 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:17.622103 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f0e03e8e-d97a-45cf-b373-2c59ec9ceb46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:17.698768 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 979/1963] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:17 2022] POST /identity/v3/users => generated 286 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:17.701059 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cc4d1-9d61-4924-8e8c-1f038927a3a4 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:17.701437 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cc4d1-9d61-4924-8e8c-1f038927a3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:17.702306 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316cc4d1-9d61-4924-8e8c-1f038927a3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:17.721569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e03e8e-d97a-45cf-b373-2c59ec9ceb46 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:17.726366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ea059-5ff4-4bed-b314-4e9501158119 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:17.727306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ea059-5ff4-4bed-b314-4e9501158119 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:17.727545 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-316cc4d1-9d61-4924-8e8c-1f038927a3a4 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:17.727936 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ea059-5ff4-4bed-b314-4e9501158119 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:17.728211 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ea059-5ff4-4bed-b314-4e9501158119 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:17.730211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-316cc4d1-9d61-4924-8e8c-1f038927a3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:17.730805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-230ea059-5ff4-4bed-b314-4e9501158119 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:17.802907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ea059-5ff4-4bed-b314-4e9501158119 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:17.804756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ea059-5ff4-4bed-b314-4e9501158119 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:17.816894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 980/1965] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:17.817094 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 985/1965] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:17.818134 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cc4d1-9d61-4924-8e8c-1f038927a3a4 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:17.826832 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-316cc4d1-9d61-4924-8e8c-1f038927a3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:17.827209 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ea059-5ff4-4bed-b314-4e9501158119 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:17.830335 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-230ea059-5ff4-4bed-b314-4e9501158119 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:17.840423 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316cc4d1-9d61-4924-8e8c-1f038927a3a4 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:17.850927 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90476e63-0986-46f0-a186-5b4ba14f8d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:17.851997 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90476e63-0986-46f0-a186-5b4ba14f8d18 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:17.852445 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90476e63-0986-46f0-a186-5b4ba14f8d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:17.852734 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90476e63-0986-46f0-a186-5b4ba14f8d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:17.853647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90476e63-0986-46f0-a186-5b4ba14f8d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:17.855688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90476e63-0986-46f0-a186-5b4ba14f8d18 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:17.883462 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 981/1966] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:17.884938 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90476e63-0986-46f0-a186-5b4ba14f8d18 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:17.910311 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90476e63-0986-46f0-a186-5b4ba14f8d18 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:17.918979 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce9fa1-5f94-4b9e-9a5f-6a8b2eff47ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:17.919962 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce9fa1-5f94-4b9e-9a5f-6a8b2eff47ea admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:17.920318 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce9fa1-5f94-4b9e-9a5f-6a8b2eff47ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:17.920666 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce9fa1-5f94-4b9e-9a5f-6a8b2eff47ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:17.921564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce9fa1-5f94-4b9e-9a5f-6a8b2eff47ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:17.923274 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce9fa1-5f94-4b9e-9a5f-6a8b2eff47ea admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:17.923980 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ea059-5ff4-4bed-b314-4e9501158119 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:17.930558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4284d6f-9f5f-4612-a8ae-95a9da14c99f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:17.931338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4284d6f-9f5f-4612-a8ae-95a9da14c99f service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:17.931698 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4284d6f-9f5f-4612-a8ae-95a9da14c99f service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:17.932053 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4284d6f-9f5f-4612-a8ae-95a9da14c99f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:17.938604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 982/1967] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:17.939631 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce9fa1-5f94-4b9e-9a5f-6a8b2eff47ea admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:17.942987 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-dfce9fa1-5f94-4b9e-9a5f-6a8b2eff47ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:17.956957 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4284d6f-9f5f-4612-a8ae-95a9da14c99f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:17.958468 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4284d6f-9f5f-4612-a8ae-95a9da14c99f service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:17.962540 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce9fa1-5f94-4b9e-9a5f-6a8b2eff47ea admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:17.971329 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 986/1968] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:52:17.971704 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80395b07-c58d-4a95-b6b5-2a0638877c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:17.972179 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4284d6f-9f5f-4612-a8ae-95a9da14c99f service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:17.973028 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80395b07-c58d-4a95-b6b5-2a0638877c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:17.973515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80395b07-c58d-4a95-b6b5-2a0638877c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:17.973888 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80395b07-c58d-4a95-b6b5-2a0638877c85 admin admin] PATH_INFO: `/v3/projects/ad3604d129e4415ebfc1cf7dfb840b4f` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:17.976018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80395b07-c58d-4a95-b6b5-2a0638877c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad3604d129e4415ebfc1cf7dfb840b4f)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:17.978425 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80395b07-c58d-4a95-b6b5-2a0638877c85 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:17.982573 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4284d6f-9f5f-4612-a8ae-95a9da14c99f service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:17.987785 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e413b-f5ff-41a6-bd38-6dc5ddbd2d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:17.988754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e413b-f5ff-41a6-bd38-6dc5ddbd2d5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:17.991090 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e413b-f5ff-41a6-bd38-6dc5ddbd2d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:17.991090 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e413b-f5ff-41a6-bd38-6dc5ddbd2d5f admin admin] PATH_INFO: `/v3/projects/8ece88657fac40ca868fb895890aa06a/users/4541981b72094f2c94a501aacfe0f6cd/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:18.007218 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e413b-f5ff-41a6-bd38-6dc5ddbd2d5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ece88657fac40ca868fb895890aa06a, user_id=4541981b72094f2c94a501aacfe0f6cd, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:18.010085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e413b-f5ff-41a6-bd38-6dc5ddbd2d5f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:18.097236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:18.169376 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 987/1969] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:17 2022] PUT /identity/v3/projects/8ece88657fac40ca868fb895890aa06a/users/4541981b72094f2c94a501aacfe0f6cd/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:18.180481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8cc71-c7e1-433a-b9f4-703b0e13d61f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:18.180793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8cc71-c7e1-433a-b9f4-703b0e13d61f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:18.181439 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd8cc71-c7e1-433a-b9f4-703b0e13d61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:18.197355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-80395b07-c58d-4a95-b6b5-2a0638877c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad3604d129e4415ebfc1cf7dfb840b4f', 'request_id': 'req-80395b07-c58d-4a95-b6b5-2a0638877c85'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:18.216247 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6bd8cc71-c7e1-433a-b9f4-703b0e13d61f None None] MFA Rules not processed for user `4541981b72094f2c94a501aacfe0f6cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:18.217540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6bd8cc71-c7e1-433a-b9f4-703b0e13d61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:18.225170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-80395b07-c58d-4a95-b6b5-2a0638877c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad3604d129e4415ebfc1cf7dfb840b4f', 'request_id': 'req-80395b07-c58d-4a95-b6b5-2a0638877c85'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:18.235844 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-80395b07-c58d-4a95-b6b5-2a0638877c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad3604d129e4415ebfc1cf7dfb840b4f', 'request_id': 'req-80395b07-c58d-4a95-b6b5-2a0638877c85'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:18.332581 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 988/1970] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:18.353342 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8cc71-c7e1-433a-b9f4-703b0e13d61f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:18.355356 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-80395b07-c58d-4a95-b6b5-2a0638877c85 admin admin] The token cache is being invalidate because project ad3604d129e4415ebfc1cf7dfb840b4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:18.355885 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-80395b07-c58d-4a95-b6b5-2a0638877c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:18.356799 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-80395b07-c58d-4a95-b6b5-2a0638877c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:18.360279 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 983/1971] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:17 2022] DELETE /identity/v3/projects/ad3604d129e4415ebfc1cf7dfb840b4f => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:18.363319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6bd8cc71-c7e1-433a-b9f4-703b0e13d61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:18.366105 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80395b07-c58d-4a95-b6b5-2a0638877c85 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:18.368720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-80395b07-c58d-4a95-b6b5-2a0638877c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:18.452977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd8cc71-c7e1-433a-b9f4-703b0e13d61f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:18.454269 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80395b07-c58d-4a95-b6b5-2a0638877c85 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:18.458079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097e97e-5a6d-4e67-80ca-59830b821e15 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e1900754214020931b202e98f660a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:18.458868 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097e97e-5a6d-4e67-80ca-59830b821e15 service glance] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:18.459159 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097e97e-5a6d-4e67-80ca-59830b821e15 service glance] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:18.459447 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097e97e-5a6d-4e67-80ca-59830b821e15 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:18.460246 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779108d-8c7d-4725-aabd-1fc94e12e726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:18.461840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b097e97e-5a6d-4e67-80ca-59830b821e15 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:18.462526 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779108d-8c7d-4725-aabd-1fc94e12e726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:18.463045 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779108d-8c7d-4725-aabd-1fc94e12e726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:18.463384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779108d-8c7d-4725-aabd-1fc94e12e726 admin admin] PATH_INFO: `/v3/users/802a2b8f19364b5a9c8d03a639618114` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:18.465042 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779108d-8c7d-4725-aabd-1fc94e12e726 admin admin] RBAC: Authorizing `identity:delete_user(user_id=802a2b8f19364b5a9c8d03a639618114)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:18.472555 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779108d-8c7d-4725-aabd-1fc94e12e726 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:18.474753 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097e97e-5a6d-4e67-80ca-59830b821e15 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:18.476513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097e97e-5a6d-4e67-80ca-59830b821e15 service glance] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:18.490640 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 989/1972] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:18.601367 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097e97e-5a6d-4e67-80ca-59830b821e15 service glance] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:18.603067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b097e97e-5a6d-4e67-80ca-59830b821e15 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:18.626050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097e97e-5a6d-4e67-80ca-59830b821e15 service glance] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:18.637794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb53d7-c9a0-4b89-a143-f5a0b054e0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:18.638683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb53d7-c9a0-4b89-a143-f5a0b054e0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:18.638968 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb53d7-c9a0-4b89-a143-f5a0b054e0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:18.639244 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb53d7-c9a0-4b89-a143-f5a0b054e0ab admin admin] PATH_INFO: `/v3/projects/dad10c31a19e4c1cb36c835bbc13e91f` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:18.645462 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb53d7-c9a0-4b89-a143-f5a0b054e0ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=dad10c31a19e4c1cb36c835bbc13e91f)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:18.647540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb53d7-c9a0-4b89-a143-f5a0b054e0ab admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:18.768426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9779108d-8c7d-4725-aabd-1fc94e12e726 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '802a2b8f19364b5a9c8d03a639618114'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:18.816362 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a3eb53d7-c9a0-4b89-a143-f5a0b054e0ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dad10c31a19e4c1cb36c835bbc13e91f', 'request_id': 'req-a3eb53d7-c9a0-4b89-a143-f5a0b054e0ab'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:18.827341 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a3eb53d7-c9a0-4b89-a143-f5a0b054e0ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dad10c31a19e4c1cb36c835bbc13e91f', 'request_id': 'req-a3eb53d7-c9a0-4b89-a143-f5a0b054e0ab'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:18.849363 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a3eb53d7-c9a0-4b89-a143-f5a0b054e0ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dad10c31a19e4c1cb36c835bbc13e91f', 'request_id': 'req-a3eb53d7-c9a0-4b89-a143-f5a0b054e0ab'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:18.850646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9779108d-8c7d-4725-aabd-1fc94e12e726 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '802a2b8f19364b5a9c8d03a639618114'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:18.866031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9779108d-8c7d-4725-aabd-1fc94e12e726 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '802a2b8f19364b5a9c8d03a639618114'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:18.867341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9779108d-8c7d-4725-aabd-1fc94e12e726 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '802a2b8f19364b5a9c8d03a639618114'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:18.888929 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9779108d-8c7d-4725-aabd-1fc94e12e726 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '802a2b8f19364b5a9c8d03a639618114'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:18.898195 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 984/1973] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:18 2022] DELETE /identity/v3/users/802a2b8f19364b5a9c8d03a639618114 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:19.049979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a3eb53d7-c9a0-4b89-a143-f5a0b054e0ab admin admin] The token cache is being invalidate because project dad10c31a19e4c1cb36c835bbc13e91f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:19.049979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a3eb53d7-c9a0-4b89-a143-f5a0b054e0ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:19.049979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a3eb53d7-c9a0-4b89-a143-f5a0b054e0ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:19.049979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 990/1974] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:18 2022] DELETE /identity/v3/projects/dad10c31a19e4c1cb36c835bbc13e91f => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:19.050833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779108d-8c7d-4725-aabd-1fc94e12e726 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:19.054709 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9779108d-8c7d-4725-aabd-1fc94e12e726 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:19.129502 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779108d-8c7d-4725-aabd-1fc94e12e726 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:19.134873 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ca4ed1-5103-44fb-ba33-e1803ab4f803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:19.135742 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca4ed1-5103-44fb-ba33-e1803ab4f803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:19.136026 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca4ed1-5103-44fb-ba33-e1803ab4f803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:19.136311 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ca4ed1-5103-44fb-ba33-e1803ab4f803 admin admin] PATH_INFO: `/v3/users/32a4ee6b5d794e43b795af512a46ff1f` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:19.137573 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca4ed1-5103-44fb-ba33-e1803ab4f803 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a4ee6b5d794e43b795af512a46ff1f)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:19.139510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ca4ed1-5103-44fb-ba33-e1803ab4f803 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:19.689390 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f4ca4ed1-5103-44fb-ba33-e1803ab4f803 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a4ee6b5d794e43b795af512a46ff1f'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:19.794454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f4ca4ed1-5103-44fb-ba33-e1803ab4f803 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a4ee6b5d794e43b795af512a46ff1f'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:19.804448 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f4ca4ed1-5103-44fb-ba33-e1803ab4f803 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a4ee6b5d794e43b795af512a46ff1f'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:19.805328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f4ca4ed1-5103-44fb-ba33-e1803ab4f803 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a4ee6b5d794e43b795af512a46ff1f'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:19.843559 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f4ca4ed1-5103-44fb-ba33-e1803ab4f803 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a4ee6b5d794e43b795af512a46ff1f'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:19.850397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 985/1975] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:19 2022] DELETE /identity/v3/users/32a4ee6b5d794e43b795af512a46ff1f => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:19.941125 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb53d7-c9a0-4b89-a143-f5a0b054e0ab admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:19.942905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a3eb53d7-c9a0-4b89-a143-f5a0b054e0ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:20.037417 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb53d7-c9a0-4b89-a143-f5a0b054e0ab admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:20.128088 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaca337-8330-49fc-ad63-37033071e53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:20.129170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaca337-8330-49fc-ad63-37033071e53c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:20.129533 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaca337-8330-49fc-ad63-37033071e53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:20.130164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaca337-8330-49fc-ad63-37033071e53c admin admin] PATH_INFO: `/v3/projects/6284aeb239e5449cb822bf0c3fecaa1b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:20.131751 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaca337-8330-49fc-ad63-37033071e53c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6284aeb239e5449cb822bf0c3fecaa1b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:20.134067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaca337-8330-49fc-ad63-37033071e53c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:20.307006 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9aaca337-8330-49fc-ad63-37033071e53c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6284aeb239e5449cb822bf0c3fecaa1b', 'request_id': 'req-9aaca337-8330-49fc-ad63-37033071e53c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:20.314821 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9aaca337-8330-49fc-ad63-37033071e53c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6284aeb239e5449cb822bf0c3fecaa1b', 'request_id': 'req-9aaca337-8330-49fc-ad63-37033071e53c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:20.325215 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9aaca337-8330-49fc-ad63-37033071e53c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6284aeb239e5449cb822bf0c3fecaa1b', 'request_id': 'req-9aaca337-8330-49fc-ad63-37033071e53c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:20.437865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9aaca337-8330-49fc-ad63-37033071e53c admin admin] The token cache is being invalidate because project 6284aeb239e5449cb822bf0c3fecaa1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:20.438542 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9aaca337-8330-49fc-ad63-37033071e53c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:20.439222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9aaca337-8330-49fc-ad63-37033071e53c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:20.441115 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 991/1976] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:19 2022] DELETE /identity/v3/projects/6284aeb239e5449cb822bf0c3fecaa1b => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:20.446964 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2f60a-5fc3-401b-bcac-7dceba4e3f87 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:20.447238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2f60a-5fc3-401b-bcac-7dceba4e3f87 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:20.447523 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e2f60a-5fc3-401b-bcac-7dceba4e3f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:20.466019 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e8e2f60a-5fc3-401b-bcac-7dceba4e3f87 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:20.467241 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e8e2f60a-5fc3-401b-bcac-7dceba4e3f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:20.529204 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 986/1977] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:20.540282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caf08a-6ad2-4739-9464-dd364c1a0c7a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:20.540579 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caf08a-6ad2-4739-9464-dd364c1a0c7a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:20.540862 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caf08a-6ad2-4739-9464-dd364c1a0c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:20.560769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-44caf08a-6ad2-4739-9464-dd364c1a0c7a None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:20.562118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-44caf08a-6ad2-4739-9464-dd364c1a0c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:20.572329 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2f60a-5fc3-401b-bcac-7dceba4e3f87 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:20.573976 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e8e2f60a-5fc3-401b-bcac-7dceba4e3f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:20.578590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 992/1978] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:20.580305 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caf08a-6ad2-4739-9464-dd364c1a0c7a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:20.590135 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e2f60a-5fc3-401b-bcac-7dceba4e3f87 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:20.597665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caf08a-6ad2-4739-9464-dd364c1a0c7a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:20.603675 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5598f-48db-45d6-bda1-d5c5770c8a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:20.605433 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5598f-48db-45d6-bda1-d5c5770c8a35 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:20.614414 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5598f-48db-45d6-bda1-d5c5770c8a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:20.614550 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1288d-2b1c-44c8-bd23-f5ce992c0f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:20.614664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5598f-48db-45d6-bda1-d5c5770c8a35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:20.614664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5598f-48db-45d6-bda1-d5c5770c8a35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:52:20.614875 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1288d-2b1c-44c8-bd23-f5ce992c0f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:20.614970 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5598f-48db-45d6-bda1-d5c5770c8a35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:20.615061 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1288d-2b1c-44c8-bd23-f5ce992c0f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:20.615061 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1288d-2b1c-44c8-bd23-f5ce992c0f60 admin admin] PATH_INFO: `/v3/projects/590fd46f4e7b46eb9e250ee10955cec2` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:20.615061 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1288d-2b1c-44c8-bd23-f5ce992c0f60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=590fd46f4e7b46eb9e250ee10955cec2)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:20.615317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5598f-48db-45d6-bda1-d5c5770c8a35 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:20.615407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1288d-2b1c-44c8-bd23-f5ce992c0f60 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:20.626190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 993/1979] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:52:20.630694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5598f-48db-45d6-bda1-d5c5770c8a35 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:20.634571 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:20.641226 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5598f-48db-45d6-bda1-d5c5770c8a35 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:20.646245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71f1d6-4bb0-4118-9239-d6dda1f04c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:20.646909 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71f1d6-4bb0-4118-9239-d6dda1f04c07 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:20.647197 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71f1d6-4bb0-4118-9239-d6dda1f04c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:20.647472 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71f1d6-4bb0-4118-9239-d6dda1f04c07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:20.648171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71f1d6-4bb0-4118-9239-d6dda1f04c07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:20.650235 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb71f1d6-4bb0-4118-9239-d6dda1f04c07 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:20.845799 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a6f1288d-2b1c-44c8-bd23-f5ce992c0f60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '590fd46f4e7b46eb9e250ee10955cec2', 'request_id': 'req-a6f1288d-2b1c-44c8-bd23-f5ce992c0f60'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:20.851511 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a6f1288d-2b1c-44c8-bd23-f5ce992c0f60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '590fd46f4e7b46eb9e250ee10955cec2', 'request_id': 'req-a6f1288d-2b1c-44c8-bd23-f5ce992c0f60'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:20.859790 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a6f1288d-2b1c-44c8-bd23-f5ce992c0f60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '590fd46f4e7b46eb9e250ee10955cec2', 'request_id': 'req-a6f1288d-2b1c-44c8-bd23-f5ce992c0f60'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:20.893987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 994/1980] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:20 2022] POST /identity/v3/projects => generated 375 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:20.898442 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71f1d6-4bb0-4118-9239-d6dda1f04c07 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:20.996408 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb71f1d6-4bb0-4118-9239-d6dda1f04c07 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:21.005222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc400d1-6bf5-44fc-b75b-bddac7da33a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:21.006109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc400d1-6bf5-44fc-b75b-bddac7da33a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:21.006403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc400d1-6bf5-44fc-b75b-bddac7da33a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:21.007175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc400d1-6bf5-44fc-b75b-bddac7da33a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:21.008073 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc400d1-6bf5-44fc-b75b-bddac7da33a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:21.010074 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc400d1-6bf5-44fc-b75b-bddac7da33a0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:21.014003 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a6f1288d-2b1c-44c8-bd23-f5ce992c0f60 admin admin] The token cache is being invalidate because project 590fd46f4e7b46eb9e250ee10955cec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:21.015468 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a6f1288d-2b1c-44c8-bd23-f5ce992c0f60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:21.016602 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a6f1288d-2b1c-44c8-bd23-f5ce992c0f60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:21.019714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 987/1981] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:20 2022] DELETE /identity/v3/projects/590fd46f4e7b46eb9e250ee10955cec2 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:21.025056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799a9ad-252e-49b1-9fbc-63112b9b7991 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:21.025506 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799a9ad-252e-49b1-9fbc-63112b9b7991 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:21.025615 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799a9ad-252e-49b1-9fbc-63112b9b7991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:21.043942 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:21.055662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d799a9ad-252e-49b1-9fbc-63112b9b7991 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:21.057262 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d799a9ad-252e-49b1-9fbc-63112b9b7991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:21.077175 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 988/1982] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:21.079598 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a4093-e0c5-4ee9-8570-2c166d66f2a9 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:21.079892 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a4093-e0c5-4ee9-8570-2c166d66f2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:21.080164 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a4093-e0c5-4ee9-8570-2c166d66f2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:21.102896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-9f6a4093-e0c5-4ee9-8570-2c166d66f2a9 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:21.104131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9f6a4093-e0c5-4ee9-8570-2c166d66f2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:21.115489 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 989/1983] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:21.120903 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a4093-e0c5-4ee9-8570-2c166d66f2a9 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:21.133663 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a4093-e0c5-4ee9-8570-2c166d66f2a9 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:21.142926 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d42e83-60b4-4390-a31c-6053ca69d2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:21.143685 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d42e83-60b4-4390-a31c-6053ca69d2ee admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:21.144168 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d42e83-60b4-4390-a31c-6053ca69d2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:21.144465 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d42e83-60b4-4390-a31c-6053ca69d2ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:21.145384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d42e83-60b4-4390-a31c-6053ca69d2ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:52:21.145990 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d42e83-60b4-4390-a31c-6053ca69d2ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:21.147811 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d42e83-60b4-4390-a31c-6053ca69d2ee admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:21.163208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 990/1984] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:52:21.168429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d42e83-60b4-4390-a31c-6053ca69d2ee admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:21.184963 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d42e83-60b4-4390-a31c-6053ca69d2ee admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:21.185739 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 995/1985] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:20 2022] POST /identity/v3/users => generated 288 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:21.192494 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc400d1-6bf5-44fc-b75b-bddac7da33a0 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:21.196366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8bc400d1-6bf5-44fc-b75b-bddac7da33a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:21.199377 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e76a2-3063-4185-a300-0f54017462b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:21.200205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e76a2-3063-4185-a300-0f54017462b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:21.200487 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e76a2-3063-4185-a300-0f54017462b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:21.200835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535e76a2-3063-4185-a300-0f54017462b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:21.202010 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e76a2-3063-4185-a300-0f54017462b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:21.208309 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535e76a2-3063-4185-a300-0f54017462b8 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:21.218199 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc400d1-6bf5-44fc-b75b-bddac7da33a0 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:21.227559 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bddf73-cf84-4774-964c-0fd5a7e03497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:21.228319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bddf73-cf84-4774-964c-0fd5a7e03497 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:21.238632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bddf73-cf84-4774-964c-0fd5a7e03497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:21.238632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bddf73-cf84-4774-964c-0fd5a7e03497 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:21.238632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bddf73-cf84-4774-964c-0fd5a7e03497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:21.238632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bddf73-cf84-4774-964c-0fd5a7e03497 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:21.246213 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 996/1986] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:21.252694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bddf73-cf84-4774-964c-0fd5a7e03497 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:21.267519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bddf73-cf84-4774-964c-0fd5a7e03497 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:21.273620 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58a889-ec1a-482c-be3e-7a8dd42e2803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:21.274471 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58a889-ec1a-482c-be3e-7a8dd42e2803 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:21.274839 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58a889-ec1a-482c-be3e-7a8dd42e2803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:21.275200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58a889-ec1a-482c-be3e-7a8dd42e2803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:21.276546 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58a889-ec1a-482c-be3e-7a8dd42e2803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:21.277803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58a889-ec1a-482c-be3e-7a8dd42e2803 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:21.297288 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 997/1987] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:21.306483 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58a889-ec1a-482c-be3e-7a8dd42e2803 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:21.322447 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58a889-ec1a-482c-be3e-7a8dd42e2803 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:21.329193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613d72b-c367-4ebc-9406-14c6da4ba6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:21.330210 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613d72b-c367-4ebc-9406-14c6da4ba6b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:21.330645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613d72b-c367-4ebc-9406-14c6da4ba6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:21.331292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613d72b-c367-4ebc-9406-14c6da4ba6b1 admin admin] PATH_INFO: `/v3/projects/264cdc1d6af24231865ba37dfff07341/users/faaa6948f5d844099002b4fb690b7423/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:21.361764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 991/1988] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:21 2022] POST /identity/v3/projects => generated 379 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:21.368148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613d72b-c367-4ebc-9406-14c6da4ba6b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=264cdc1d6af24231865ba37dfff07341, user_id=faaa6948f5d844099002b4fb690b7423, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:21.372383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e76a2-3063-4185-a300-0f54017462b8 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:21.375013 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613d72b-c367-4ebc-9406-14c6da4ba6b1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:21.481554 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535e76a2-3063-4185-a300-0f54017462b8 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:21.481988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 998/1989] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:21 2022] PUT /identity/v3/projects/264cdc1d6af24231865ba37dfff07341/users/faaa6948f5d844099002b4fb690b7423/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:21.494482 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fe1d2-f4cb-4f75-9ba3-6ba560a12c7b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:21.494577 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fe1d2-f4cb-4f75-9ba3-6ba560a12c7b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:21.494869 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fe1d2-f4cb-4f75-9ba3-6ba560a12c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:21.536037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-340fe1d2-f4cb-4f75-9ba3-6ba560a12c7b None None] MFA Rules not processed for user `faaa6948f5d844099002b4fb690b7423`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:21.538274 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-340fe1d2-f4cb-4f75-9ba3-6ba560a12c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:21.558579 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ff7ab-0e16-4c20-87f4-b1b7f3cc2df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:21.559523 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff7ab-0e16-4c20-87f4-b1b7f3cc2df7 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:21.560408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff7ab-0e16-4c20-87f4-b1b7f3cc2df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:21.560408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff7ab-0e16-4c20-87f4-b1b7f3cc2df7 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:21.561161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ff7ab-0e16-4c20-87f4-b1b7f3cc2df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:21.563837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ff7ab-0e16-4c20-87f4-b1b7f3cc2df7 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:21.637774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 999/1990] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:21.651971 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fe1d2-f4cb-4f75-9ba3-6ba560a12c7b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:21.654449 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-340fe1d2-f4cb-4f75-9ba3-6ba560a12c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:21.681907 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 992/1991] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:21 2022] POST /identity/v3/users => generated 290 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:21.682924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ff7ab-0e16-4c20-87f4-b1b7f3cc2df7 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:21.697606 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ff7ab-0e16-4c20-87f4-b1b7f3cc2df7 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:21.703126 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e52df-26bc-4a8f-9e1e-ed3a3d50e6d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:21.704115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e52df-26bc-4a8f-9e1e-ed3a3d50e6d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:21.704409 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e52df-26bc-4a8f-9e1e-ed3a3d50e6d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:21.705085 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e52df-26bc-4a8f-9e1e-ed3a3d50e6d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:21.705481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e52df-26bc-4a8f-9e1e-ed3a3d50e6d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:21.707105 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e52df-26bc-4a8f-9e1e-ed3a3d50e6d9 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:21.717984 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 993/1992] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:21.723490 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e52df-26bc-4a8f-9e1e-ed3a3d50e6d9 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:21.738927 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e52df-26bc-4a8f-9e1e-ed3a3d50e6d9 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:21.739259 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fe1d2-f4cb-4f75-9ba3-6ba560a12c7b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:21.743574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be54660-3d24-44f4-84bd-284a182902d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:21.744708 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be54660-3d24-44f4-84bd-284a182902d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:21.744995 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f396b3-9e97-470d-828a-21df14164462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:21.754575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be54660-3d24-44f4-84bd-284a182902d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:21.754575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be54660-3d24-44f4-84bd-284a182902d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:21.754791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f396b3-9e97-470d-828a-21df14164462 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:21.754791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f396b3-9e97-470d-828a-21df14164462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:21.754791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f396b3-9e97-470d-828a-21df14164462 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:21.754791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f396b3-9e97-470d-828a-21df14164462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:21.754791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f396b3-9e97-470d-828a-21df14164462 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:21.757800 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be54660-3d24-44f4-84bd-284a182902d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:21.759502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be54660-3d24-44f4-84bd-284a182902d6 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:21.765099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 994/1993] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:21.771443 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1000/1994] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:52:21.771723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f396b3-9e97-470d-828a-21df14164462 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:21.783892 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f396b3-9e97-470d-828a-21df14164462 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:21.788792 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d502e-b0d7-4f7e-821f-d98b61b53e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:21.789734 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d502e-b0d7-4f7e-821f-d98b61b53e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:21.790022 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d502e-b0d7-4f7e-821f-d98b61b53e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:21.790298 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917d502e-b0d7-4f7e-821f-d98b61b53e6e admin admin] PATH_INFO: `/v3/projects/8ddd72d79ed1446a94276e9196a34671/users/e3341ef0387b4c2ba90ac0d13f9faae7/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:21.807504 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d502e-b0d7-4f7e-821f-d98b61b53e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ddd72d79ed1446a94276e9196a34671, user_id=e3341ef0387b4c2ba90ac0d13f9faae7, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:21.810286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917d502e-b0d7-4f7e-821f-d98b61b53e6e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:21.896118 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 995/1995] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:21 2022] PUT /identity/v3/projects/8ddd72d79ed1446a94276e9196a34671/users/e3341ef0387b4c2ba90ac0d13f9faae7/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:21.907600 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e52ee-304e-4306-8d97-a971229dd610 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:21.907895 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e52ee-304e-4306-8d97-a971229dd610 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:21.908201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36e52ee-304e-4306-8d97-a971229dd610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:21.946222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a36e52ee-304e-4306-8d97-a971229dd610 None None] MFA Rules not processed for user `e3341ef0387b4c2ba90ac0d13f9faae7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:21.949344 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a36e52ee-304e-4306-8d97-a971229dd610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:22.062805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1001/1996] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:22.070070 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d502e-b0d7-4f7e-821f-d98b61b53e6e admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:22.142492 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917d502e-b0d7-4f7e-821f-d98b61b53e6e admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:22.149790 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a329be3-f961-411c-b613-9fe3a4325e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:22.150477 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a329be3-f961-411c-b613-9fe3a4325e95 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:22.150763 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a329be3-f961-411c-b613-9fe3a4325e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:22.151044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a329be3-f961-411c-b613-9fe3a4325e95 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:22.151906 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a329be3-f961-411c-b613-9fe3a4325e95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:22.153996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a329be3-f961-411c-b613-9fe3a4325e95 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:22.310979 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 996/1997] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:22 2022] POST /identity/v3/projects => generated 379 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:22.316028 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e52ee-304e-4306-8d97-a971229dd610 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:22.334777 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36e52ee-304e-4306-8d97-a971229dd610 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:22.407936 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b932d6-821f-4a09-89dd-ff402c2e3b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:22.408829 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b932d6-821f-4a09-89dd-ff402c2e3b00 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:22.409305 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b932d6-821f-4a09-89dd-ff402c2e3b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:22.409746 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b932d6-821f-4a09-89dd-ff402c2e3b00 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:22.412180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b932d6-821f-4a09-89dd-ff402c2e3b00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:22.412389 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b932d6-821f-4a09-89dd-ff402c2e3b00 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:22.504524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1002/1998] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:22 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:22.508446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a329be3-f961-411c-b613-9fe3a4325e95 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:22.519234 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a329be3-f961-411c-b613-9fe3a4325e95 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:22.524124 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aefbf5-a583-4174-abfe-a4486d6b81a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:22.524790 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aefbf5-a583-4174-abfe-a4486d6b81a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:22.525112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aefbf5-a583-4174-abfe-a4486d6b81a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:22.525437 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aefbf5-a583-4174-abfe-a4486d6b81a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:22.526160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aefbf5-a583-4174-abfe-a4486d6b81a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:22.527807 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aefbf5-a583-4174-abfe-a4486d6b81a0 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:22.542196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 997/1999] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:22.543445 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b932d6-821f-4a09-89dd-ff402c2e3b00 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:22.556743 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b932d6-821f-4a09-89dd-ff402c2e3b00 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:22.566688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df27457a-88f6-42b8-a6a9-d4b040dcb93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:22.568236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27457a-88f6-42b8-a6a9-d4b040dcb93a admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:22.569351 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27457a-88f6-42b8-a6a9-d4b040dcb93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:22.569948 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df27457a-88f6-42b8-a6a9-d4b040dcb93a admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:22.570935 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27457a-88f6-42b8-a6a9-d4b040dcb93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:22.572929 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df27457a-88f6-42b8-a6a9-d4b040dcb93a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:22.594645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1003/2000] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:22.599159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aefbf5-a583-4174-abfe-a4486d6b81a0 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:22.627764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aefbf5-a583-4174-abfe-a4486d6b81a0 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:22.636745 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b0f42-6d2c-4bb5-833e-724b6d5bd4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:22.640457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b0f42-6d2c-4bb5-833e-724b6d5bd4e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:22.641456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b0f42-6d2c-4bb5-833e-724b6d5bd4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:22.642628 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b0f42-6d2c-4bb5-833e-724b6d5bd4e5 admin admin] PATH_INFO: `/v3/projects/7d0306e34aa54fb8a8a9680ebe6795e7/users/0b172ea4afd34100ae99825e8803d5f4/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:22.693473 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b0f42-6d2c-4bb5-833e-724b6d5bd4e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d0306e34aa54fb8a8a9680ebe6795e7, user_id=0b172ea4afd34100ae99825e8803d5f4, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:22.697698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b0f42-6d2c-4bb5-833e-724b6d5bd4e5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:22.817712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 998/2001] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:22 2022] PUT /identity/v3/projects/7d0306e34aa54fb8a8a9680ebe6795e7/users/0b172ea4afd34100ae99825e8803d5f4/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:22.829410 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276d22-8fda-4bb3-988d-93c1a389e5ea None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:22.829890 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276d22-8fda-4bb3-988d-93c1a389e5ea None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:22.830237 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276d22-8fda-4bb3-988d-93c1a389e5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:22.858528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-40276d22-8fda-4bb3-988d-93c1a389e5ea None None] MFA Rules not processed for user `0b172ea4afd34100ae99825e8803d5f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:22.860470 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-40276d22-8fda-4bb3-988d-93c1a389e5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:22.931224 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1004/2002] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:22.935920 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b0f42-6d2c-4bb5-833e-724b6d5bd4e5 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:23.009187 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b0f42-6d2c-4bb5-833e-724b6d5bd4e5 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:23.014081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdadf6-8867-42dc-9468-8aaff9f6aaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:23.014812 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdadf6-8867-42dc-9468-8aaff9f6aaec admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:23.015149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdadf6-8867-42dc-9468-8aaff9f6aaec admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:23.015432 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdadf6-8867-42dc-9468-8aaff9f6aaec admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:23.016141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdadf6-8867-42dc-9468-8aaff9f6aaec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:23.018249 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdadf6-8867-42dc-9468-8aaff9f6aaec admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:23.164381 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 999/2003] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:22 2022] POST /identity/v3/projects => generated 379 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:23.169351 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40276d22-8fda-4bb3-988d-93c1a389e5ea None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:23.184343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40276d22-8fda-4bb3-988d-93c1a389e5ea None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:23.255878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d25480-fafa-485f-adae-a5309f9b7b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:23.256572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d25480-fafa-485f-adae-a5309f9b7b07 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:23.256865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d25480-fafa-485f-adae-a5309f9b7b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:23.257182 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d25480-fafa-485f-adae-a5309f9b7b07 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:23.257894 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d25480-fafa-485f-adae-a5309f9b7b07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:23.259829 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d25480-fafa-485f-adae-a5309f9b7b07 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:23.425593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1005/2004] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:23 2022] POST /identity/v3/users => generated 296 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:23.428008 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdadf6-8867-42dc-9468-8aaff9f6aaec admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:23.439535 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdadf6-8867-42dc-9468-8aaff9f6aaec admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:23.444241 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562694d-b41c-46cf-834d-95b28d1766dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:23.444921 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562694d-b41c-46cf-834d-95b28d1766dd admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:23.445258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562694d-b41c-46cf-834d-95b28d1766dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:23.445540 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d562694d-b41c-46cf-834d-95b28d1766dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:23.446278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562694d-b41c-46cf-834d-95b28d1766dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:23.448173 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d562694d-b41c-46cf-834d-95b28d1766dd admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:23.465425 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d25480-fafa-485f-adae-a5309f9b7b07 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:23.465840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1000/2005] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:23.478125 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d25480-fafa-485f-adae-a5309f9b7b07 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:23.485931 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bdcc1-0964-4323-affc-9f8574aead46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:23.487478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bdcc1-0964-4323-affc-9f8574aead46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:23.487773 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bdcc1-0964-4323-affc-9f8574aead46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:23.488057 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bdcc1-0964-4323-affc-9f8574aead46 admin admin] PATH_INFO: `/v3/projects/fbe711926bff4bce9330bdae96ae431b/users/db3091e5e9a24f63b2922bd817d45a4a/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:23.531416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753bdcc1-0964-4323-affc-9f8574aead46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe711926bff4bce9330bdae96ae431b, user_id=db3091e5e9a24f63b2922bd817d45a4a, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:23.537029 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753bdcc1-0964-4323-affc-9f8574aead46 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:23.752503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1006/2006] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:23 2022] PUT /identity/v3/projects/fbe711926bff4bce9330bdae96ae431b/users/db3091e5e9a24f63b2922bd817d45a4a/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:23.756528 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562694d-b41c-46cf-834d-95b28d1766dd admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:23.766824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d562694d-b41c-46cf-834d-95b28d1766dd admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:23.825358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c47ac83-8b29-44fe-ab29-cb33465f0231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:23.826042 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47ac83-8b29-44fe-ab29-cb33465f0231 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:23.826326 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47ac83-8b29-44fe-ab29-cb33465f0231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:23.826606 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c47ac83-8b29-44fe-ab29-cb33465f0231 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:23.827338 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47ac83-8b29-44fe-ab29-cb33465f0231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:23.829498 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c47ac83-8b29-44fe-ab29-cb33465f0231 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:23.839582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1001/2007] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:23.844590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bdcc1-0964-4323-affc-9f8574aead46 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:23.855146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bdcc1-0964-4323-affc-9f8574aead46 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:23.860228 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516769b-a689-401a-bdd0-aee71aceea52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:23.861154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516769b-a689-401a-bdd0-aee71aceea52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:23.861439 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516769b-a689-401a-bdd0-aee71aceea52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:23.861715 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516769b-a689-401a-bdd0-aee71aceea52 admin admin] PATH_INFO: `/v3/projects/fbe711926bff4bce9330bdae96ae431b/users/db3091e5e9a24f63b2922bd817d45a4a/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:23.863658 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516769b-a689-401a-bdd0-aee71aceea52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe711926bff4bce9330bdae96ae431b, user_id=db3091e5e9a24f63b2922bd817d45a4a, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:23.866338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516769b-a689-401a-bdd0-aee71aceea52 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:23.877712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1007/2008] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:23 2022] PUT /identity/v3/projects/fbe711926bff4bce9330bdae96ae431b/users/db3091e5e9a24f63b2922bd817d45a4a/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:23.887666 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86c770-7b2c-4fea-96aa-780c84254fd5 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:23.887965 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86c770-7b2c-4fea-96aa-780c84254fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:23.892307 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86c770-7b2c-4fea-96aa-780c84254fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:23.916674 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-2e86c770-7b2c-4fea-96aa-780c84254fd5 None None] MFA Rules not processed for user `db3091e5e9a24f63b2922bd817d45a4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:23.917946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2e86c770-7b2c-4fea-96aa-780c84254fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:23.994852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1002/2009] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:24.006076 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516769b-a689-401a-bdd0-aee71aceea52 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:24.007921 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1516769b-a689-401a-bdd0-aee71aceea52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:24.070558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516769b-a689-401a-bdd0-aee71aceea52 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:24.074516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d315f5c-388e-43f3-974c-e79cf4f941ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:24.075179 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d315f5c-388e-43f3-974c-e79cf4f941ae service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:24.075469 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d315f5c-388e-43f3-974c-e79cf4f941ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:24.075750 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d315f5c-388e-43f3-974c-e79cf4f941ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:24.085548 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:24.087937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d315f5c-388e-43f3-974c-e79cf4f941ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:24.089520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d315f5c-388e-43f3-974c-e79cf4f941ae service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:24.100635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1008/2010] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:52:24.281166 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86c770-7b2c-4fea-96aa-780c84254fd5 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:24.290871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86c770-7b2c-4fea-96aa-780c84254fd5 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:24.294491 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7926ae-311b-4c11-8455-be5f9f16f87e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:24.295353 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7926ae-311b-4c11-8455-be5f9f16f87e service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:24.295548 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7926ae-311b-4c11-8455-be5f9f16f87e service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:24.295828 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7926ae-311b-4c11-8455-be5f9f16f87e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:24.354763 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7926ae-311b-4c11-8455-be5f9f16f87e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:24.356217 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7926ae-311b-4c11-8455-be5f9f16f87e service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:24.366682 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1003/2011] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:24.800164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:25.965734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d315f5c-388e-43f3-974c-e79cf4f941ae service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:25.979922 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d315f5c-388e-43f3-974c-e79cf4f941ae service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:25.987283 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf8d97-3950-49f8-afe2-cc12f0fe28b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:25.988224 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf8d97-3950-49f8-afe2-cc12f0fe28b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:25.988512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf8d97-3950-49f8-afe2-cc12f0fe28b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:25.989266 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf8d97-3950-49f8-afe2-cc12f0fe28b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:25.991103 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a7bf8d97-3950-49f8-afe2-cc12f0fe28b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:26.066746 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf8d97-3950-49f8-afe2-cc12f0fe28b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:26.068209 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf8d97-3950-49f8-afe2-cc12f0fe28b8 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:26.077322 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1009/2012] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:28.109175 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7926ae-311b-4c11-8455-be5f9f16f87e service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:28.196374 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7926ae-311b-4c11-8455-be5f9f16f87e service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:28.203769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c9da8-6467-4e83-b98e-4018cee36943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:28.203769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c9da8-6467-4e83-b98e-4018cee36943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:28.203769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c9da8-6467-4e83-b98e-4018cee36943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:28.204236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469c9da8-6467-4e83-b98e-4018cee36943 admin admin] PATH_INFO: `/v3/users/faaa6948f5d844099002b4fb690b7423` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:28.205623 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c9da8-6467-4e83-b98e-4018cee36943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faaa6948f5d844099002b4fb690b7423)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:28.207700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469c9da8-6467-4e83-b98e-4018cee36943 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:28.445381 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:28.512927 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-469c9da8-6467-4e83-b98e-4018cee36943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faaa6948f5d844099002b4fb690b7423'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:28.717458 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-469c9da8-6467-4e83-b98e-4018cee36943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faaa6948f5d844099002b4fb690b7423'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:28.727970 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-469c9da8-6467-4e83-b98e-4018cee36943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faaa6948f5d844099002b4fb690b7423'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:28.728894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-469c9da8-6467-4e83-b98e-4018cee36943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faaa6948f5d844099002b4fb690b7423'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:28.743716 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-469c9da8-6467-4e83-b98e-4018cee36943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faaa6948f5d844099002b4fb690b7423'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:28.751683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1004/2013] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:28 2022] DELETE /identity/v3/users/faaa6948f5d844099002b4fb690b7423 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:28.756417 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1447b90-b6da-420b-bf9a-5fa5ce8d9ef9 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:28.761122 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1447b90-b6da-420b-bf9a-5fa5ce8d9ef9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:28.761122 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1447b90-b6da-420b-bf9a-5fa5ce8d9ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:28.785783 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b1447b90-b6da-420b-bf9a-5fa5ce8d9ef9 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:28.785783 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b1447b90-b6da-420b-bf9a-5fa5ce8d9ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:28.849323 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1010/2014] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:28.860434 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c9da8-6467-4e83-b98e-4018cee36943 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:28.862115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-469c9da8-6467-4e83-b98e-4018cee36943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:28.923912 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469c9da8-6467-4e83-b98e-4018cee36943 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:28.927766 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fac583-163f-48c5-84ff-e7e5d06d3e6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:28.928427 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fac583-163f-48c5-84ff-e7e5d06d3e6a service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:28.928708 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fac583-163f-48c5-84ff-e7e5d06d3e6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:28.958735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fac583-163f-48c5-84ff-e7e5d06d3e6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:28.959950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:28.960055 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fac583-163f-48c5-84ff-e7e5d06d3e6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:28.960055 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fac583-163f-48c5-84ff-e7e5d06d3e6a service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:28.960055 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1005/2015] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:29.489167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1447b90-b6da-420b-bf9a-5fa5ce8d9ef9 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:29.490623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b1447b90-b6da-420b-bf9a-5fa5ce8d9ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:29.504745 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1447b90-b6da-420b-bf9a-5fa5ce8d9ef9 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:29.509995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b698ffcf-0508-4581-9b30-3ab22f44ab51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:29.510898 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698ffcf-0508-4581-9b30-3ab22f44ab51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:29.511281 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698ffcf-0508-4581-9b30-3ab22f44ab51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:29.511569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b698ffcf-0508-4581-9b30-3ab22f44ab51 admin admin] PATH_INFO: `/v3/projects/264cdc1d6af24231865ba37dfff07341` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:29.512821 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698ffcf-0508-4581-9b30-3ab22f44ab51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=264cdc1d6af24231865ba37dfff07341)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:29.514894 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b698ffcf-0508-4581-9b30-3ab22f44ab51 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:29.712200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b698ffcf-0508-4581-9b30-3ab22f44ab51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '264cdc1d6af24231865ba37dfff07341', 'request_id': 'req-b698ffcf-0508-4581-9b30-3ab22f44ab51'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:29.719260 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b698ffcf-0508-4581-9b30-3ab22f44ab51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '264cdc1d6af24231865ba37dfff07341', 'request_id': 'req-b698ffcf-0508-4581-9b30-3ab22f44ab51'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:29.724872 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b698ffcf-0508-4581-9b30-3ab22f44ab51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '264cdc1d6af24231865ba37dfff07341', 'request_id': 'req-b698ffcf-0508-4581-9b30-3ab22f44ab51'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:29.833342 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b698ffcf-0508-4581-9b30-3ab22f44ab51 admin admin] The token cache is being invalidate because project 264cdc1d6af24231865ba37dfff07341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:29.833985 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b698ffcf-0508-4581-9b30-3ab22f44ab51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:29.834393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b698ffcf-0508-4581-9b30-3ab22f44ab51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:29.840350 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1011/2016] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:29 2022] DELETE /identity/v3/projects/264cdc1d6af24231865ba37dfff07341 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:29.841429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b783f98-fe72-4461-8c6c-2f2a0b9e1014 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:29.841877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b783f98-fe72-4461-8c6c-2f2a0b9e1014 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:29.841989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b783f98-fe72-4461-8c6c-2f2a0b9e1014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:29.874194 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-8b783f98-fe72-4461-8c6c-2f2a0b9e1014 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:29.874194 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8b783f98-fe72-4461-8c6c-2f2a0b9e1014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:29.952510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1006/2017] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:29.960490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8116fd1-b8bf-45a3-96e6-c348a5efbe0d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:29.960795 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8116fd1-b8bf-45a3-96e6-c348a5efbe0d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:29.961130 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8116fd1-b8bf-45a3-96e6-c348a5efbe0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:29.985264 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c8116fd1-b8bf-45a3-96e6-c348a5efbe0d None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:29.986767 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c8116fd1-b8bf-45a3-96e6-c348a5efbe0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:29.995098 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1012/2018] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:29.999367 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b783f98-fe72-4461-8c6c-2f2a0b9e1014 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:30.009451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b783f98-fe72-4461-8c6c-2f2a0b9e1014 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:30.014452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83a592-9064-4623-bdb8-23ede6a1cb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:30.015025 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83a592-9064-4623-bdb8-23ede6a1cb7a admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:30.015873 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83a592-9064-4623-bdb8-23ede6a1cb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:30.016158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c83a592-9064-4623-bdb8-23ede6a1cb7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:30.017133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83a592-9064-4623-bdb8-23ede6a1cb7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:52:30.017445 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83a592-9064-4623-bdb8-23ede6a1cb7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:30.019086 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c83a592-9064-4623-bdb8-23ede6a1cb7a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:30.032274 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1007/2019] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:52:30.036785 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8116fd1-b8bf-45a3-96e6-c348a5efbe0d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:30.046095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8116fd1-b8bf-45a3-96e6-c348a5efbe0d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:30.053484 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef69b06-f338-44ad-aaad-fd78dc760336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:30.055005 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef69b06-f338-44ad-aaad-fd78dc760336 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:30.059436 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef69b06-f338-44ad-aaad-fd78dc760336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:30.059436 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef69b06-f338-44ad-aaad-fd78dc760336 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:30.059436 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef69b06-f338-44ad-aaad-fd78dc760336 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:30.059436 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef69b06-f338-44ad-aaad-fd78dc760336 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:30.200748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1013/2020] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:30 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:30.205913 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83a592-9064-4623-bdb8-23ede6a1cb7a admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:30.216429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c83a592-9064-4623-bdb8-23ede6a1cb7a admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:30.289115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bc70a-97c7-41cc-b941-b7c23294efa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:30.289857 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bc70a-97c7-41cc-b941-b7c23294efa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:30.290158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bc70a-97c7-41cc-b941-b7c23294efa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:30.290438 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bc70a-97c7-41cc-b941-b7c23294efa0 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:30.291176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bc70a-97c7-41cc-b941-b7c23294efa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:30.294299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bc70a-97c7-41cc-b941-b7c23294efa0 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:30.410496 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1008/2021] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:30 2022] POST /identity/v3/users => generated 289 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:30.414728 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef69b06-f338-44ad-aaad-fd78dc760336 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:30.420886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:30.428433 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef69b06-f338-44ad-aaad-fd78dc760336 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:30.434337 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8192416-99a5-4d4c-b5cc-10d513341115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:30.435025 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8192416-99a5-4d4c-b5cc-10d513341115 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:30.435363 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8192416-99a5-4d4c-b5cc-10d513341115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:30.435638 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8192416-99a5-4d4c-b5cc-10d513341115 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:30.436372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8192416-99a5-4d4c-b5cc-10d513341115 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:30.438031 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8192416-99a5-4d4c-b5cc-10d513341115 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:30.450364 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1014/2022] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:30.453877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bc70a-97c7-41cc-b941-b7c23294efa0 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:30.464687 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bc70a-97c7-41cc-b941-b7c23294efa0 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:30.470840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df832e09-e863-4bb8-8c54-9a655ae76c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:30.471508 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df832e09-e863-4bb8-8c54-9a655ae76c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:30.471801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df832e09-e863-4bb8-8c54-9a655ae76c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:30.472130 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df832e09-e863-4bb8-8c54-9a655ae76c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:30.472871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df832e09-e863-4bb8-8c54-9a655ae76c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:30.474589 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df832e09-e863-4bb8-8c54-9a655ae76c24 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:30.489598 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1009/2023] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:30.493944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8192416-99a5-4d4c-b5cc-10d513341115 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:30.505165 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8192416-99a5-4d4c-b5cc-10d513341115 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:30.509939 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91845083-ee9a-47fb-a778-6d298c553347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:30.511054 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91845083-ee9a-47fb-a778-6d298c553347 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:30.511339 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91845083-ee9a-47fb-a778-6d298c553347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:30.511620 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91845083-ee9a-47fb-a778-6d298c553347 admin admin] PATH_INFO: `/v3/projects/63c371af4a664f26a92bd681d4bfee9f/users/f659b63f72b04b61a104ee735550487b/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:30.527929 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91845083-ee9a-47fb-a778-6d298c553347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63c371af4a664f26a92bd681d4bfee9f, user_id=f659b63f72b04b61a104ee735550487b, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:30.532064 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91845083-ee9a-47fb-a778-6d298c553347 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:30.625074 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1015/2024] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:30 2022] PUT /identity/v3/projects/63c371af4a664f26a92bd681d4bfee9f/users/f659b63f72b04b61a104ee735550487b/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:30.636841 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfab69-ac0e-4e0a-869b-e9886c239d77 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:30.637251 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfab69-ac0e-4e0a-869b-e9886c239d77 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:30.637612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfab69-ac0e-4e0a-869b-e9886c239d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:30.672249 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-51cfab69-ac0e-4e0a-869b-e9886c239d77 None None] MFA Rules not processed for user `f659b63f72b04b61a104ee735550487b`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:30.674815 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-51cfab69-ac0e-4e0a-869b-e9886c239d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:30.781945 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1010/2025] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:30.786761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91845083-ee9a-47fb-a778-6d298c553347 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:30.801370 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:30.821629 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfab69-ac0e-4e0a-869b-e9886c239d77 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:30.823451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-51cfab69-ac0e-4e0a-869b-e9886c239d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:30.897188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91845083-ee9a-47fb-a778-6d298c553347 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:30.906080 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4389ee-be8c-4779-86f8-7fa318a8ac4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:30.907001 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4389ee-be8c-4779-86f8-7fa318a8ac4c admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:30.907461 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4389ee-be8c-4779-86f8-7fa318a8ac4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:30.907910 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4389ee-be8c-4779-86f8-7fa318a8ac4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:30.908808 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4389ee-be8c-4779-86f8-7fa318a8ac4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:30.911635 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4389ee-be8c-4779-86f8-7fa318a8ac4c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:30.939019 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfab69-ac0e-4e0a-869b-e9886c239d77 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:30.944247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f575b8-5ed6-4779-9aef-e5d343fc1ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:30.945345 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f575b8-5ed6-4779-9aef-e5d343fc1ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:30.945756 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f575b8-5ed6-4779-9aef-e5d343fc1ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:30.946135 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f575b8-5ed6-4779-9aef-e5d343fc1ff6 admin admin] PATH_INFO: `/v3/users/e3341ef0387b4c2ba90ac0d13f9faae7` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:30.947905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f575b8-5ed6-4779-9aef-e5d343fc1ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3341ef0387b4c2ba90ac0d13f9faae7)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:30.949817 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f575b8-5ed6-4779-9aef-e5d343fc1ff6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:31.072280 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1016/2026] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:30 2022] POST /identity/v3/projects => generated 375 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:31.098499 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4389ee-be8c-4779-86f8-7fa318a8ac4c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:31.163159 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4389ee-be8c-4779-86f8-7fa318a8ac4c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:31.168510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a68f6f-0a41-4252-8083-74ecfb199fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:31.169448 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a68f6f-0a41-4252-8083-74ecfb199fdf admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:31.169853 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a68f6f-0a41-4252-8083-74ecfb199fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:31.171327 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a68f6f-0a41-4252-8083-74ecfb199fdf admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:31.173072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a68f6f-0a41-4252-8083-74ecfb199fdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:31.176171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a68f6f-0a41-4252-8083-74ecfb199fdf admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:31.263591 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-31f575b8-5ed6-4779-9aef-e5d343fc1ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3341ef0387b4c2ba90ac0d13f9faae7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:31.395561 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1017/2027] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:31 2022] POST /identity/v3/users => generated 288 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:31.418959 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a68f6f-0a41-4252-8083-74ecfb199fdf admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:31.429612 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a68f6f-0a41-4252-8083-74ecfb199fdf admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:31.434283 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b5fb7-f7f6-4c51-8c18-214f4ef740e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:31.434980 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b5fb7-f7f6-4c51-8c18-214f4ef740e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:31.435263 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b5fb7-f7f6-4c51-8c18-214f4ef740e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:31.435540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b5fb7-f7f6-4c51-8c18-214f4ef740e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:31.436274 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b5fb7-f7f6-4c51-8c18-214f4ef740e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:31.438683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b5fb7-f7f6-4c51-8c18-214f4ef740e8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:31.448994 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1018/2028] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:52:31.454300 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b5fb7-f7f6-4c51-8c18-214f4ef740e8 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:31.464337 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b5fb7-f7f6-4c51-8c18-214f4ef740e8 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:31.470186 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa786795-6823-4ba0-8da2-ee24d1a2165c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:31.470853 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa786795-6823-4ba0-8da2-ee24d1a2165c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:31.471144 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa786795-6823-4ba0-8da2-ee24d1a2165c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:31.471423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa786795-6823-4ba0-8da2-ee24d1a2165c admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:31.472148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa786795-6823-4ba0-8da2-ee24d1a2165c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:31.473783 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa786795-6823-4ba0-8da2-ee24d1a2165c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:31.477312 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-31f575b8-5ed6-4779-9aef-e5d343fc1ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3341ef0387b4c2ba90ac0d13f9faae7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:31.487604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1019/2029] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:52:31.488881 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-31f575b8-5ed6-4779-9aef-e5d343fc1ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3341ef0387b4c2ba90ac0d13f9faae7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:31.490622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-31f575b8-5ed6-4779-9aef-e5d343fc1ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3341ef0387b4c2ba90ac0d13f9faae7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:31.492058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa786795-6823-4ba0-8da2-ee24d1a2165c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:31.494905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-aa786795-6823-4ba0-8da2-ee24d1a2165c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:31.508629 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa786795-6823-4ba0-8da2-ee24d1a2165c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:31.508985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-31f575b8-5ed6-4779-9aef-e5d343fc1ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3341ef0387b4c2ba90ac0d13f9faae7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:31.513987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec13c7c-ec83-4f66-8a7e-fbbacfcb542a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:31.515677 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec13c7c-ec83-4f66-8a7e-fbbacfcb542a admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:31.516193 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec13c7c-ec83-4f66-8a7e-fbbacfcb542a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:31.516767 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec13c7c-ec83-4f66-8a7e-fbbacfcb542a admin admin] PATH_INFO: `/v3/projects/bea46f24d13a4c399dfa74ec8a301c3d/users/51382e8aac0248898bb597ac228959fc/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:31.516879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1011/2030] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:30 2022] DELETE /identity/v3/users/e3341ef0387b4c2ba90ac0d13f9faae7 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:31.522240 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35b788-109c-449b-b4a7-574a77f30d3c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:31.522541 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35b788-109c-449b-b4a7-574a77f30d3c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:31.522932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35b788-109c-449b-b4a7-574a77f30d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:31.535467 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec13c7c-ec83-4f66-8a7e-fbbacfcb542a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea46f24d13a4c399dfa74ec8a301c3d, user_id=51382e8aac0248898bb597ac228959fc, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:31.539186 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec13c7c-ec83-4f66-8a7e-fbbacfcb542a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:31.553901 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-bf35b788-109c-449b-b4a7-574a77f30d3c None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:31.553901 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-bf35b788-109c-449b-b4a7-574a77f30d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:31.604001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1012/2031] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:31.616449 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35b788-109c-449b-b4a7-574a77f30d3c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:31.617902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-bf35b788-109c-449b-b4a7-574a77f30d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:31.678005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35b788-109c-449b-b4a7-574a77f30d3c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:31.682265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f9e6f-9069-4404-8f91-f87fd9a5c654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:31.682935 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f9e6f-9069-4404-8f91-f87fd9a5c654 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:31.683228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f9e6f-9069-4404-8f91-f87fd9a5c654 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:31.683510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f9e6f-9069-4404-8f91-f87fd9a5c654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:31.699407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f9e6f-9069-4404-8f91-f87fd9a5c654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:31.699407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f9e6f-9069-4404-8f91-f87fd9a5c654 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:31.707243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1013/2032] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:52:32.027034 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1020/2033] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:31 2022] PUT /identity/v3/projects/bea46f24d13a4c399dfa74ec8a301c3d/users/51382e8aac0248898bb597ac228959fc/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:32.036559 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f05d0-5f34-48d0-b407-2520b8c4497d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:32.037463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f05d0-5f34-48d0-b407-2520b8c4497d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:32.037781 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161f05d0-5f34-48d0-b407-2520b8c4497d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:32.085802 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-161f05d0-5f34-48d0-b407-2520b8c4497d None None] MFA Rules not processed for user `51382e8aac0248898bb597ac228959fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:32.085802 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-161f05d0-5f34-48d0-b407-2520b8c4497d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:32.213296 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1014/2034] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:32.217346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec13c7c-ec83-4f66-8a7e-fbbacfcb542a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:32.217862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f05d0-5f34-48d0-b407-2520b8c4497d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:32.221395 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0ec13c7c-ec83-4f66-8a7e-fbbacfcb542a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:32.380314 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec13c7c-ec83-4f66-8a7e-fbbacfcb542a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:32.393053 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6303e6e-2464-4c94-8795-94108a1dc565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:32.394316 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6303e6e-2464-4c94-8795-94108a1dc565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:32.394751 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6303e6e-2464-4c94-8795-94108a1dc565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:32.395316 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6303e6e-2464-4c94-8795-94108a1dc565 admin admin] PATH_INFO: `/v3/users/38b19da9e17d455092681d908ccb221c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:32.397143 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6303e6e-2464-4c94-8795-94108a1dc565 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38b19da9e17d455092681d908ccb221c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:32.401346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6303e6e-2464-4c94-8795-94108a1dc565 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:32.431150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161f05d0-5f34-48d0-b407-2520b8c4497d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:32.455227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda6469-ba31-4d9e-9246-9e66fe99fc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:32.460793 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda6469-ba31-4d9e-9246-9e66fe99fc84 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:32.473934 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda6469-ba31-4d9e-9246-9e66fe99fc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:32.477420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda6469-ba31-4d9e-9246-9e66fe99fc84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:32.480290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda6469-ba31-4d9e-9246-9e66fe99fc84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:32.491564 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda6469-ba31-4d9e-9246-9e66fe99fc84 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:32.616674 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1015/2035] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:32 2022] POST /identity/v3/projects => generated 377 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:32.618298 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda6469-ba31-4d9e-9246-9e66fe99fc84 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:32.621379 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-abda6469-ba31-4d9e-9246-9e66fe99fc84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:32.724084 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda6469-ba31-4d9e-9246-9e66fe99fc84 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:32.729253 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793d16a-e04b-4b58-acfa-c084f008168e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:32.730427 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793d16a-e04b-4b58-acfa-c084f008168e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:32.730897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793d16a-e04b-4b58-acfa-c084f008168e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:32.731193 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793d16a-e04b-4b58-acfa-c084f008168e admin admin] PATH_INFO: `/v3/projects/8ddd72d79ed1446a94276e9196a34671` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:32.732410 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793d16a-e04b-4b58-acfa-c084f008168e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ddd72d79ed1446a94276e9196a34671)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:32.734884 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793d16a-e04b-4b58-acfa-c084f008168e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:32.795574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b6303e6e-2464-4c94-8795-94108a1dc565 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38b19da9e17d455092681d908ccb221c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:32.904302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b793d16a-e04b-4b58-acfa-c084f008168e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ddd72d79ed1446a94276e9196a34671', 'request_id': 'req-b793d16a-e04b-4b58-acfa-c084f008168e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:32.911686 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b793d16a-e04b-4b58-acfa-c084f008168e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ddd72d79ed1446a94276e9196a34671', 'request_id': 'req-b793d16a-e04b-4b58-acfa-c084f008168e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:32.916470 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b6303e6e-2464-4c94-8795-94108a1dc565 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38b19da9e17d455092681d908ccb221c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:32.925922 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b793d16a-e04b-4b58-acfa-c084f008168e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ddd72d79ed1446a94276e9196a34671', 'request_id': 'req-b793d16a-e04b-4b58-acfa-c084f008168e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:32.934649 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b6303e6e-2464-4c94-8795-94108a1dc565 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38b19da9e17d455092681d908ccb221c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:32.935462 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b6303e6e-2464-4c94-8795-94108a1dc565 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38b19da9e17d455092681d908ccb221c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:32.949880 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b6303e6e-2464-4c94-8795-94108a1dc565 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38b19da9e17d455092681d908ccb221c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:32.959147 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1021/2036] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:32 2022] DELETE /identity/v3/users/38b19da9e17d455092681d908ccb221c => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:32.959147 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6303e6e-2464-4c94-8795-94108a1dc565 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:32.961035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b6303e6e-2464-4c94-8795-94108a1dc565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:33.033437 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6303e6e-2464-4c94-8795-94108a1dc565 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:33.038844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e845d31-d6b8-4590-86ef-469fd1bbb85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:33.039529 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e845d31-d6b8-4590-86ef-469fd1bbb85d admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:33.039813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e845d31-d6b8-4590-86ef-469fd1bbb85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:33.040087 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e845d31-d6b8-4590-86ef-469fd1bbb85d admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:33.040794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e845d31-d6b8-4590-86ef-469fd1bbb85d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:33.042922 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e845d31-d6b8-4590-86ef-469fd1bbb85d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:33.119947 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b793d16a-e04b-4b58-acfa-c084f008168e admin admin] The token cache is being invalidate because project 8ddd72d79ed1446a94276e9196a34671 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:33.120607 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b793d16a-e04b-4b58-acfa-c084f008168e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:33.121179 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b793d16a-e04b-4b58-acfa-c084f008168e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:33.122933 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1016/2037] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:32 2022] DELETE /identity/v3/projects/8ddd72d79ed1446a94276e9196a34671 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:33.124304 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50a8b6-4cc0-4f76-ad16-39ed44b4a7ff None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:33.124528 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50a8b6-4cc0-4f76-ad16-39ed44b4a7ff None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:33.124849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50a8b6-4cc0-4f76-ad16-39ed44b4a7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:33.144865 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-4d50a8b6-4cc0-4f76-ad16-39ed44b4a7ff None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:33.154815 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4d50a8b6-4cc0-4f76-ad16-39ed44b4a7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:33.165230 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1017/2038] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:33.165916 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50a8b6-4cc0-4f76-ad16-39ed44b4a7ff None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:33.167232 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4d50a8b6-4cc0-4f76-ad16-39ed44b4a7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:33.197676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1022/2039] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:32 2022] POST /identity/v3/users => generated 295 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:33.199391 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e845d31-d6b8-4590-86ef-469fd1bbb85d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:33.199509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50a8b6-4cc0-4f76-ad16-39ed44b4a7ff None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:33.202615 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0e845d31-d6b8-4590-86ef-469fd1bbb85d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:33.207759 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ca7f9-949a-496b-b91f-a70bb4cb0f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:33.209648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ca7f9-949a-496b-b91f-a70bb4cb0f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:33.209854 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ca7f9-949a-496b-b91f-a70bb4cb0f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:33.210404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699ca7f9-949a-496b-b91f-a70bb4cb0f47 admin admin] PATH_INFO: `/v3/users/0b172ea4afd34100ae99825e8803d5f4` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:33.211779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ca7f9-949a-496b-b91f-a70bb4cb0f47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b172ea4afd34100ae99825e8803d5f4)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:33.214139 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699ca7f9-949a-496b-b91f-a70bb4cb0f47 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:33.265960 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e845d31-d6b8-4590-86ef-469fd1bbb85d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:33.269649 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ba251-d16b-477d-87a2-2c2e357ffa54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:33.270362 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ba251-d16b-477d-87a2-2c2e357ffa54 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:33.270647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ba251-d16b-477d-87a2-2c2e357ffa54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:33.270924 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1ba251-d16b-477d-87a2-2c2e357ffa54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:33.279986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ba251-d16b-477d-87a2-2c2e357ffa54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:33.281563 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1ba251-d16b-477d-87a2-2c2e357ffa54 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:33.291245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1023/2040] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:33.292252 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ba251-d16b-477d-87a2-2c2e357ffa54 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:33.293711 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2e1ba251-d16b-477d-87a2-2c2e357ffa54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:33.310896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1ba251-d16b-477d-87a2-2c2e357ffa54 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:33.317024 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb3272-c019-42cd-a66c-19d7b6ef7b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:33.317714 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb3272-c019-42cd-a66c-19d7b6ef7b28 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:33.318001 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb3272-c019-42cd-a66c-19d7b6ef7b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:33.318277 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb3272-c019-42cd-a66c-19d7b6ef7b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:33.319006 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb3272-c019-42cd-a66c-19d7b6ef7b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:33.320603 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb3272-c019-42cd-a66c-19d7b6ef7b28 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:33.336129 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1024/2041] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:33.340323 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb3272-c019-42cd-a66c-19d7b6ef7b28 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:33.351489 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb3272-c019-42cd-a66c-19d7b6ef7b28 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:33.356414 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c757a5-652b-4274-985b-d5366e1b9674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:33.357336 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c757a5-652b-4274-985b-d5366e1b9674 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:33.357625 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c757a5-652b-4274-985b-d5366e1b9674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:33.357902 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c757a5-652b-4274-985b-d5366e1b9674 admin admin] PATH_INFO: `/v3/projects/bcb8eb857ec848e1a6c895d56282017a/users/89414129f3eb496fbd929d870558960a/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:33.374107 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c757a5-652b-4274-985b-d5366e1b9674 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb8eb857ec848e1a6c895d56282017a, user_id=89414129f3eb496fbd929d870558960a, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:33.378182 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c757a5-652b-4274-985b-d5366e1b9674 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:33.505555 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1025/2042] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:33 2022] PUT /identity/v3/projects/bcb8eb857ec848e1a6c895d56282017a/users/89414129f3eb496fbd929d870558960a/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:33.509685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c757a5-652b-4274-985b-d5366e1b9674 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:33.532747 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-699ca7f9-949a-496b-b91f-a70bb4cb0f47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b172ea4afd34100ae99825e8803d5f4'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:33.608209 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c757a5-652b-4274-985b-d5366e1b9674 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:33.614563 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfea2f4-a3dc-4fa7-9c6b-cc90ef999182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:33.615326 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea2f4-a3dc-4fa7-9c6b-cc90ef999182 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:33.615775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea2f4-a3dc-4fa7-9c6b-cc90ef999182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:33.616188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfea2f4-a3dc-4fa7-9c6b-cc90ef999182 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:33.616948 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfea2f4-a3dc-4fa7-9c6b-cc90ef999182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:33.618651 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfea2f4-a3dc-4fa7-9c6b-cc90ef999182 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:33.631604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1026/2043] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:33.636001 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfea2f4-a3dc-4fa7-9c6b-cc90ef999182 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:33.637801 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:33.649092 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfea2f4-a3dc-4fa7-9c6b-cc90ef999182 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:33.653837 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ea7cb-871b-4d74-b4f7-e6fccedb70ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:33.654759 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ea7cb-871b-4d74-b4f7-e6fccedb70ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:33.655049 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ea7cb-871b-4d74-b4f7-e6fccedb70ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:33.655332 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ea7cb-871b-4d74-b4f7-e6fccedb70ff admin admin] PATH_INFO: `/v3/projects/bcb8eb857ec848e1a6c895d56282017a/users/89414129f3eb496fbd929d870558960a/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:33.658854 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ea7cb-871b-4d74-b4f7-e6fccedb70ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb8eb857ec848e1a6c895d56282017a, user_id=89414129f3eb496fbd929d870558960a, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:33.662069 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ea7cb-871b-4d74-b4f7-e6fccedb70ff admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:33.667787 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-699ca7f9-949a-496b-b91f-a70bb4cb0f47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b172ea4afd34100ae99825e8803d5f4'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:33.673833 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1027/2044] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:33 2022] PUT /identity/v3/projects/bcb8eb857ec848e1a6c895d56282017a/users/89414129f3eb496fbd929d870558960a/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:33.679059 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-699ca7f9-949a-496b-b91f-a70bb4cb0f47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b172ea4afd34100ae99825e8803d5f4'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:33.679915 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-699ca7f9-949a-496b-b91f-a70bb4cb0f47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b172ea4afd34100ae99825e8803d5f4'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:33.684009 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363306e7-63e5-40ff-a788-fff5557cdd35 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:33.684316 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363306e7-63e5-40ff-a788-fff5557cdd35 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:33.684569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363306e7-63e5-40ff-a788-fff5557cdd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:33.695383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-699ca7f9-949a-496b-b91f-a70bb4cb0f47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b172ea4afd34100ae99825e8803d5f4'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:33.715449 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1018/2045] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:33 2022] DELETE /identity/v3/users/0b172ea4afd34100ae99825e8803d5f4 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:33.718137 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-363306e7-63e5-40ff-a788-fff5557cdd35 None None] MFA Rules not processed for user `89414129f3eb496fbd929d870558960a`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:33.722061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-363306e7-63e5-40ff-a788-fff5557cdd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:33.827334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1028/2046] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:33 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:33.840069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ca7f9-949a-496b-b91f-a70bb4cb0f47 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:33.841676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-699ca7f9-949a-496b-b91f-a70bb4cb0f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:33.915263 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699ca7f9-949a-496b-b91f-a70bb4cb0f47 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:33.918853 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f6de9-cc05-47ac-b111-7f6e6f511848 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:33.919513 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f6de9-cc05-47ac-b111-7f6e6f511848 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:33.919796 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f6de9-cc05-47ac-b111-7f6e6f511848 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:33.920073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f6de9-cc05-47ac-b111-7f6e6f511848 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:33.921962 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-bc1f6de9-cc05-47ac-b111-7f6e6f511848 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:33.984363 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f6de9-cc05-47ac-b111-7f6e6f511848 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:33.985843 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f6de9-cc05-47ac-b111-7f6e6f511848 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:34.005609 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1019/2047] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:34.005705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363306e7-63e5-40ff-a788-fff5557cdd35 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:34.007958 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-363306e7-63e5-40ff-a788-fff5557cdd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:34.110965 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363306e7-63e5-40ff-a788-fff5557cdd35 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:34.116325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80104887-f983-43e7-93e5-665031fa8661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:34.117248 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80104887-f983-43e7-93e5-665031fa8661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:34.117532 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80104887-f983-43e7-93e5-665031fa8661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:34.117807 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80104887-f983-43e7-93e5-665031fa8661 admin admin] PATH_INFO: `/v3/projects/c69c9b5255e44e20ad679c5958b911c8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:34.119085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80104887-f983-43e7-93e5-665031fa8661 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c69c9b5255e44e20ad679c5958b911c8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:34.121025 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80104887-f983-43e7-93e5-665031fa8661 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:34.182933 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:34.361059 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f6de9-cc05-47ac-b111-7f6e6f511848 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:34.363236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-bc1f6de9-cc05-47ac-b111-7f6e6f511848 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:34.375773 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-80104887-f983-43e7-93e5-665031fa8661 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c69c9b5255e44e20ad679c5958b911c8', 'request_id': 'req-80104887-f983-43e7-93e5-665031fa8661'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:34.382747 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f6de9-cc05-47ac-b111-7f6e6f511848 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:34.385262 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-80104887-f983-43e7-93e5-665031fa8661 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c69c9b5255e44e20ad679c5958b911c8', 'request_id': 'req-80104887-f983-43e7-93e5-665031fa8661'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:34.392552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-80104887-f983-43e7-93e5-665031fa8661 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c69c9b5255e44e20ad679c5958b911c8', 'request_id': 'req-80104887-f983-43e7-93e5-665031fa8661'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:34.463183 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7560e6-696c-4cf4-8953-6544a459ecaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:34.465614 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7560e6-696c-4cf4-8953-6544a459ecaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:34.465906 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7560e6-696c-4cf4-8953-6544a459ecaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:34.466186 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7560e6-696c-4cf4-8953-6544a459ecaf admin admin] PATH_INFO: `/v3/projects/7d0306e34aa54fb8a8a9680ebe6795e7` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:34.467443 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7560e6-696c-4cf4-8953-6544a459ecaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d0306e34aa54fb8a8a9680ebe6795e7)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:34.469678 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7560e6-696c-4cf4-8953-6544a459ecaf admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:34.501206 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-80104887-f983-43e7-93e5-665031fa8661 admin admin] The token cache is being invalidate because project c69c9b5255e44e20ad679c5958b911c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:34.502039 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-80104887-f983-43e7-93e5-665031fa8661 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:34.502647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-80104887-f983-43e7-93e5-665031fa8661 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:34.504605 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1029/2048] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:34 2022] DELETE /identity/v3/projects/c69c9b5255e44e20ad679c5958b911c8 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:34.509328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80104887-f983-43e7-93e5-665031fa8661 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:34.511174 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-80104887-f983-43e7-93e5-665031fa8661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:34.525384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80104887-f983-43e7-93e5-665031fa8661 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:34.531247 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf03cab-0199-44b7-98a5-892ac1369df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:34.532493 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf03cab-0199-44b7-98a5-892ac1369df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:34.532784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf03cab-0199-44b7-98a5-892ac1369df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:34.533089 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf03cab-0199-44b7-98a5-892ac1369df3 admin admin] PATH_INFO: `/v3/users/a43faf1abd2d4103a447350914cd4199` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:34.534540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf03cab-0199-44b7-98a5-892ac1369df3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a43faf1abd2d4103a447350914cd4199)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:34.536516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf03cab-0199-44b7-98a5-892ac1369df3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:34.650325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ea7560e6-696c-4cf4-8953-6544a459ecaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d0306e34aa54fb8a8a9680ebe6795e7', 'request_id': 'req-ea7560e6-696c-4cf4-8953-6544a459ecaf'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:34.657094 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ea7560e6-696c-4cf4-8953-6544a459ecaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d0306e34aa54fb8a8a9680ebe6795e7', 'request_id': 'req-ea7560e6-696c-4cf4-8953-6544a459ecaf'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:34.663633 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ea7560e6-696c-4cf4-8953-6544a459ecaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d0306e34aa54fb8a8a9680ebe6795e7', 'request_id': 'req-ea7560e6-696c-4cf4-8953-6544a459ecaf'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:34.784070 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:34.791196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ea7560e6-696c-4cf4-8953-6544a459ecaf admin admin] The token cache is being invalidate because project 7d0306e34aa54fb8a8a9680ebe6795e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:34.791490 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ea7560e6-696c-4cf4-8953-6544a459ecaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:34.792154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ea7560e6-696c-4cf4-8953-6544a459ecaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:34.793758 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1020/2049] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:34 2022] DELETE /identity/v3/projects/7d0306e34aa54fb8a8a9680ebe6795e7 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:34.798191 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7560e6-696c-4cf4-8953-6544a459ecaf admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:34.799896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ea7560e6-696c-4cf4-8953-6544a459ecaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:34.889467 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7560e6-696c-4cf4-8953-6544a459ecaf admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:34.894256 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f05d8-d61a-4bed-8d04-1a206d44d9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:34.895212 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f05d8-d61a-4bed-8d04-1a206d44d9e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:34.895505 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f05d8-d61a-4bed-8d04-1a206d44d9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:34.896375 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f05d8-d61a-4bed-8d04-1a206d44d9e5 admin admin] PATH_INFO: `/v3/users/db3091e5e9a24f63b2922bd817d45a4a` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:34.897053 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f05d8-d61a-4bed-8d04-1a206d44d9e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db3091e5e9a24f63b2922bd817d45a4a)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:34.899332 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f05d8-d61a-4bed-8d04-1a206d44d9e5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:34.918284 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bcf03cab-0199-44b7-98a5-892ac1369df3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a43faf1abd2d4103a447350914cd4199'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:35.318133 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bcf03cab-0199-44b7-98a5-892ac1369df3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a43faf1abd2d4103a447350914cd4199'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:35.326448 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bcf03cab-0199-44b7-98a5-892ac1369df3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a43faf1abd2d4103a447350914cd4199'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:35.327503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bcf03cab-0199-44b7-98a5-892ac1369df3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a43faf1abd2d4103a447350914cd4199'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:35.340740 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bcf03cab-0199-44b7-98a5-892ac1369df3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a43faf1abd2d4103a447350914cd4199'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:35.347779 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1030/2050] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:34 2022] DELETE /identity/v3/users/a43faf1abd2d4103a447350914cd4199 => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:35.428171 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ff9f05d8-d61a-4bed-8d04-1a206d44d9e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db3091e5e9a24f63b2922bd817d45a4a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:35.577735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ff9f05d8-d61a-4bed-8d04-1a206d44d9e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db3091e5e9a24f63b2922bd817d45a4a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:35.586406 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ff9f05d8-d61a-4bed-8d04-1a206d44d9e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db3091e5e9a24f63b2922bd817d45a4a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:35.589475 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ff9f05d8-d61a-4bed-8d04-1a206d44d9e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db3091e5e9a24f63b2922bd817d45a4a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:35.600345 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ff9f05d8-d61a-4bed-8d04-1a206d44d9e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db3091e5e9a24f63b2922bd817d45a4a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:35.607458 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1021/2051] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:34 2022] DELETE /identity/v3/users/db3091e5e9a24f63b2922bd817d45a4a => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:35.876619 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf03cab-0199-44b7-98a5-892ac1369df3 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:35.878191 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bcf03cab-0199-44b7-98a5-892ac1369df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:35.979500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf03cab-0199-44b7-98a5-892ac1369df3 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:36.050476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ee515-2f16-41ba-abba-cd1644574757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:36.050733 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ee515-2f16-41ba-abba-cd1644574757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:36.050827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ee515-2f16-41ba-abba-cd1644574757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:36.051161 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ee515-2f16-41ba-abba-cd1644574757 admin admin] PATH_INFO: `/v3/projects/4595e302c5e54c1191a87c9985da6ffc` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:36.052448 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ee515-2f16-41ba-abba-cd1644574757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4595e302c5e54c1191a87c9985da6ffc)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:36.054738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8ee515-2f16-41ba-abba-cd1644574757 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:36.207521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f05d8-d61a-4bed-8d04-1a206d44d9e5 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:36.208976 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ff9f05d8-d61a-4bed-8d04-1a206d44d9e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:36.218046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ee8ee515-2f16-41ba-abba-cd1644574757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4595e302c5e54c1191a87c9985da6ffc', 'request_id': 'req-ee8ee515-2f16-41ba-abba-cd1644574757'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:36.223752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f05d8-d61a-4bed-8d04-1a206d44d9e5 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:36.230811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ee8ee515-2f16-41ba-abba-cd1644574757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4595e302c5e54c1191a87c9985da6ffc', 'request_id': 'req-ee8ee515-2f16-41ba-abba-cd1644574757'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:36.237565 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ee8ee515-2f16-41ba-abba-cd1644574757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4595e302c5e54c1191a87c9985da6ffc', 'request_id': 'req-ee8ee515-2f16-41ba-abba-cd1644574757'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:36.287761 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62812d0-d2d6-4823-a722-b5bb175751aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:36.288642 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62812d0-d2d6-4823-a722-b5bb175751aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:36.288929 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62812d0-d2d6-4823-a722-b5bb175751aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:36.289255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62812d0-d2d6-4823-a722-b5bb175751aa admin admin] PATH_INFO: `/v3/projects/fbe711926bff4bce9330bdae96ae431b` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:36.290450 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62812d0-d2d6-4823-a722-b5bb175751aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe711926bff4bce9330bdae96ae431b)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:36.292351 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62812d0-d2d6-4823-a722-b5bb175751aa admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:36.379616 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ee8ee515-2f16-41ba-abba-cd1644574757 admin admin] The token cache is being invalidate because project 4595e302c5e54c1191a87c9985da6ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:36.380489 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ee8ee515-2f16-41ba-abba-cd1644574757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:36.380638 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ee8ee515-2f16-41ba-abba-cd1644574757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:36.382181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1031/2052] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:35 2022] DELETE /identity/v3/projects/4595e302c5e54c1191a87c9985da6ffc => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:36.386335 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ee515-2f16-41ba-abba-cd1644574757 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:36.387714 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ee8ee515-2f16-41ba-abba-cd1644574757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:36.401297 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ee515-2f16-41ba-abba-cd1644574757 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:36.407035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe149f-97b5-46d3-bc80-eb20e72ad8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:36.407923 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe149f-97b5-46d3-bc80-eb20e72ad8a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:36.408205 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe149f-97b5-46d3-bc80-eb20e72ad8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:36.408492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fe149f-97b5-46d3-bc80-eb20e72ad8a8 admin admin] PATH_INFO: `/v3/users/231eb3b32c924e62b99c1e95195935b2` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:36.409760 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe149f-97b5-46d3-bc80-eb20e72ad8a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=231eb3b32c924e62b99c1e95195935b2)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:36.411712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fe149f-97b5-46d3-bc80-eb20e72ad8a8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:36.432385 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b62812d0-d2d6-4823-a722-b5bb175751aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe711926bff4bce9330bdae96ae431b', 'request_id': 'req-b62812d0-d2d6-4823-a722-b5bb175751aa'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:36.439399 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b62812d0-d2d6-4823-a722-b5bb175751aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe711926bff4bce9330bdae96ae431b', 'request_id': 'req-b62812d0-d2d6-4823-a722-b5bb175751aa'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:36.445993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b62812d0-d2d6-4823-a722-b5bb175751aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe711926bff4bce9330bdae96ae431b', 'request_id': 'req-b62812d0-d2d6-4823-a722-b5bb175751aa'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:36.611894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b62812d0-d2d6-4823-a722-b5bb175751aa admin admin] The token cache is being invalidate because project fbe711926bff4bce9330bdae96ae431b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:36.612142 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b62812d0-d2d6-4823-a722-b5bb175751aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:36.612757 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b62812d0-d2d6-4823-a722-b5bb175751aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:36.614433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1022/2053] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:36 2022] DELETE /identity/v3/projects/fbe711926bff4bce9330bdae96ae431b => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:36.620567 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41541489-80c8-4f63-a6e7-c930100c8a6d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:36.620861 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41541489-80c8-4f63-a6e7-c930100c8a6d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:36.621193 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41541489-80c8-4f63-a6e7-c930100c8a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:36.642234 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-41541489-80c8-4f63-a6e7-c930100c8a6d None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:36.643472 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-41541489-80c8-4f63-a6e7-c930100c8a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:36.717417 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1023/2054] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:36.719271 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a6181-73f7-463b-9eb2-80b848ff05f8 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:36.725641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a6181-73f7-463b-9eb2-80b848ff05f8 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:36.725641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a6181-73f7-463b-9eb2-80b848ff05f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:36.739125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-582a6181-73f7-463b-9eb2-80b848ff05f8 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:36.740338 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-582a6181-73f7-463b-9eb2-80b848ff05f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:36.752140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1024/2055] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:36.756572 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a6181-73f7-463b-9eb2-80b848ff05f8 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:36.757121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-97fe149f-97b5-46d3-bc80-eb20e72ad8a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '231eb3b32c924e62b99c1e95195935b2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:36.767614 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a6181-73f7-463b-9eb2-80b848ff05f8 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:36.772342 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451da81-e2f8-48a1-b125-2eb3beb40758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:36.773033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451da81-e2f8-48a1-b125-2eb3beb40758 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:36.773331 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451da81-e2f8-48a1-b125-2eb3beb40758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:36.773614 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5451da81-e2f8-48a1-b125-2eb3beb40758 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:36.774351 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451da81-e2f8-48a1-b125-2eb3beb40758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:52:36.774659 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451da81-e2f8-48a1-b125-2eb3beb40758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:36.776297 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5451da81-e2f8-48a1-b125-2eb3beb40758 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:36.788283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1025/2056] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:52:36.792861 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451da81-e2f8-48a1-b125-2eb3beb40758 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:36.803451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5451da81-e2f8-48a1-b125-2eb3beb40758 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:36.808245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2cfcc-3f7f-418e-b677-39fafa18a241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:36.808891 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2cfcc-3f7f-418e-b677-39fafa18a241 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:36.809247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2cfcc-3f7f-418e-b677-39fafa18a241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:36.809535 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2cfcc-3f7f-418e-b677-39fafa18a241 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:36.810237 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2cfcc-3f7f-418e-b677-39fafa18a241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:36.812879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2cfcc-3f7f-418e-b677-39fafa18a241 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:36.833950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-97fe149f-97b5-46d3-bc80-eb20e72ad8a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '231eb3b32c924e62b99c1e95195935b2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:36.841382 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-97fe149f-97b5-46d3-bc80-eb20e72ad8a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '231eb3b32c924e62b99c1e95195935b2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:36.842032 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-97fe149f-97b5-46d3-bc80-eb20e72ad8a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '231eb3b32c924e62b99c1e95195935b2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:36.853719 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-97fe149f-97b5-46d3-bc80-eb20e72ad8a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '231eb3b32c924e62b99c1e95195935b2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:36.861228 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1032/2057] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:36 2022] DELETE /identity/v3/users/231eb3b32c924e62b99c1e95195935b2 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:36.934516 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1026/2058] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:36 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:36.935651 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe149f-97b5-46d3-bc80-eb20e72ad8a8 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:36.937783 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-97fe149f-97b5-46d3-bc80-eb20e72ad8a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:37.005175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fe149f-97b5-46d3-bc80-eb20e72ad8a8 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:37.062973 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c87c6-fc6e-4173-8a49-c2c83cd127b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:37.063663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c87c6-fc6e-4173-8a49-c2c83cd127b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:37.063979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c87c6-fc6e-4173-8a49-c2c83cd127b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:37.064334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c87c6-fc6e-4173-8a49-c2c83cd127b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:37.065022 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c87c6-fc6e-4173-8a49-c2c83cd127b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:37.066999 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3c87c6-fc6e-4173-8a49-c2c83cd127b6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:37.155371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1033/2059] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:36 2022] POST /identity/v3/users => generated 294 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:37.159700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2cfcc-3f7f-418e-b677-39fafa18a241 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:37.170312 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2cfcc-3f7f-418e-b677-39fafa18a241 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:37.177163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:37.179608 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a017a-7db4-460f-8505-19c1019899f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:37.184206 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a017a-7db4-460f-8505-19c1019899f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:37.184206 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a017a-7db4-460f-8505-19c1019899f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:37.184206 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a017a-7db4-460f-8505-19c1019899f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:37.184206 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a017a-7db4-460f-8505-19c1019899f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:37.184206 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a017a-7db4-460f-8505-19c1019899f0 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:37.197059 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1027/2060] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:52:37.198535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c87c6-fc6e-4173-8a49-c2c83cd127b6 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:37.209565 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c87c6-fc6e-4173-8a49-c2c83cd127b6 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:37.214433 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729e77d-342f-449b-970c-7a2f3b5d676d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:37.215099 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729e77d-342f-449b-970c-7a2f3b5d676d admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:37.215457 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729e77d-342f-449b-970c-7a2f3b5d676d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:37.215734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729e77d-342f-449b-970c-7a2f3b5d676d admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:37.216482 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729e77d-342f-449b-970c-7a2f3b5d676d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:37.230375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729e77d-342f-449b-970c-7a2f3b5d676d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:37.233440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1034/2061] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:37.236045 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a017a-7db4-460f-8505-19c1019899f0 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:37.246617 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a017a-7db4-460f-8505-19c1019899f0 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:37.253874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd384608-3588-404c-857a-fe020170c9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:37.254817 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd384608-3588-404c-857a-fe020170c9de admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:37.255296 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd384608-3588-404c-857a-fe020170c9de admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:37.255585 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd384608-3588-404c-857a-fe020170c9de admin admin] PATH_INFO: `/v3/projects/dbf5740c1cad4ff0bbfe1b3538b7635d/users/4d2d8cc03f4641c9941a1724dd63bb30/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:37.283237 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd384608-3588-404c-857a-fe020170c9de admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbf5740c1cad4ff0bbfe1b3538b7635d, user_id=4d2d8cc03f4641c9941a1724dd63bb30, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:37.285989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd384608-3588-404c-857a-fe020170c9de admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:37.401935 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729e77d-342f-449b-970c-7a2f3b5d676d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:37.403898 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2729e77d-342f-449b-970c-7a2f3b5d676d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:37.422582 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729e77d-342f-449b-970c-7a2f3b5d676d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:37.441968 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724d546-3e05-4b61-9f2e-ace1ba561eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:37.442347 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724d546-3e05-4b61-9f2e-ace1ba561eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:37.442641 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724d546-3e05-4b61-9f2e-ace1ba561eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:37.443017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724d546-3e05-4b61-9f2e-ace1ba561eef admin admin] PATH_INFO: `/v3/projects/26ba2bd22eb049e5b4345ddfb2248f9b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:37.444265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724d546-3e05-4b61-9f2e-ace1ba561eef admin admin] RBAC: Authorizing `identity:delete_project(project_id=26ba2bd22eb049e5b4345ddfb2248f9b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:37.446344 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724d546-3e05-4b61-9f2e-ace1ba561eef admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:37.508813 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1028/2062] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:37 2022] PUT /identity/v3/projects/dbf5740c1cad4ff0bbfe1b3538b7635d/users/4d2d8cc03f4641c9941a1724dd63bb30/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:37.509766 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd384608-3588-404c-857a-fe020170c9de admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:37.511325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-cd384608-3588-404c-857a-fe020170c9de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:37.542837 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:37.569980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd384608-3588-404c-857a-fe020170c9de admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:37.574149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f34f68-8bc2-46a0-ba69-ed742fe9477c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:37.574808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f34f68-8bc2-46a0-ba69-ed742fe9477c service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:37.575095 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f34f68-8bc2-46a0-ba69-ed742fe9477c service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:37.575374 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f34f68-8bc2-46a0-ba69-ed742fe9477c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:37.577170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a8f34f68-8bc2-46a0-ba69-ed742fe9477c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:37.617525 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5724d546-3e05-4b61-9f2e-ace1ba561eef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26ba2bd22eb049e5b4345ddfb2248f9b', 'request_id': 'req-5724d546-3e05-4b61-9f2e-ace1ba561eef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:37.624960 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5724d546-3e05-4b61-9f2e-ace1ba561eef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26ba2bd22eb049e5b4345ddfb2248f9b', 'request_id': 'req-5724d546-3e05-4b61-9f2e-ace1ba561eef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:37.631807 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5724d546-3e05-4b61-9f2e-ace1ba561eef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26ba2bd22eb049e5b4345ddfb2248f9b', 'request_id': 'req-5724d546-3e05-4b61-9f2e-ace1ba561eef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:37.639820 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f34f68-8bc2-46a0-ba69-ed742fe9477c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:37.642130 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f34f68-8bc2-46a0-ba69-ed742fe9477c service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:37.651265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1029/2063] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:37 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:37.652555 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a92fe6-e5cf-4d47-8094-904091f6f018 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:37.652829 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a92fe6-e5cf-4d47-8094-904091f6f018 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:37.653142 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a92fe6-e5cf-4d47-8094-904091f6f018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:37.682321 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-44a92fe6-e5cf-4d47-8094-904091f6f018 None None] MFA Rules not processed for user `4d2d8cc03f4641c9941a1724dd63bb30`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:37.683558 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-44a92fe6-e5cf-4d47-8094-904091f6f018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:37.766659 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5724d546-3e05-4b61-9f2e-ace1ba561eef admin admin] The token cache is being invalidate because project 26ba2bd22eb049e5b4345ddfb2248f9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:37.768308 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5724d546-3e05-4b61-9f2e-ace1ba561eef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:37.770080 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5724d546-3e05-4b61-9f2e-ace1ba561eef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:37.774247 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1035/2064] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:37 2022] DELETE /identity/v3/projects/26ba2bd22eb049e5b4345ddfb2248f9b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:37.783685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2ff82-2709-4f01-8548-e7d146c70242 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:37.784809 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2ff82-2709-4f01-8548-e7d146c70242 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:37.785457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1030/2065] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:37.787555 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a92fe6-e5cf-4d47-8094-904091f6f018 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:37.788338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2ff82-2709-4f01-8548-e7d146c70242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:37.819814 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2be2ff82-2709-4f01-8548-e7d146c70242 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:37.822080 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2be2ff82-2709-4f01-8548-e7d146c70242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:37.876644 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a92fe6-e5cf-4d47-8094-904091f6f018 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:37.884031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac443bde-63d7-485f-837c-b4d0cd41d7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:37.884718 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac443bde-63d7-485f-837c-b4d0cd41d7cd admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:37.885126 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac443bde-63d7-485f-837c-b4d0cd41d7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:37.885405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac443bde-63d7-485f-837c-b4d0cd41d7cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:37.886184 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac443bde-63d7-485f-837c-b4d0cd41d7cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:37.888466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac443bde-63d7-485f-837c-b4d0cd41d7cd admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:37.907174 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1036/2066] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:37.915504 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd43631-c120-415b-b3b6-afe59491b821 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:37.919592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd43631-c120-415b-b3b6-afe59491b821 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:37.919592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd43631-c120-415b-b3b6-afe59491b821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:37.935072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3fd43631-c120-415b-b3b6-afe59491b821 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:37.936313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3fd43631-c120-415b-b3b6-afe59491b821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:37.944820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1037/2067] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:37.949239 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd43631-c120-415b-b3b6-afe59491b821 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:37.959093 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd43631-c120-415b-b3b6-afe59491b821 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:37.963968 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b419f5b-30ba-44e7-956a-0bb3076e5bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:37.964631 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b419f5b-30ba-44e7-956a-0bb3076e5bbf admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:37.964919 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b419f5b-30ba-44e7-956a-0bb3076e5bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:37.965231 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b419f5b-30ba-44e7-956a-0bb3076e5bbf admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:37.965976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b419f5b-30ba-44e7-956a-0bb3076e5bbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:52:37.966287 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b419f5b-30ba-44e7-956a-0bb3076e5bbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:37.967893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b419f5b-30ba-44e7-956a-0bb3076e5bbf admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:37.981092 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1038/2068] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:52:37.986303 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b419f5b-30ba-44e7-956a-0bb3076e5bbf admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:37.996354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b419f5b-30ba-44e7-956a-0bb3076e5bbf admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:38.002250 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f765e85-fe0c-4283-9751-c8f7f896f72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:38.002956 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f765e85-fe0c-4283-9751-c8f7f896f72d admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:38.003245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f765e85-fe0c-4283-9751-c8f7f896f72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:38.003583 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f765e85-fe0c-4283-9751-c8f7f896f72d admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:38.004292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f765e85-fe0c-4283-9751-c8f7f896f72d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:38.006270 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f765e85-fe0c-4283-9751-c8f7f896f72d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:38.012999 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1031/2069] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:37 2022] POST /identity/v3/projects => generated 387 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:38.019303 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac443bde-63d7-485f-837c-b4d0cd41d7cd admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:38.021596 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ac443bde-63d7-485f-837c-b4d0cd41d7cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:38.088768 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac443bde-63d7-485f-837c-b4d0cd41d7cd admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:38.094987 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686685d0-f875-49dc-8176-0272d0957c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:38.095677 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686685d0-f875-49dc-8176-0272d0957c5a admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:38.095962 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686685d0-f875-49dc-8176-0272d0957c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:38.096608 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686685d0-f875-49dc-8176-0272d0957c5a admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:38.096944 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686685d0-f875-49dc-8176-0272d0957c5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:38.101922 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1039/2070] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:37 2022] POST /identity/v3/projects => generated 371 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:38.102061 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686685d0-f875-49dc-8176-0272d0957c5a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:38.103039 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f765e85-fe0c-4283-9751-c8f7f896f72d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:38.180961 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f765e85-fe0c-4283-9751-c8f7f896f72d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:38.187281 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023900f7-88bf-4918-9ad2-f0bc0bdeca47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:38.190374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023900f7-88bf-4918-9ad2-f0bc0bdeca47 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:38.190374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023900f7-88bf-4918-9ad2-f0bc0bdeca47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:38.190374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023900f7-88bf-4918-9ad2-f0bc0bdeca47 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:38.190374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023900f7-88bf-4918-9ad2-f0bc0bdeca47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:38.191337 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023900f7-88bf-4918-9ad2-f0bc0bdeca47 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:38.193288 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1032/2071] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:38 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:38.195339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686685d0-f875-49dc-8176-0272d0957c5a admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:38.206474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686685d0-f875-49dc-8176-0272d0957c5a admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:38.211488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4368e-047c-4d30-885a-95398094eb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:38.212201 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4368e-047c-4d30-885a-95398094eb97 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:38.212489 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4368e-047c-4d30-885a-95398094eb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:38.212772 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4368e-047c-4d30-885a-95398094eb97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:38.213620 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4368e-047c-4d30-885a-95398094eb97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:38.215162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c4368e-047c-4d30-885a-95398094eb97 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:38.226450 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1033/2072] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:52:38.230852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4368e-047c-4d30-885a-95398094eb97 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:38.241119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4368e-047c-4d30-885a-95398094eb97 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:38.245921 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069b5c1-7751-4cdb-9ece-9ebdde84a21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:38.246800 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069b5c1-7751-4cdb-9ece-9ebdde84a21e admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:38.247088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069b5c1-7751-4cdb-9ece-9ebdde84a21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:38.247368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069b5c1-7751-4cdb-9ece-9ebdde84a21e admin admin] PATH_INFO: `/v3/projects/f5be1077c802462ba65c1fcd1722a2f0/users/9f47bf8a7afb4a2b8b0b2814fdd099f9/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:38.262268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069b5c1-7751-4cdb-9ece-9ebdde84a21e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5be1077c802462ba65c1fcd1722a2f0, user_id=9f47bf8a7afb4a2b8b0b2814fdd099f9, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:38.264935 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069b5c1-7751-4cdb-9ece-9ebdde84a21e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:38.338414 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1040/2073] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:38 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:38.342526 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023900f7-88bf-4918-9ad2-f0bc0bdeca47 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:38.353893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023900f7-88bf-4918-9ad2-f0bc0bdeca47 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:38.359222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4b10d-e186-4578-b45b-f8b759b72a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:38.360081 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4b10d-e186-4578-b45b-f8b759b72a69 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:38.360255 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4b10d-e186-4578-b45b-f8b759b72a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:38.360503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4b10d-e186-4578-b45b-f8b759b72a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:38.361292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4b10d-e186-4578-b45b-f8b759b72a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:38.362918 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4b10d-e186-4578-b45b-f8b759b72a69 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:38.377301 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1041/2074] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:52:38.378779 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4b10d-e186-4578-b45b-f8b759b72a69 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:38.396336 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1034/2075] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:38 2022] PUT /identity/v3/projects/f5be1077c802462ba65c1fcd1722a2f0/users/9f47bf8a7afb4a2b8b0b2814fdd099f9/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:38.397849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4b10d-e186-4578-b45b-f8b759b72a69 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:38.400276 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069b5c1-7751-4cdb-9ece-9ebdde84a21e admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:38.499286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069b5c1-7751-4cdb-9ece-9ebdde84a21e admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:38.527677 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2108e7-d939-4986-8bd2-6076e6e82d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:38.530288 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2108e7-d939-4986-8bd2-6076e6e82d29 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:38.531449 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2108e7-d939-4986-8bd2-6076e6e82d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:38.533385 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2108e7-d939-4986-8bd2-6076e6e82d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:38.536181 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2108e7-d939-4986-8bd2-6076e6e82d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:38.540166 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2108e7-d939-4986-8bd2-6076e6e82d29 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:38.569288 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1035/2076] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:52:38.574344 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2108e7-d939-4986-8bd2-6076e6e82d29 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:38.575580 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d866055-3aef-48a7-a800-b63114985f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:38.576284 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d866055-3aef-48a7-a800-b63114985f59 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:38.576612 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d866055-3aef-48a7-a800-b63114985f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:38.578647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d866055-3aef-48a7-a800-b63114985f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:38.580921 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d866055-3aef-48a7-a800-b63114985f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:38.588157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d866055-3aef-48a7-a800-b63114985f59 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:38.592115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:38.603718 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2108e7-d939-4986-8bd2-6076e6e82d29 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:38.618953 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1042/2077] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:52:38.619552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d866055-3aef-48a7-a800-b63114985f59 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:38.621708 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98642f19-580f-469f-bcad-a5d997833916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:38.623474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98642f19-580f-469f-bcad-a5d997833916 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:38.623790 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98642f19-580f-469f-bcad-a5d997833916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:38.624081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98642f19-580f-469f-bcad-a5d997833916 admin admin] PATH_INFO: `/v3/projects/f5be1077c802462ba65c1fcd1722a2f0/users/9f47bf8a7afb4a2b8b0b2814fdd099f9/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:38.630868 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d866055-3aef-48a7-a800-b63114985f59 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:38.631875 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98642f19-580f-469f-bcad-a5d997833916 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5be1077c802462ba65c1fcd1722a2f0, user_id=9f47bf8a7afb4a2b8b0b2814fdd099f9, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:38.635921 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c87624-efb7-4582-bb94-696bdae77165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:38.636816 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c87624-efb7-4582-bb94-696bdae77165 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:38.637147 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c87624-efb7-4582-bb94-696bdae77165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:38.637428 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c87624-efb7-4582-bb94-696bdae77165 admin admin] PATH_INFO: `/v3/projects/6de94f35d60b48d8bc9bc6ce23d6f55f/users/c6d0307b31b74fca9644efbf06c6581d/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:38.649532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98642f19-580f-469f-bcad-a5d997833916 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:38.667095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c87624-efb7-4582-bb94-696bdae77165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de94f35d60b48d8bc9bc6ce23d6f55f, user_id=c6d0307b31b74fca9644efbf06c6581d, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:38.670145 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c87624-efb7-4582-bb94-696bdae77165 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:38.673180 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1036/2078] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:38 2022] PUT /identity/v3/projects/f5be1077c802462ba65c1fcd1722a2f0/users/9f47bf8a7afb4a2b8b0b2814fdd099f9/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:38.681200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d0d87-666c-4826-9143-47c0ef52513a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:38.681200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d0d87-666c-4826-9143-47c0ef52513a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:38.681200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d0d87-666c-4826-9143-47c0ef52513a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:38.707702 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e86d0d87-666c-4826-9143-47c0ef52513a None None] MFA Rules not processed for user `9f47bf8a7afb4a2b8b0b2814fdd099f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:38.708920 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e86d0d87-666c-4826-9143-47c0ef52513a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:38.779832 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1037/2079] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:38.793358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d0d87-666c-4826-9143-47c0ef52513a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:38.794777 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e86d0d87-666c-4826-9143-47c0ef52513a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:38.818006 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1043/2080] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:38 2022] PUT /identity/v3/projects/6de94f35d60b48d8bc9bc6ce23d6f55f/users/c6d0307b31b74fca9644efbf06c6581d/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:38.832893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffc227-9f82-4bd2-b89a-253ac08b1228 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:38.833255 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffc227-9f82-4bd2-b89a-253ac08b1228 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:38.833586 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffc227-9f82-4bd2-b89a-253ac08b1228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:38.859524 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d0d87-666c-4826-9143-47c0ef52513a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:38.863172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d6ffc227-9f82-4bd2-b89a-253ac08b1228 None None] MFA Rules not processed for user `c6d0307b31b74fca9644efbf06c6581d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:38.864758 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d6ffc227-9f82-4bd2-b89a-253ac08b1228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:38.912163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8542b06-d980-4d78-95bf-c290747e7cd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:38.912840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8542b06-d980-4d78-95bf-c290747e7cd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:38.913147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8542b06-d980-4d78-95bf-c290747e7cd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:38.913427 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8542b06-d980-4d78-95bf-c290747e7cd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:38.950588 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1044/2081] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:38.980404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8542b06-d980-4d78-95bf-c290747e7cd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:38.981917 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8542b06-d980-4d78-95bf-c290747e7cd7 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:38.993134 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1038/2082] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:52:39.595268 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffc227-9f82-4bd2-b89a-253ac08b1228 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:39.596808 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d6ffc227-9f82-4bd2-b89a-253ac08b1228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:39.601789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:39.611229 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffc227-9f82-4bd2-b89a-253ac08b1228 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:39.614806 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f6e80-a2c5-428b-b994-bcc77ea6d2f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:39.615453 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f6e80-a2c5-428b-b994-bcc77ea6d2f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:39.615734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f6e80-a2c5-428b-b994-bcc77ea6d2f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:39.616274 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1f6e80-a2c5-428b-b994-bcc77ea6d2f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:39.625752 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f6e80-a2c5-428b-b994-bcc77ea6d2f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:39.627242 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1f6e80-a2c5-428b-b994-bcc77ea6d2f0 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:39.641155 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1045/2083] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:39.677153 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8542b06-d980-4d78-95bf-c290747e7cd7 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:39.775206 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8542b06-d980-4d78-95bf-c290747e7cd7 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:39.782364 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66fc3b-6ce7-4d19-843a-4847a598ee72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:39.783822 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66fc3b-6ce7-4d19-843a-4847a598ee72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:39.784592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66fc3b-6ce7-4d19-843a-4847a598ee72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:39.784685 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66fc3b-6ce7-4d19-843a-4847a598ee72 admin admin] PATH_INFO: `/v3/users/c6d0307b31b74fca9644efbf06c6581d` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:39.785995 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66fc3b-6ce7-4d19-843a-4847a598ee72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6d0307b31b74fca9644efbf06c6581d)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:39.788161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66fc3b-6ce7-4d19-843a-4847a598ee72 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:39.816256 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f6e80-a2c5-428b-b994-bcc77ea6d2f0 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:39.826137 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1f6e80-a2c5-428b-b994-bcc77ea6d2f0 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:39.833319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21bc3c-d034-4cbf-b6fa-d6299df93815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:39.833319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21bc3c-d034-4cbf-b6fa-d6299df93815 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:39.833319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21bc3c-d034-4cbf-b6fa-d6299df93815 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:39.833319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21bc3c-d034-4cbf-b6fa-d6299df93815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:39.835100 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5c21bc3c-d034-4cbf-b6fa-d6299df93815 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:39.911832 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21bc3c-d034-4cbf-b6fa-d6299df93815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:39.913342 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21bc3c-d034-4cbf-b6fa-d6299df93815 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:39.923470 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1046/2084] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:52:40.215853 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1b66fc3b-6ce7-4d19-843a-4847a598ee72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6d0307b31b74fca9644efbf06c6581d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:40.274615 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:40.334730 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1b66fc3b-6ce7-4d19-843a-4847a598ee72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6d0307b31b74fca9644efbf06c6581d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:40.343668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1b66fc3b-6ce7-4d19-843a-4847a598ee72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6d0307b31b74fca9644efbf06c6581d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:40.344558 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1b66fc3b-6ce7-4d19-843a-4847a598ee72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6d0307b31b74fca9644efbf06c6581d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:40.360674 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1b66fc3b-6ce7-4d19-843a-4847a598ee72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6d0307b31b74fca9644efbf06c6581d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:40.370864 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1039/2085] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:39 2022] DELETE /identity/v3/users/c6d0307b31b74fca9644efbf06c6581d => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:40.378139 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c18a9-7b3d-4c7b-a5ac-7a5ff74025da None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:40.378487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c18a9-7b3d-4c7b-a5ac-7a5ff74025da None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:40.378826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1c18a9-7b3d-4c7b-a5ac-7a5ff74025da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:40.399824 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ce1c18a9-7b3d-4c7b-a5ac-7a5ff74025da None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:40.401306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ce1c18a9-7b3d-4c7b-a5ac-7a5ff74025da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:40.471571 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1047/2086] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:40.481888 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66fc3b-6ce7-4d19-843a-4847a598ee72 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:40.483443 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1b66fc3b-6ce7-4d19-843a-4847a598ee72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:40.546226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66fc3b-6ce7-4d19-843a-4847a598ee72 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:40.550724 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f2ab2-76f3-4115-aaf2-dd114dc5b374 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:40.551387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f2ab2-76f3-4115-aaf2-dd114dc5b374 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:40.551671 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f2ab2-76f3-4115-aaf2-dd114dc5b374 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:40.551947 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0f2ab2-76f3-4115-aaf2-dd114dc5b374 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:40.561683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f2ab2-76f3-4115-aaf2-dd114dc5b374 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:40.563982 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0f2ab2-76f3-4115-aaf2-dd114dc5b374 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:40.574327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1040/2087] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:52:41.137071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c18a9-7b3d-4c7b-a5ac-7a5ff74025da None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:41.138575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ce1c18a9-7b3d-4c7b-a5ac-7a5ff74025da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:41.140412 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f2ab2-76f3-4115-aaf2-dd114dc5b374 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:41.142021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9d0f2ab2-76f3-4115-aaf2-dd114dc5b374 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:41.157822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1c18a9-7b3d-4c7b-a5ac-7a5ff74025da None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:41.163132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dac736-b3ef-40ce-84cc-05feccef9b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:41.172667 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dac736-b3ef-40ce-84cc-05feccef9b0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:41.172667 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dac736-b3ef-40ce-84cc-05feccef9b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:41.172667 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dac736-b3ef-40ce-84cc-05feccef9b0c admin admin] PATH_INFO: `/v3/projects/6de94f35d60b48d8bc9bc6ce23d6f55f` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:41.173569 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0f2ab2-76f3-4115-aaf2-dd114dc5b374 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:41.174028 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dac736-b3ef-40ce-84cc-05feccef9b0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de94f35d60b48d8bc9bc6ce23d6f55f)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:41.174028 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dac736-b3ef-40ce-84cc-05feccef9b0c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:41.178809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd96664-1665-48a7-9a9a-628b43e94252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:41.178809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd96664-1665-48a7-9a9a-628b43e94252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:41.178809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd96664-1665-48a7-9a9a-628b43e94252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:41.179116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd96664-1665-48a7-9a9a-628b43e94252 admin admin] PATH_INFO: `/v3/users/4d2d8cc03f4641c9941a1724dd63bb30` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:41.180336 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd96664-1665-48a7-9a9a-628b43e94252 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d2d8cc03f4641c9941a1724dd63bb30)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:41.182400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd96664-1665-48a7-9a9a-628b43e94252 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:41.249325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:41.428841 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9fd96664-1665-48a7-9a9a-628b43e94252 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d2d8cc03f4641c9941a1724dd63bb30'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:41.429097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-82dac736-b3ef-40ce-84cc-05feccef9b0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de94f35d60b48d8bc9bc6ce23d6f55f', 'request_id': 'req-82dac736-b3ef-40ce-84cc-05feccef9b0c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:41.435615 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-82dac736-b3ef-40ce-84cc-05feccef9b0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de94f35d60b48d8bc9bc6ce23d6f55f', 'request_id': 'req-82dac736-b3ef-40ce-84cc-05feccef9b0c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:41.442450 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-82dac736-b3ef-40ce-84cc-05feccef9b0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de94f35d60b48d8bc9bc6ce23d6f55f', 'request_id': 'req-82dac736-b3ef-40ce-84cc-05feccef9b0c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:41.546120 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9fd96664-1665-48a7-9a9a-628b43e94252 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d2d8cc03f4641c9941a1724dd63bb30'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:41.554381 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9fd96664-1665-48a7-9a9a-628b43e94252 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d2d8cc03f4641c9941a1724dd63bb30'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:41.555052 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9fd96664-1665-48a7-9a9a-628b43e94252 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d2d8cc03f4641c9941a1724dd63bb30'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:41.567453 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9fd96664-1665-48a7-9a9a-628b43e94252 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d2d8cc03f4641c9941a1724dd63bb30'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:41.573879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1041/2088] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:41 2022] DELETE /identity/v3/users/4d2d8cc03f4641c9941a1724dd63bb30 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:41.578058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197edeb4-eeb5-44c7-b088-4eb2cc66b47a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:41.578349 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197edeb4-eeb5-44c7-b088-4eb2cc66b47a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:41.578626 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197edeb4-eeb5-44c7-b088-4eb2cc66b47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:41.596404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-197edeb4-eeb5-44c7-b088-4eb2cc66b47a None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:41.597661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-197edeb4-eeb5-44c7-b088-4eb2cc66b47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:41.627280 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:41.658953 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-82dac736-b3ef-40ce-84cc-05feccef9b0c admin admin] The token cache is being invalidate because project 6de94f35d60b48d8bc9bc6ce23d6f55f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:41.659257 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-82dac736-b3ef-40ce-84cc-05feccef9b0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:41.659969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-82dac736-b3ef-40ce-84cc-05feccef9b0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:41.661913 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1048/2089] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:41 2022] DELETE /identity/v3/projects/6de94f35d60b48d8bc9bc6ce23d6f55f => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:41.666666 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37b376-5979-4eb0-9fdc-98692bd1ec5c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:41.666960 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37b376-5979-4eb0-9fdc-98692bd1ec5c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:41.667241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a37b376-5979-4eb0-9fdc-98692bd1ec5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:41.668136 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1042/2090] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:41.680016 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197edeb4-eeb5-44c7-b088-4eb2cc66b47a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:41.682105 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-197edeb4-eeb5-44c7-b088-4eb2cc66b47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:41.687352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3a37b376-5979-4eb0-9fdc-98692bd1ec5c None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:41.688723 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3a37b376-5979-4eb0-9fdc-98692bd1ec5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:41.699925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1049/2091] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:41.714925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6df55-6243-4c2a-bb46-63e4f5f87319 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:41.715212 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6df55-6243-4c2a-bb46-63e4f5f87319 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:41.715495 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6df55-6243-4c2a-bb46-63e4f5f87319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:41.736990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-17b6df55-6243-4c2a-bb46-63e4f5f87319 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:41.738247 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-17b6df55-6243-4c2a-bb46-63e4f5f87319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:41.748924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197edeb4-eeb5-44c7-b088-4eb2cc66b47a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:41.753000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdad09-07f8-489e-a543-29dc9c584478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:41.753556 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1050/2092] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:41.753764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdad09-07f8-489e-a543-29dc9c584478 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:41.754056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdad09-07f8-489e-a543-29dc9c584478 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:41.754420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cdad09-07f8-489e-a543-29dc9c584478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:41.757576 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6df55-6243-4c2a-bb46-63e4f5f87319 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:41.764830 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdad09-07f8-489e-a543-29dc9c584478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:41.766483 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cdad09-07f8-489e-a543-29dc9c584478 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:41.768470 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6df55-6243-4c2a-bb46-63e4f5f87319 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:41.773282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457a552-eb00-438f-ae29-e94dc7d563ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:41.773950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457a552-eb00-438f-ae29-e94dc7d563ed admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:41.782359 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457a552-eb00-438f-ae29-e94dc7d563ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:41.782359 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457a552-eb00-438f-ae29-e94dc7d563ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:41.782359 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457a552-eb00-438f-ae29-e94dc7d563ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:52:41.782359 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457a552-eb00-438f-ae29-e94dc7d563ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:41.782676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1043/2093] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:52:41.782753 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457a552-eb00-438f-ae29-e94dc7d563ed admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:41.793073 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1051/2094] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:52:41.795372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdad09-07f8-489e-a543-29dc9c584478 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:41.806871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cdad09-07f8-489e-a543-29dc9c584478 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:41.812740 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4f174-6406-49c9-961f-d599ba3c559d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:41.813777 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4f174-6406-49c9-961f-d599ba3c559d admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:41.814090 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4f174-6406-49c9-961f-d599ba3c559d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:41.814546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f4f174-6406-49c9-961f-d599ba3c559d admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:41.815104 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4f174-6406-49c9-961f-d599ba3c559d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:41.818019 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f4f174-6406-49c9-961f-d599ba3c559d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:41.982231 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1044/2095] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:41 2022] POST /identity/v3/projects => generated 375 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:41.986536 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457a552-eb00-438f-ae29-e94dc7d563ed admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:41.998404 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457a552-eb00-438f-ae29-e94dc7d563ed admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:42.070062 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d1614-f0e3-4ab3-892c-2a26e99f5307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:42.071073 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1614-f0e3-4ab3-892c-2a26e99f5307 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:42.071584 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1614-f0e3-4ab3-892c-2a26e99f5307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:42.072021 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d1614-f0e3-4ab3-892c-2a26e99f5307 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:42.073145 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d1614-f0e3-4ab3-892c-2a26e99f5307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:42.076132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d1614-f0e3-4ab3-892c-2a26e99f5307 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:42.182744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1052/2096] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:41 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:42.188210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4f174-6406-49c9-961f-d599ba3c559d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:42.221741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f4f174-6406-49c9-961f-d599ba3c559d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:42.227567 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd95770-d60d-4516-90e1-7dbe55ccf691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:42.228386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd95770-d60d-4516-90e1-7dbe55ccf691 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:42.228923 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd95770-d60d-4516-90e1-7dbe55ccf691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:42.229440 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd95770-d60d-4516-90e1-7dbe55ccf691 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:42.230663 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd95770-d60d-4516-90e1-7dbe55ccf691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:42.233684 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd95770-d60d-4516-90e1-7dbe55ccf691 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:42.253802 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1045/2097] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:52:42.257661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d1614-f0e3-4ab3-892c-2a26e99f5307 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:42.284035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d1614-f0e3-4ab3-892c-2a26e99f5307 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:42.300888 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f66661-5b42-40ca-9d21-d647a3536c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:42.300888 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f66661-5b42-40ca-9d21-d647a3536c52 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:42.301603 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f66661-5b42-40ca-9d21-d647a3536c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:42.304936 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f66661-5b42-40ca-9d21-d647a3536c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:42.304936 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f66661-5b42-40ca-9d21-d647a3536c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:42.311516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f66661-5b42-40ca-9d21-d647a3536c52 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:42.337062 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1053/2098] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:42.340930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd95770-d60d-4516-90e1-7dbe55ccf691 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:42.353608 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd95770-d60d-4516-90e1-7dbe55ccf691 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:42.358760 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f1bdc-13c9-49d3-9968-dc000624b6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:42.360437 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f1bdc-13c9-49d3-9968-dc000624b6d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:42.360766 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f1bdc-13c9-49d3-9968-dc000624b6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:42.361157 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f1bdc-13c9-49d3-9968-dc000624b6d6 admin admin] PATH_INFO: `/v3/projects/a1bfcc64565642ef99b5cda5e03d59ed/users/0e8445cbb93a4579875c51b559697687/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:42.377920 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f1bdc-13c9-49d3-9968-dc000624b6d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1bfcc64565642ef99b5cda5e03d59ed, user_id=0e8445cbb93a4579875c51b559697687, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:42.380778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f1bdc-13c9-49d3-9968-dc000624b6d6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:42.472832 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1046/2099] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:42 2022] PUT /identity/v3/projects/a1bfcc64565642ef99b5cda5e03d59ed/users/0e8445cbb93a4579875c51b559697687/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:42.483595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74caf6a-f0e4-401a-87de-1b5ca22adbc6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:42.483813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74caf6a-f0e4-401a-87de-1b5ca22adbc6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:42.484732 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74caf6a-f0e4-401a-87de-1b5ca22adbc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:42.513682 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b74caf6a-f0e4-401a-87de-1b5ca22adbc6 None None] MFA Rules not processed for user `0e8445cbb93a4579875c51b559697687`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:42.514899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b74caf6a-f0e4-401a-87de-1b5ca22adbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:42.580374 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f1bdc-13c9-49d3-9968-dc000624b6d6 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:42.582408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f73f1bdc-13c9-49d3-9968-dc000624b6d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:42.597372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1054/2100] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:42.605601 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74caf6a-f0e4-401a-87de-1b5ca22adbc6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:42.607143 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b74caf6a-f0e4-401a-87de-1b5ca22adbc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:42.658069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f1bdc-13c9-49d3-9968-dc000624b6d6 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:42.662919 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2418f3-dd62-45cb-822d-d6a6daf4c472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:42.663816 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2418f3-dd62-45cb-822d-d6a6daf4c472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:42.664150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2418f3-dd62-45cb-822d-d6a6daf4c472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:42.664409 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2418f3-dd62-45cb-822d-d6a6daf4c472 admin admin] PATH_INFO: `/v3/projects/dbf5740c1cad4ff0bbfe1b3538b7635d` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:42.665624 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2418f3-dd62-45cb-822d-d6a6daf4c472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbf5740c1cad4ff0bbfe1b3538b7635d)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:42.667535 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2418f3-dd62-45cb-822d-d6a6daf4c472 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:42.669504 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74caf6a-f0e4-401a-87de-1b5ca22adbc6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:42.674031 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81aa05-1d39-444a-bffd-200e51d4b4a4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e1900754214020931b202e98f660a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:42.674688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81aa05-1d39-444a-bffd-200e51d4b4a4 service glance] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:42.674975 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81aa05-1d39-444a-bffd-200e51d4b4a4 service glance] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:42.675253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81aa05-1d39-444a-bffd-200e51d4b4a4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:42.683999 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81aa05-1d39-444a-bffd-200e51d4b4a4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:42.686067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81aa05-1d39-444a-bffd-200e51d4b4a4 service glance] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:42.696806 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1055/2101] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:52:42.864725 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-eb2418f3-dd62-45cb-822d-d6a6daf4c472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbf5740c1cad4ff0bbfe1b3538b7635d', 'request_id': 'req-eb2418f3-dd62-45cb-822d-d6a6daf4c472'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:42.870354 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-eb2418f3-dd62-45cb-822d-d6a6daf4c472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbf5740c1cad4ff0bbfe1b3538b7635d', 'request_id': 'req-eb2418f3-dd62-45cb-822d-d6a6daf4c472'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:42.877178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-eb2418f3-dd62-45cb-822d-d6a6daf4c472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbf5740c1cad4ff0bbfe1b3538b7635d', 'request_id': 'req-eb2418f3-dd62-45cb-822d-d6a6daf4c472'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:43.001816 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-eb2418f3-dd62-45cb-822d-d6a6daf4c472 admin admin] The token cache is being invalidate because project dbf5740c1cad4ff0bbfe1b3538b7635d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:43.001816 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-eb2418f3-dd62-45cb-822d-d6a6daf4c472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:43.001816 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-eb2418f3-dd62-45cb-822d-d6a6daf4c472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:43.003164 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1047/2102] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:42 2022] DELETE /identity/v3/projects/dbf5740c1cad4ff0bbfe1b3538b7635d => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:43.007207 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81aa05-1d39-444a-bffd-200e51d4b4a4 service glance] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:43.018582 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81aa05-1d39-444a-bffd-200e51d4b4a4 service glance] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:43.074805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cc87d-18ee-4aa9-a609-85b7c307e727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:43.075815 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cc87d-18ee-4aa9-a609-85b7c307e727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:43.076050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cc87d-18ee-4aa9-a609-85b7c307e727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:43.076250 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cc87d-18ee-4aa9-a609-85b7c307e727 admin admin] PATH_INFO: `/v3/users/9f47bf8a7afb4a2b8b0b2814fdd099f9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:43.077500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cc87d-18ee-4aa9-a609-85b7c307e727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f47bf8a7afb4a2b8b0b2814fdd099f9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:43.079557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cc87d-18ee-4aa9-a609-85b7c307e727 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:43.373879 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-cb8cc87d-18ee-4aa9-a609-85b7c307e727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f47bf8a7afb4a2b8b0b2814fdd099f9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:43.470127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:43.470894 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-cb8cc87d-18ee-4aa9-a609-85b7c307e727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f47bf8a7afb4a2b8b0b2814fdd099f9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:43.478414 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-cb8cc87d-18ee-4aa9-a609-85b7c307e727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f47bf8a7afb4a2b8b0b2814fdd099f9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:43.479166 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-cb8cc87d-18ee-4aa9-a609-85b7c307e727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f47bf8a7afb4a2b8b0b2814fdd099f9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:43.492044 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-cb8cc87d-18ee-4aa9-a609-85b7c307e727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f47bf8a7afb4a2b8b0b2814fdd099f9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:43.498947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1056/2103] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:43 2022] DELETE /identity/v3/users/9f47bf8a7afb4a2b8b0b2814fdd099f9 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:43.917537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:43.999308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2418f3-dd62-45cb-822d-d6a6daf4c472 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:44.000879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-eb2418f3-dd62-45cb-822d-d6a6daf4c472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:44.015330 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2418f3-dd62-45cb-822d-d6a6daf4c472 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:44.076227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6187018-cf38-4924-8524-a846d8315c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:44.077165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6187018-cf38-4924-8524-a846d8315c70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:44.077550 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6187018-cf38-4924-8524-a846d8315c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:44.078500 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6187018-cf38-4924-8524-a846d8315c70 admin admin] PATH_INFO: `/v3/projects/f5be1077c802462ba65c1fcd1722a2f0` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:44.079764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6187018-cf38-4924-8524-a846d8315c70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5be1077c802462ba65c1fcd1722a2f0)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:44.081733 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6187018-cf38-4924-8524-a846d8315c70 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:44.278475 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c6187018-cf38-4924-8524-a846d8315c70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5be1077c802462ba65c1fcd1722a2f0', 'request_id': 'req-c6187018-cf38-4924-8524-a846d8315c70'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:44.285577 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c6187018-cf38-4924-8524-a846d8315c70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5be1077c802462ba65c1fcd1722a2f0', 'request_id': 'req-c6187018-cf38-4924-8524-a846d8315c70'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:44.293480 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c6187018-cf38-4924-8524-a846d8315c70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5be1077c802462ba65c1fcd1722a2f0', 'request_id': 'req-c6187018-cf38-4924-8524-a846d8315c70'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:44.392368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c6187018-cf38-4924-8524-a846d8315c70 admin admin] The token cache is being invalidate because project f5be1077c802462ba65c1fcd1722a2f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:44.392605 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c6187018-cf38-4924-8524-a846d8315c70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:44.393350 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c6187018-cf38-4924-8524-a846d8315c70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:44.400221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1048/2104] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:43 2022] DELETE /identity/v3/projects/f5be1077c802462ba65c1fcd1722a2f0 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:44.401125 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57015c21-54c2-4a1f-98cc-0f2ca9496a5a None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:44.401659 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57015c21-54c2-4a1f-98cc-0f2ca9496a5a None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:44.401745 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57015c21-54c2-4a1f-98cc-0f2ca9496a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:44.421119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-57015c21-54c2-4a1f-98cc-0f2ca9496a5a None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:44.422430 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-57015c21-54c2-4a1f-98cc-0f2ca9496a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:44.488623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1057/2105] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:44.500163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94233f31-3bee-4c7e-89d3-52a71c620124 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:44.500163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94233f31-3bee-4c7e-89d3-52a71c620124 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:44.500163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94233f31-3bee-4c7e-89d3-52a71c620124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:44.521264 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-94233f31-3bee-4c7e-89d3-52a71c620124 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:44.528201 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-94233f31-3bee-4c7e-89d3-52a71c620124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:44.533067 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1049/2106] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:44.537522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57015c21-54c2-4a1f-98cc-0f2ca9496a5a None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:44.548569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57015c21-54c2-4a1f-98cc-0f2ca9496a5a None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:44.554526 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c758d5c-d77e-4dc5-aec3-ea80366738c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:44.555277 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c758d5c-d77e-4dc5-aec3-ea80366738c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:44.555653 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c758d5c-d77e-4dc5-aec3-ea80366738c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:44.555941 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c758d5c-d77e-4dc5-aec3-ea80366738c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:44.557103 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c758d5c-d77e-4dc5-aec3-ea80366738c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:52:44.557427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c758d5c-d77e-4dc5-aec3-ea80366738c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:44.559261 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c758d5c-d77e-4dc5-aec3-ea80366738c2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:44.573448 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1058/2107] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:52:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:52:44.578588 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94233f31-3bee-4c7e-89d3-52a71c620124 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:44.588488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94233f31-3bee-4c7e-89d3-52a71c620124 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:44.593720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bd1d7-8440-43cb-a0b3-f457a6bb454f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:44.594424 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bd1d7-8440-43cb-a0b3-f457a6bb454f admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:44.594716 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bd1d7-8440-43cb-a0b3-f457a6bb454f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:44.594996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618bd1d7-8440-43cb-a0b3-f457a6bb454f admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:44.595711 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bd1d7-8440-43cb-a0b3-f457a6bb454f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:44.597731 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618bd1d7-8440-43cb-a0b3-f457a6bb454f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:44.739845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1050/2108] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:44 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:44.744024 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c758d5c-d77e-4dc5-aec3-ea80366738c2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:44.754582 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c758d5c-d77e-4dc5-aec3-ea80366738c2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:44.811924 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52704712-1760-4f52-af98-a80da2b866c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:44.813425 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52704712-1760-4f52-af98-a80da2b866c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:44.817672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52704712-1760-4f52-af98-a80da2b866c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:44.817672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52704712-1760-4f52-af98-a80da2b866c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:44.817672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52704712-1760-4f52-af98-a80da2b866c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:44.817672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52704712-1760-4f52-af98-a80da2b866c9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:44.956581 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1059/2109] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:44 2022] POST /identity/v3/users => generated 287 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:44.961196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bd1d7-8440-43cb-a0b3-f457a6bb454f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:44.979459 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618bd1d7-8440-43cb-a0b3-f457a6bb454f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:44.995707 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be8c70-4f54-4275-b21f-71e3470f1f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:44.996423 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be8c70-4f54-4275-b21f-71e3470f1f02 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:44.996729 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be8c70-4f54-4275-b21f-71e3470f1f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:44.997054 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be8c70-4f54-4275-b21f-71e3470f1f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:44.997848 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be8c70-4f54-4275-b21f-71e3470f1f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:45.001160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be8c70-4f54-4275-b21f-71e3470f1f02 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:45.013930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1051/2110] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:45.022763 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52704712-1760-4f52-af98-a80da2b866c9 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:45.044250 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52704712-1760-4f52-af98-a80da2b866c9 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:45.053670 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30edc104-b35d-417a-b281-0af4f3655db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:45.054640 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edc104-b35d-417a-b281-0af4f3655db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:45.055203 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edc104-b35d-417a-b281-0af4f3655db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:45.055694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30edc104-b35d-417a-b281-0af4f3655db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:45.057271 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edc104-b35d-417a-b281-0af4f3655db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:45.066491 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30edc104-b35d-417a-b281-0af4f3655db0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:45.074062 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1060/2111] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:52:45.078271 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be8c70-4f54-4275-b21f-71e3470f1f02 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:45.088750 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be8c70-4f54-4275-b21f-71e3470f1f02 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:45.093839 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cba9b5-9241-4ea1-b705-53427f93dd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:45.094801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cba9b5-9241-4ea1-b705-53427f93dd6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:45.095094 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cba9b5-9241-4ea1-b705-53427f93dd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:45.095373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cba9b5-9241-4ea1-b705-53427f93dd6e admin admin] PATH_INFO: `/v3/projects/99ae4bdba9404be09aafe72858de5a18/users/6809c29bee4041c393e6773643c63c2d/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:45.112432 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cba9b5-9241-4ea1-b705-53427f93dd6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ae4bdba9404be09aafe72858de5a18, user_id=6809c29bee4041c393e6773643c63c2d, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:45.115234 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cba9b5-9241-4ea1-b705-53427f93dd6e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:45.228724 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1052/2112] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:45 2022] PUT /identity/v3/projects/99ae4bdba9404be09aafe72858de5a18/users/6809c29bee4041c393e6773643c63c2d/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:45.234869 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f0f6a-95eb-48a2-b96b-206b0aa23dcc None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:45.235386 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f0f6a-95eb-48a2-b96b-206b0aa23dcc None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:45.236092 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9f0f6a-95eb-48a2-b96b-206b0aa23dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:45.254645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5a9f0f6a-95eb-48a2-b96b-206b0aa23dcc None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:45.256106 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5a9f0f6a-95eb-48a2-b96b-206b0aa23dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:45.320625 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1061/2113] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:45.334320 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cba9b5-9241-4ea1-b705-53427f93dd6e admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:45.338253 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-19cba9b5-9241-4ea1-b705-53427f93dd6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:45.403593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cba9b5-9241-4ea1-b705-53427f93dd6e admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:45.410481 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc37810e-3d57-4444-9d16-2533feb761b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:45.411155 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37810e-3d57-4444-9d16-2533feb761b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:45.411443 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37810e-3d57-4444-9d16-2533feb761b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:45.411731 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc37810e-3d57-4444-9d16-2533feb761b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:45.422386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37810e-3d57-4444-9d16-2533feb761b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:45.424140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc37810e-3d57-4444-9d16-2533feb761b3 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:45.434942 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1053/2114] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:45.763053 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:46.202107 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f0f6a-95eb-48a2-b96b-206b0aa23dcc None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:46.204871 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5a9f0f6a-95eb-48a2-b96b-206b0aa23dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:46.215168 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:46.222628 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9f0f6a-95eb-48a2-b96b-206b0aa23dcc None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:46.227442 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde9584-4347-48e0-bfc8-a49b6f8ff40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:46.228357 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde9584-4347-48e0-bfc8-a49b6f8ff40d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:46.228642 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde9584-4347-48e0-bfc8-a49b6f8ff40d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:46.228917 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde9584-4347-48e0-bfc8-a49b6f8ff40d admin admin] PATH_INFO: `/v3/users/f659b63f72b04b61a104ee735550487b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:46.230206 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde9584-4347-48e0-bfc8-a49b6f8ff40d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f659b63f72b04b61a104ee735550487b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:46.232413 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde9584-4347-48e0-bfc8-a49b6f8ff40d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:46.580641 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bdde9584-4347-48e0-bfc8-a49b6f8ff40d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f659b63f72b04b61a104ee735550487b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:46.720734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bdde9584-4347-48e0-bfc8-a49b6f8ff40d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f659b63f72b04b61a104ee735550487b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:46.732735 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bdde9584-4347-48e0-bfc8-a49b6f8ff40d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f659b63f72b04b61a104ee735550487b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:46.738165 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bdde9584-4347-48e0-bfc8-a49b6f8ff40d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f659b63f72b04b61a104ee735550487b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:46.769225 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bdde9584-4347-48e0-bfc8-a49b6f8ff40d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f659b63f72b04b61a104ee735550487b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:46.776414 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1062/2115] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:46 2022] DELETE /identity/v3/users/f659b63f72b04b61a104ee735550487b => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:46.780522 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28504eb4-dd84-49d3-848d-4913c8a67f61 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:46.781499 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28504eb4-dd84-49d3-848d-4913c8a67f61 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:46.781973 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28504eb4-dd84-49d3-848d-4913c8a67f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:46.801332 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-28504eb4-dd84-49d3-848d-4913c8a67f61 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:46.802605 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-28504eb4-dd84-49d3-848d-4913c8a67f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:46.884231 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1054/2116] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:46.895840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde9584-4347-48e0-bfc8-a49b6f8ff40d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:46.897278 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bdde9584-4347-48e0-bfc8-a49b6f8ff40d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:46.958502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde9584-4347-48e0-bfc8-a49b6f8ff40d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:46.962332 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ef09f-262f-47a7-b7b0-0647dddad9c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:46.962994 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ef09f-262f-47a7-b7b0-0647dddad9c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:46.963283 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ef09f-262f-47a7-b7b0-0647dddad9c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:46.963567 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ef09f-262f-47a7-b7b0-0647dddad9c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:46.974648 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ef09f-262f-47a7-b7b0-0647dddad9c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:46.977822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ef09f-262f-47a7-b7b0-0647dddad9c7 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:46.989458 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1063/2117] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:47.135070 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7577b6-4ef0-4add-9693-d04e38d68e83 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:47.135464 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7577b6-4ef0-4add-9693-d04e38d68e83 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:47.135663 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7577b6-4ef0-4add-9693-d04e38d68e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:47.229542 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-7a7577b6-4ef0-4add-9693-d04e38d68e83 None None] MFA Rules not processed for user `6809c29bee4041c393e6773643c63c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:47.231143 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7a7577b6-4ef0-4add-9693-d04e38d68e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:47.386149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1055/2118] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:47.398300 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ef09f-262f-47a7-b7b0-0647dddad9c7 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:47.399862 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c35ef09f-262f-47a7-b7b0-0647dddad9c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:47.502442 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ef09f-262f-47a7-b7b0-0647dddad9c7 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:47.506668 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41cd48-19e5-4135-be90-3ebae0e79514 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:47.507443 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41cd48-19e5-4135-be90-3ebae0e79514 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:47.507731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41cd48-19e5-4135-be90-3ebae0e79514 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:47.508201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41cd48-19e5-4135-be90-3ebae0e79514 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:47.518177 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41cd48-19e5-4135-be90-3ebae0e79514 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:47.519651 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41cd48-19e5-4135-be90-3ebae0e79514 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:47.529947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1064/2119] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:47.907108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:47.914100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7577b6-4ef0-4add-9693-d04e38d68e83 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:47.915620 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7a7577b6-4ef0-4add-9693-d04e38d68e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:47.929894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7577b6-4ef0-4add-9693-d04e38d68e83 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:47.935177 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626419ce-ea6c-41d4-b99e-f38aa77a0724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:47.936618 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626419ce-ea6c-41d4-b99e-f38aa77a0724 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:47.936972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626419ce-ea6c-41d4-b99e-f38aa77a0724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:47.937745 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626419ce-ea6c-41d4-b99e-f38aa77a0724 admin admin] PATH_INFO: `/v3/projects/63c371af4a664f26a92bd681d4bfee9f` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:47.939143 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626419ce-ea6c-41d4-b99e-f38aa77a0724 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63c371af4a664f26a92bd681d4bfee9f)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:47.941071 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626419ce-ea6c-41d4-b99e-f38aa77a0724 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:48.071724 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-626419ce-ea6c-41d4-b99e-f38aa77a0724 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63c371af4a664f26a92bd681d4bfee9f', 'request_id': 'req-626419ce-ea6c-41d4-b99e-f38aa77a0724'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:48.077450 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-626419ce-ea6c-41d4-b99e-f38aa77a0724 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63c371af4a664f26a92bd681d4bfee9f', 'request_id': 'req-626419ce-ea6c-41d4-b99e-f38aa77a0724'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:48.084419 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-626419ce-ea6c-41d4-b99e-f38aa77a0724 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63c371af4a664f26a92bd681d4bfee9f', 'request_id': 'req-626419ce-ea6c-41d4-b99e-f38aa77a0724'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:48.182684 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-626419ce-ea6c-41d4-b99e-f38aa77a0724 admin admin] The token cache is being invalidate because project 63c371af4a664f26a92bd681d4bfee9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:48.183033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-626419ce-ea6c-41d4-b99e-f38aa77a0724 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:48.183710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-626419ce-ea6c-41d4-b99e-f38aa77a0724 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:48.185341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1056/2120] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:47 2022] DELETE /identity/v3/projects/63c371af4a664f26a92bd681d4bfee9f => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:48.191163 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41cd48-19e5-4135-be90-3ebae0e79514 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:48.205207 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41cd48-19e5-4135-be90-3ebae0e79514 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:48.266455 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:48.285823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2aa0df-1525-4c73-9ef6-75d7972f2758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:48.286850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2aa0df-1525-4c73-9ef6-75d7972f2758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:48.287199 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2aa0df-1525-4c73-9ef6-75d7972f2758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:48.287563 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2aa0df-1525-4c73-9ef6-75d7972f2758 admin admin] PATH_INFO: `/v3/users/51382e8aac0248898bb597ac228959fc` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:48.288793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2aa0df-1525-4c73-9ef6-75d7972f2758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51382e8aac0248898bb597ac228959fc)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:48.291068 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2aa0df-1525-4c73-9ef6-75d7972f2758 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:48.493811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-af2aa0df-1525-4c73-9ef6-75d7972f2758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51382e8aac0248898bb597ac228959fc'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:48.668573 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-af2aa0df-1525-4c73-9ef6-75d7972f2758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51382e8aac0248898bb597ac228959fc'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:48.679132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-af2aa0df-1525-4c73-9ef6-75d7972f2758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51382e8aac0248898bb597ac228959fc'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:48.679680 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-af2aa0df-1525-4c73-9ef6-75d7972f2758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51382e8aac0248898bb597ac228959fc'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:48.693252 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-af2aa0df-1525-4c73-9ef6-75d7972f2758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51382e8aac0248898bb597ac228959fc'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:48.699505 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1065/2121] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:48 2022] DELETE /identity/v3/users/51382e8aac0248898bb597ac228959fc => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:49.226702 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:49.268170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626419ce-ea6c-41d4-b99e-f38aa77a0724 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:49.270713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-626419ce-ea6c-41d4-b99e-f38aa77a0724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:49.295512 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626419ce-ea6c-41d4-b99e-f38aa77a0724 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:49.369465 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d8949-ee80-49cc-b305-b77845c3869f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:49.370501 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d8949-ee80-49cc-b305-b77845c3869f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:49.370890 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d8949-ee80-49cc-b305-b77845c3869f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:49.371270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d8949-ee80-49cc-b305-b77845c3869f admin admin] PATH_INFO: `/v3/projects/bea46f24d13a4c399dfa74ec8a301c3d` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:49.372603 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d8949-ee80-49cc-b305-b77845c3869f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bea46f24d13a4c399dfa74ec8a301c3d)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:49.374704 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d8949-ee80-49cc-b305-b77845c3869f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:49.544190 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f84d8949-ee80-49cc-b305-b77845c3869f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bea46f24d13a4c399dfa74ec8a301c3d', 'request_id': 'req-f84d8949-ee80-49cc-b305-b77845c3869f'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:49.552403 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f84d8949-ee80-49cc-b305-b77845c3869f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bea46f24d13a4c399dfa74ec8a301c3d', 'request_id': 'req-f84d8949-ee80-49cc-b305-b77845c3869f'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:49.567619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f84d8949-ee80-49cc-b305-b77845c3869f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bea46f24d13a4c399dfa74ec8a301c3d', 'request_id': 'req-f84d8949-ee80-49cc-b305-b77845c3869f'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:49.718191 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f84d8949-ee80-49cc-b305-b77845c3869f admin admin] The token cache is being invalidate because project bea46f24d13a4c399dfa74ec8a301c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:49.718649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f84d8949-ee80-49cc-b305-b77845c3869f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:49.719382 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f84d8949-ee80-49cc-b305-b77845c3869f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:49.722039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1057/2122] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:49 2022] DELETE /identity/v3/projects/bea46f24d13a4c399dfa74ec8a301c3d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:49.725908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2aa0df-1525-4c73-9ef6-75d7972f2758 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:49.727542 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-af2aa0df-1525-4c73-9ef6-75d7972f2758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:49.742422 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2aa0df-1525-4c73-9ef6-75d7972f2758 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:49.810447 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d82078-1b7a-4f40-89fb-14ef441c003e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:49.811332 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d82078-1b7a-4f40-89fb-14ef441c003e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:49.811619 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d82078-1b7a-4f40-89fb-14ef441c003e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:49.811900 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d82078-1b7a-4f40-89fb-14ef441c003e admin admin] PATH_INFO: `/v3/users/89414129f3eb496fbd929d870558960a` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:49.813943 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d82078-1b7a-4f40-89fb-14ef441c003e admin admin] RBAC: Authorizing `identity:delete_user(user_id=89414129f3eb496fbd929d870558960a)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:49.815960 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d82078-1b7a-4f40-89fb-14ef441c003e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:49.917214 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d8949-ee80-49cc-b305-b77845c3869f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:49.919019 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f84d8949-ee80-49cc-b305-b77845c3869f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:49.940103 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d8949-ee80-49cc-b305-b77845c3869f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:49.945122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a1af3-2eff-4814-8635-18a74adfa626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:49.946165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a1af3-2eff-4814-8635-18a74adfa626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:49.946452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a1af3-2eff-4814-8635-18a74adfa626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:49.946739 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a1af3-2eff-4814-8635-18a74adfa626 admin admin] PATH_INFO: `/v3/users/d6df4c3768134ebeb90d5566624a7cdd` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:49.947954 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a1af3-2eff-4814-8635-18a74adfa626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6df4c3768134ebeb90d5566624a7cdd)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:49.950247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52a1af3-2eff-4814-8635-18a74adfa626 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:50.062953 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a8d82078-1b7a-4f40-89fb-14ef441c003e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89414129f3eb496fbd929d870558960a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:50.140589 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a8d82078-1b7a-4f40-89fb-14ef441c003e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89414129f3eb496fbd929d870558960a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:50.148438 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a8d82078-1b7a-4f40-89fb-14ef441c003e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89414129f3eb496fbd929d870558960a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:50.149160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a8d82078-1b7a-4f40-89fb-14ef441c003e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89414129f3eb496fbd929d870558960a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:50.161388 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a8d82078-1b7a-4f40-89fb-14ef441c003e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89414129f3eb496fbd929d870558960a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:50.168078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1066/2123] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:49 2022] DELETE /identity/v3/users/89414129f3eb496fbd929d870558960a => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:50.353572 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e52a1af3-2eff-4814-8635-18a74adfa626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6df4c3768134ebeb90d5566624a7cdd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:50.426495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:50.503360 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e52a1af3-2eff-4814-8635-18a74adfa626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6df4c3768134ebeb90d5566624a7cdd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:50.508980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e52a1af3-2eff-4814-8635-18a74adfa626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6df4c3768134ebeb90d5566624a7cdd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:50.509949 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e52a1af3-2eff-4814-8635-18a74adfa626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6df4c3768134ebeb90d5566624a7cdd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:50.513483 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10639d86-5fcd-4e95-ad1c-a3ef63819347 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:50.513985 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10639d86-5fcd-4e95-ad1c-a3ef63819347 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:50.514453 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10639d86-5fcd-4e95-ad1c-a3ef63819347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:50.524623 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e52a1af3-2eff-4814-8635-18a74adfa626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6df4c3768134ebeb90d5566624a7cdd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:50.534108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1058/2124] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:52:49 2022] DELETE /identity/v3/users/d6df4c3768134ebeb90d5566624a7cdd => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:52:50.535528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-10639d86-5fcd-4e95-ad1c-a3ef63819347 None None] MFA Rules not processed for user `6809c29bee4041c393e6773643c63c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:50.536804 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-10639d86-5fcd-4e95-ad1c-a3ef63819347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:50.606581 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1067/2125] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:51.016980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a1af3-2eff-4814-8635-18a74adfa626 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:51.016980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e52a1af3-2eff-4814-8635-18a74adfa626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:51.020130 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10639d86-5fcd-4e95-ad1c-a3ef63819347 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:51.021829 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-10639d86-5fcd-4e95-ad1c-a3ef63819347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:51.163491 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10639d86-5fcd-4e95-ad1c-a3ef63819347 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:51.170076 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958da427-417c-4d31-8269-af27c5b69ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:51.172296 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958da427-417c-4d31-8269-af27c5b69ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:51.172998 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958da427-417c-4d31-8269-af27c5b69ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:51.173528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958da427-417c-4d31-8269-af27c5b69ca6 admin admin] PATH_INFO: `/v3/projects/b5d7c6ee418c41cb833e47c51ea4158b` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:51.174309 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a1af3-2eff-4814-8635-18a74adfa626 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:51.176235 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958da427-417c-4d31-8269-af27c5b69ca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d7c6ee418c41cb833e47c51ea4158b)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:51.178431 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958da427-417c-4d31-8269-af27c5b69ca6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:51.180678 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7f03d1-ccee-4cbf-896e-c19d935c4155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:51.182317 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f03d1-ccee-4cbf-896e-c19d935c4155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:51.184834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f03d1-ccee-4cbf-896e-c19d935c4155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:51.184834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7f03d1-ccee-4cbf-896e-c19d935c4155 admin admin] PATH_INFO: `/v3/projects/bcb8eb857ec848e1a6c895d56282017a` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:51.186164 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f03d1-ccee-4cbf-896e-c19d935c4155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb8eb857ec848e1a6c895d56282017a)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:51.190001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7f03d1-ccee-4cbf-896e-c19d935c4155 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:51.320187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-958da427-417c-4d31-8269-af27c5b69ca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d7c6ee418c41cb833e47c51ea4158b', 'request_id': 'req-958da427-417c-4d31-8269-af27c5b69ca6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:51.326501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-958da427-417c-4d31-8269-af27c5b69ca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d7c6ee418c41cb833e47c51ea4158b', 'request_id': 'req-958da427-417c-4d31-8269-af27c5b69ca6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:51.332247 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-958da427-417c-4d31-8269-af27c5b69ca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d7c6ee418c41cb833e47c51ea4158b', 'request_id': 'req-958da427-417c-4d31-8269-af27c5b69ca6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:51.358456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1f7f03d1-ccee-4cbf-896e-c19d935c4155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb8eb857ec848e1a6c895d56282017a', 'request_id': 'req-1f7f03d1-ccee-4cbf-896e-c19d935c4155'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:51.364999 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1f7f03d1-ccee-4cbf-896e-c19d935c4155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb8eb857ec848e1a6c895d56282017a', 'request_id': 'req-1f7f03d1-ccee-4cbf-896e-c19d935c4155'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:51.371562 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1f7f03d1-ccee-4cbf-896e-c19d935c4155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb8eb857ec848e1a6c895d56282017a', 'request_id': 'req-1f7f03d1-ccee-4cbf-896e-c19d935c4155'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:51.436128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-958da427-417c-4d31-8269-af27c5b69ca6 admin admin] The token cache is being invalidate because project b5d7c6ee418c41cb833e47c51ea4158b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:51.436657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-958da427-417c-4d31-8269-af27c5b69ca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:51.437522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-958da427-417c-4d31-8269-af27c5b69ca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:51.439952 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1068/2126] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:51 2022] DELETE /identity/v3/projects/b5d7c6ee418c41cb833e47c51ea4158b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:51.445648 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85e1ac-a197-4452-9ea8-21b167ca8a89 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:51.446252 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85e1ac-a197-4452-9ea8-21b167ca8a89 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:51.446788 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85e1ac-a197-4452-9ea8-21b167ca8a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:51.489725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0c85e1ac-a197-4452-9ea8-21b167ca8a89 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:51.493904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0c85e1ac-a197-4452-9ea8-21b167ca8a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:51.561420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1069/2127] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:51.578644 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb836ef5-ca1c-40fe-a5a0-d8796d5a3def None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:51.579034 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb836ef5-ca1c-40fe-a5a0-d8796d5a3def None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:51.579437 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb836ef5-ca1c-40fe-a5a0-d8796d5a3def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:51.580722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1f7f03d1-ccee-4cbf-896e-c19d935c4155 admin admin] The token cache is being invalidate because project bcb8eb857ec848e1a6c895d56282017a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:52:51.580953 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1f7f03d1-ccee-4cbf-896e-c19d935c4155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:51.581856 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1f7f03d1-ccee-4cbf-896e-c19d935c4155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:52:51.583658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1059/2128] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:52:51 2022] DELETE /identity/v3/projects/bcb8eb857ec848e1a6c895d56282017a => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:51.589972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e54bc7-219c-4f31-9acf-14ae6d43f16c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:51.590389 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e54bc7-219c-4f31-9acf-14ae6d43f16c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:51.590802 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e54bc7-219c-4f31-9acf-14ae6d43f16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:51.601936 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-cb836ef5-ca1c-40fe-a5a0-d8796d5a3def None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:51.603477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-cb836ef5-ca1c-40fe-a5a0-d8796d5a3def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:51.613369 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1070/2129] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:51.623253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb836ef5-ca1c-40fe-a5a0-d8796d5a3def None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:51.624026 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-98e54bc7-219c-4f31-9acf-14ae6d43f16c None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:51.625545 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-98e54bc7-219c-4f31-9acf-14ae6d43f16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:51.634332 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb836ef5-ca1c-40fe-a5a0-d8796d5a3def None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:51.636754 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1060/2130] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:51.641418 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149639c-0235-4337-b269-bc432c139975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:51.642381 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149639c-0235-4337-b269-bc432c139975 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:51.642681 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149639c-0235-4337-b269-bc432c139975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:51.642952 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149639c-0235-4337-b269-bc432c139975 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:51.643858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149639c-0235-4337-b269-bc432c139975 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:52:51.644026 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149639c-0235-4337-b269-bc432c139975 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:51.644305 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6e3f4-ecce-4dce-ba3a-d6ea2d18ed96 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:51.644664 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6e3f4-ecce-4dce-ba3a-d6ea2d18ed96 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:51.645033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a6e3f4-ecce-4dce-ba3a-d6ea2d18ed96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:51.645694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149639c-0235-4337-b269-bc432c139975 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:51.665047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1071/2131] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:52:51.666863 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149639c-0235-4337-b269-bc432c139975 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:51.670277 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-f1a6e3f4-ecce-4dce-ba3a-d6ea2d18ed96 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:51.672321 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f1a6e3f4-ecce-4dce-ba3a-d6ea2d18ed96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:51.677731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149639c-0235-4337-b269-bc432c139975 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:51.681702 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1061/2132] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:51.685503 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6e3f4-ecce-4dce-ba3a-d6ea2d18ed96 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:51.685850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab0336-4c1d-46bb-808f-4bc3bd1a9f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:51.686524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab0336-4c1d-46bb-808f-4bc3bd1a9f5f admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:51.686813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab0336-4c1d-46bb-808f-4bc3bd1a9f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:51.687222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab0336-4c1d-46bb-808f-4bc3bd1a9f5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:51.687928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab0336-4c1d-46bb-808f-4bc3bd1a9f5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:51.689891 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab0336-4c1d-46bb-808f-4bc3bd1a9f5f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:51.695701 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a6e3f4-ecce-4dce-ba3a-d6ea2d18ed96 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:51.705274 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b4da5-f70c-40d5-b30d-a3cb6c721195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:51.709864 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b4da5-f70c-40d5-b30d-a3cb6c721195 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:51.709864 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b4da5-f70c-40d5-b30d-a3cb6c721195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:51.709864 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b4da5-f70c-40d5-b30d-a3cb6c721195 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:51.709864 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b4da5-f70c-40d5-b30d-a3cb6c721195 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:52:51.709864 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b4da5-f70c-40d5-b30d-a3cb6c721195 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:51.709864 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b4da5-f70c-40d5-b30d-a3cb6c721195 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:51.725040 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1062/2133] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:52:51.727057 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b4da5-f70c-40d5-b30d-a3cb6c721195 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:51.737871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b4da5-f70c-40d5-b30d-a3cb6c721195 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:51.745824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03111da6-197d-49bc-b629-b9247bb1d78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:51.746872 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03111da6-197d-49bc-b629-b9247bb1d78d admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:51.747867 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03111da6-197d-49bc-b629-b9247bb1d78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:51.748458 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03111da6-197d-49bc-b629-b9247bb1d78d admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:51.749276 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03111da6-197d-49bc-b629-b9247bb1d78d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:51.751718 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03111da6-197d-49bc-b629-b9247bb1d78d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:51.786373 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:51.913363 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1072/2134] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:51 2022] POST /identity/v3/projects => generated 375 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:51.915350 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1063/2135] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:52:51 2022] POST /identity/v3/projects => generated 391 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:52:51.916282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab0336-4c1d-46bb-808f-4bc3bd1a9f5f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:51.916429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03111da6-197d-49bc-b629-b9247bb1d78d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:51.993668 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab0336-4c1d-46bb-808f-4bc3bd1a9f5f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:51.995669 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03111da6-197d-49bc-b629-b9247bb1d78d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:51.998845 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1e4cb-37bf-408a-ab09-489d3c03e01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:52.000058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1e4cb-37bf-408a-ab09-489d3c03e01c admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:52.000892 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1e4cb-37bf-408a-ab09-489d3c03e01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:52.001214 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1e4cb-37bf-408a-ab09-489d3c03e01c admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:52.001502 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51f22c-57be-4e21-8a30-ecfe3f6db254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:52.001933 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1e4cb-37bf-408a-ab09-489d3c03e01c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:52.002370 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51f22c-57be-4e21-8a30-ecfe3f6db254 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:52.002668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51f22c-57be-4e21-8a30-ecfe3f6db254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:52.002949 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f51f22c-57be-4e21-8a30-ecfe3f6db254 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:52.003654 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51f22c-57be-4e21-8a30-ecfe3f6db254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:52.004019 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c1e4cb-37bf-408a-ab09-489d3c03e01c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:52.005943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f51f22c-57be-4e21-8a30-ecfe3f6db254 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:52.104562 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1073/2136] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:51 2022] POST /identity/v3/users => generated 296 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:52.108355 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1e4cb-37bf-408a-ab09-489d3c03e01c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:52.122069 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c1e4cb-37bf-408a-ab09-489d3c03e01c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:52.128471 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f68f2-5c55-4e6e-82f8-ba274e1a2e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:52.129280 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f68f2-5c55-4e6e-82f8-ba274e1a2e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:52.129570 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f68f2-5c55-4e6e-82f8-ba274e1a2e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:52.129989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8f68f2-5c55-4e6e-82f8-ba274e1a2e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:52.130610 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f68f2-5c55-4e6e-82f8-ba274e1a2e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:52.132433 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8f68f2-5c55-4e6e-82f8-ba274e1a2e96 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:52.139541 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1064/2137] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:52:51 2022] POST /identity/v3/users => generated 288 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:52:52.146050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1074/2138] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:52.150324 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51f22c-57be-4e21-8a30-ecfe3f6db254 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:52.153218 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f68f2-5c55-4e6e-82f8-ba274e1a2e96 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:52.163657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8f68f2-5c55-4e6e-82f8-ba274e1a2e96 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:52.168080 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f51f22c-57be-4e21-8a30-ecfe3f6db254 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:52.181859 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce94d8-8cc9-4174-83e4-60517b11ade2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:52.181859 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce94d8-8cc9-4174-83e4-60517b11ade2 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:52.181859 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce94d8-8cc9-4174-83e4-60517b11ade2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:52.181859 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce94d8-8cc9-4174-83e4-60517b11ade2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:52.182313 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf54c8-066e-4599-9380-d7aa80419ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:52.182313 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf54c8-066e-4599-9380-d7aa80419ebb admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:52.182508 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce94d8-8cc9-4174-83e4-60517b11ade2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:52.182585 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf54c8-066e-4599-9380-d7aa80419ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:52.182585 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf54c8-066e-4599-9380-d7aa80419ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:52.182585 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf54c8-066e-4599-9380-d7aa80419ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:52.182915 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce94d8-8cc9-4174-83e4-60517b11ade2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:52.183063 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabf54c8-066e-4599-9380-d7aa80419ebb admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:52.197065 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1065/2139] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:52:52.197287 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1075/2140] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:52:52.199995 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf54c8-066e-4599-9380-d7aa80419ebb admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:52.200207 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce94d8-8cc9-4174-83e4-60517b11ade2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:52.210877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabf54c8-066e-4599-9380-d7aa80419ebb admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:52.211701 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce94d8-8cc9-4174-83e4-60517b11ade2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:52.215614 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc346434-dca7-4195-9e1a-2ba2867e9d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:52.216519 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc346434-dca7-4195-9e1a-2ba2867e9d80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:52.216710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bfb4e-c5db-413c-9188-ecd1ac8f8ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:52.216836 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc346434-dca7-4195-9e1a-2ba2867e9d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:52.217083 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc346434-dca7-4195-9e1a-2ba2867e9d80 admin admin] PATH_INFO: `/v3/projects/c74fdc78fd4b4f51a56bb012bd3a20e8/users/6e8df8003c634508b17a9ea686a17d8c/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:52.217408 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bfb4e-c5db-413c-9188-ecd1ac8f8ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:52.217702 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bfb4e-c5db-413c-9188-ecd1ac8f8ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:52.217983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bfb4e-c5db-413c-9188-ecd1ac8f8ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:52.218852 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bfb4e-c5db-413c-9188-ecd1ac8f8ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:52.220482 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760bfb4e-c5db-413c-9188-ecd1ac8f8ec1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:52.231349 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1076/2141] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:52:52.234670 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc346434-dca7-4195-9e1a-2ba2867e9d80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c74fdc78fd4b4f51a56bb012bd3a20e8, user_id=6e8df8003c634508b17a9ea686a17d8c, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:52.237352 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc346434-dca7-4195-9e1a-2ba2867e9d80 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:52.241948 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bfb4e-c5db-413c-9188-ecd1ac8f8ec1 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:52.252773 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bfb4e-c5db-413c-9188-ecd1ac8f8ec1 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:52.257577 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b731d57-bf00-4c5a-b33e-31e4277640fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:52.258494 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b731d57-bf00-4c5a-b33e-31e4277640fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:52.258788 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b731d57-bf00-4c5a-b33e-31e4277640fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:52.259067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b731d57-bf00-4c5a-b33e-31e4277640fe admin admin] PATH_INFO: `/v3/projects/d713a57b50cf4fe3b0fc1bd63cb761fd/users/7b98162f0ce8462fa1a20871ab1a6560/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:52.280677 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b731d57-bf00-4c5a-b33e-31e4277640fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d713a57b50cf4fe3b0fc1bd63cb761fd, user_id=7b98162f0ce8462fa1a20871ab1a6560, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:52.283555 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b731d57-bf00-4c5a-b33e-31e4277640fe admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:52.361455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1077/2143] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:52 2022] PUT /identity/v3/projects/d713a57b50cf4fe3b0fc1bd63cb761fd/users/7b98162f0ce8462fa1a20871ab1a6560/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:52.365752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1066/2143] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:52:52 2022] PUT /identity/v3/projects/c74fdc78fd4b4f51a56bb012bd3a20e8/users/6e8df8003c634508b17a9ea686a17d8c/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:52:52.367456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8556c-296c-4111-8d7f-da144d046e1c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:52.367745 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8556c-296c-4111-8d7f-da144d046e1c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:52.368025 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8556c-296c-4111-8d7f-da144d046e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:52.370170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861e708-110e-4a70-9d66-c509f715af79 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:52.370657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861e708-110e-4a70-9d66-c509f715af79 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:52.371098 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1861e708-110e-4a70-9d66-c509f715af79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:52.389278 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-52e8556c-296c-4111-8d7f-da144d046e1c None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:52.391847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-52e8556c-296c-4111-8d7f-da144d046e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:52.407604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-1861e708-110e-4a70-9d66-c509f715af79 None None] MFA Rules not processed for user `6e8df8003c634508b17a9ea686a17d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:52.408865 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1861e708-110e-4a70-9d66-c509f715af79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:52.476451 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1078/2144] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:52.491023 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8556c-296c-4111-8d7f-da144d046e1c None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:52.492917 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-52e8556c-296c-4111-8d7f-da144d046e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:52.493331 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1067/2145] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:52:52.510432 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861e708-110e-4a70-9d66-c509f715af79 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:52.512153 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1861e708-110e-4a70-9d66-c509f715af79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:52.560238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8556c-296c-4111-8d7f-da144d046e1c None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:52.565185 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092f48d-7ff3-4d82-9b8f-b755ef9a2d77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:52.565907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092f48d-7ff3-4d82-9b8f-b755ef9a2d77 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:52.566197 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092f48d-7ff3-4d82-9b8f-b755ef9a2d77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:52.566675 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092f48d-7ff3-4d82-9b8f-b755ef9a2d77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:52.576102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1861e708-110e-4a70-9d66-c509f715af79 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:52.585705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092f48d-7ff3-4d82-9b8f-b755ef9a2d77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:52.585705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092f48d-7ff3-4d82-9b8f-b755ef9a2d77 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:52.585952 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded4499-2229-4e95-aabd-e1448627283e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:52.585952 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded4499-2229-4e95-aabd-e1448627283e service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:52.585952 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded4499-2229-4e95-aabd-e1448627283e service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:52.585952 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded4499-2229-4e95-aabd-e1448627283e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:52.592027 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1079/2146] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:52:52.592478 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded4499-2229-4e95-aabd-e1448627283e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:52.594116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ded4499-2229-4e95-aabd-e1448627283e service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:52.611086 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1068/2147] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:52:53.312895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:53.646493 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:57.149262 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:57.418612 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:58.331925 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:59.315042 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:52:59.629616 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18770ab7-a0e9-43f6-98a0-60ad9b69e98b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:59.629910 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18770ab7-a0e9-43f6-98a0-60ad9b69e98b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:59.630392 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18770ab7-a0e9-43f6-98a0-60ad9b69e98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:59.662170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-18770ab7-a0e9-43f6-98a0-60ad9b69e98b None None] MFA Rules not processed for user `7b98162f0ce8462fa1a20871ab1a6560`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:52:59.663349 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-18770ab7-a0e9-43f6-98a0-60ad9b69e98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:59.731738 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1080/2148] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:52:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:52:59.747052 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded4499-2229-4e95-aabd-e1448627283e service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:52:59.750857 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2ded4499-2229-4e95-aabd-e1448627283e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:52:59.835631 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded4499-2229-4e95-aabd-e1448627283e service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:52:59.841582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38938cf2-9baa-4bab-a472-1111c82b1cd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:52:59.842247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38938cf2-9baa-4bab-a472-1111c82b1cd8 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:52:59.842534 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38938cf2-9baa-4bab-a472-1111c82b1cd8 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:52:59.842814 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38938cf2-9baa-4bab-a472-1111c82b1cd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:52:59.851179 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38938cf2-9baa-4bab-a472-1111c82b1cd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:52:59.852785 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38938cf2-9baa-4bab-a472-1111c82b1cd8 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:52:59.862561 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1069/2149] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:52:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:53:00.628788 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:00.908711 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:02.609890 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:03.258571 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f06b5-36bb-4c33-8b7a-4411f02b7c13 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:03.259135 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f06b5-36bb-4c33-8b7a-4411f02b7c13 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:03.259135 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f06b5-36bb-4c33-8b7a-4411f02b7c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:03.279160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3e7f06b5-36bb-4c33-8b7a-4411f02b7c13 None None] MFA Rules not processed for user `7b98162f0ce8462fa1a20871ab1a6560`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:03.280404 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3e7f06b5-36bb-4c33-8b7a-4411f02b7c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:03.288214 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1081/2150] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:53:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:03.407055 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:06.312175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:06.717976 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:07.388837 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:07.646228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:08.160388 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:08.358174 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:09.280612 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:09.386402 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:10.023370 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:10.061166 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:10.375207 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:10.506462 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:10.583151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:11.097697 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:11.183083 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:11.543289 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:11.652672 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:11.906709 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:11.983528 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:12.028937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:12.301031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:12.346802 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:12.525941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:12.564459 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:12.714633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:12.753066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:12.943025 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:12.974978 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:13.170062 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:13.210110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:13.366507 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:13.463141 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:13.497843 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:13.748667 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:13.952309 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:14.060708 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:14.148937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:14.243858 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:14.541584 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:14.786731 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:23.609786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:24.925752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=25 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:27.378794 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38938cf2-9baa-4bab-a472-1111c82b1cd8 service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:27.380809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-38938cf2-9baa-4bab-a472-1111c82b1cd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:27.395256 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38938cf2-9baa-4bab-a472-1111c82b1cd8 service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:27.400999 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6054187-ffb2-4760-ba34-40b78ac67449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:27.401687 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6054187-ffb2-4760-ba34-40b78ac67449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:27.401971 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6054187-ffb2-4760-ba34-40b78ac67449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:27.402248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6054187-ffb2-4760-ba34-40b78ac67449 admin admin] PATH_INFO: `/v3/users/4541981b72094f2c94a501aacfe0f6cd` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:27.403463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6054187-ffb2-4760-ba34-40b78ac67449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4541981b72094f2c94a501aacfe0f6cd)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:27.405470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6054187-ffb2-4760-ba34-40b78ac67449 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:27.768411 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b6054187-ffb2-4760-ba34-40b78ac67449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4541981b72094f2c94a501aacfe0f6cd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:27.886157 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b6054187-ffb2-4760-ba34-40b78ac67449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4541981b72094f2c94a501aacfe0f6cd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:27.894857 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b6054187-ffb2-4760-ba34-40b78ac67449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4541981b72094f2c94a501aacfe0f6cd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:27.895623 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b6054187-ffb2-4760-ba34-40b78ac67449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4541981b72094f2c94a501aacfe0f6cd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:27.908741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b6054187-ffb2-4760-ba34-40b78ac67449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4541981b72094f2c94a501aacfe0f6cd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:27.915716 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1070/2151] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:53:27 2022] DELETE /identity/v3/users/4541981b72094f2c94a501aacfe0f6cd => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:53:27.920209 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d93e09-c146-4d8c-9ecd-a0f5588d0d8e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:27.920671 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d93e09-c146-4d8c-9ecd-a0f5588d0d8e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:27.920790 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d93e09-c146-4d8c-9ecd-a0f5588d0d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:27.942158 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e3d93e09-c146-4d8c-9ecd-a0f5588d0d8e None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:27.943224 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e3d93e09-c146-4d8c-9ecd-a0f5588d0d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:28.022263 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1082/2152] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:53:28.033590 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6054187-ffb2-4760-ba34-40b78ac67449 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:28.035430 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b6054187-ffb2-4760-ba34-40b78ac67449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:28.099666 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6054187-ffb2-4760-ba34-40b78ac67449 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:28.103826 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6f1ad6-ac70-4fbb-a9e8-dc3d6fe8dd88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:28.108828 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f1ad6-ac70-4fbb-a9e8-dc3d6fe8dd88 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:28.108828 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f1ad6-ac70-4fbb-a9e8-dc3d6fe8dd88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:28.108828 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f1ad6-ac70-4fbb-a9e8-dc3d6fe8dd88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:28.119167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f1ad6-ac70-4fbb-a9e8-dc3d6fe8dd88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:28.120753 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6f1ad6-ac70-4fbb-a9e8-dc3d6fe8dd88 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:28.132031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1071/2153] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:53:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:53:28.790400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d93e09-c146-4d8c-9ecd-a0f5588d0d8e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:28.791952 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e3d93e09-c146-4d8c-9ecd-a0f5588d0d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:28.806873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d93e09-c146-4d8c-9ecd-a0f5588d0d8e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:28.812461 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07276e18-6e52-4a51-b759-140f3f2ee1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:28.813495 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07276e18-6e52-4a51-b759-140f3f2ee1f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:28.814011 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07276e18-6e52-4a51-b759-140f3f2ee1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:28.814586 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07276e18-6e52-4a51-b759-140f3f2ee1f3 admin admin] PATH_INFO: `/v3/projects/8ece88657fac40ca868fb895890aa06a` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:28.816330 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07276e18-6e52-4a51-b759-140f3f2ee1f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ece88657fac40ca868fb895890aa06a)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:28.818576 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07276e18-6e52-4a51-b759-140f3f2ee1f3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:28.969993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-07276e18-6e52-4a51-b759-140f3f2ee1f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ece88657fac40ca868fb895890aa06a', 'request_id': 'req-07276e18-6e52-4a51-b759-140f3f2ee1f3'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:28.977618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-07276e18-6e52-4a51-b759-140f3f2ee1f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ece88657fac40ca868fb895890aa06a', 'request_id': 'req-07276e18-6e52-4a51-b759-140f3f2ee1f3'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:28.984496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-07276e18-6e52-4a51-b759-140f3f2ee1f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ece88657fac40ca868fb895890aa06a', 'request_id': 'req-07276e18-6e52-4a51-b759-140f3f2ee1f3'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:29.081707 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-07276e18-6e52-4a51-b759-140f3f2ee1f3 admin admin] The token cache is being invalidate because project 8ece88657fac40ca868fb895890aa06a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:53:29.082108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-07276e18-6e52-4a51-b759-140f3f2ee1f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:29.082811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-07276e18-6e52-4a51-b759-140f3f2ee1f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:29.084529 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1083/2154] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:53:28 2022] DELETE /identity/v3/projects/8ece88657fac40ca868fb895890aa06a => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:53:29.089714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977960ca-598a-44c0-a10e-4e10795476c5 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:29.090211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977960ca-598a-44c0-a10e-4e10795476c5 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:29.090306 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977960ca-598a-44c0-a10e-4e10795476c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:29.108731 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-977960ca-598a-44c0-a10e-4e10795476c5 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:29.110072 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-977960ca-598a-44c0-a10e-4e10795476c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:29.171224 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1072/2155] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:29.180228 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac7965-37c6-4b3f-8617-2b038ffeae2f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:29.180583 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac7965-37c6-4b3f-8617-2b038ffeae2f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:29.180896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac7965-37c6-4b3f-8617-2b038ffeae2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:29.200124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-24ac7965-37c6-4b3f-8617-2b038ffeae2f None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:29.202200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-24ac7965-37c6-4b3f-8617-2b038ffeae2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:29.211362 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1084/2156] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:53:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:29.215927 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977960ca-598a-44c0-a10e-4e10795476c5 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:29.226920 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977960ca-598a-44c0-a10e-4e10795476c5 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:29.232339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11a783-bc1e-4d5a-ba63-cd068e4b4689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:29.233034 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11a783-bc1e-4d5a-ba63-cd068e4b4689 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:29.233367 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11a783-bc1e-4d5a-ba63-cd068e4b4689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:29.233649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11a783-bc1e-4d5a-ba63-cd068e4b4689 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:29.234413 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11a783-bc1e-4d5a-ba63-cd068e4b4689 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:53:29.234750 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11a783-bc1e-4d5a-ba63-cd068e4b4689 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:29.236648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d11a783-bc1e-4d5a-ba63-cd068e4b4689 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:29.250013 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1073/2157] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:53:29.254739 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac7965-37c6-4b3f-8617-2b038ffeae2f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:29.268343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac7965-37c6-4b3f-8617-2b038ffeae2f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:29.273918 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2f6eb-69c5-44be-a67b-1c7760b10b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:29.274600 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2f6eb-69c5-44be-a67b-1c7760b10b6f admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:29.302801 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2f6eb-69c5-44be-a67b-1c7760b10b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:29.302801 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2f6eb-69c5-44be-a67b-1c7760b10b6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:29.302801 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2f6eb-69c5-44be-a67b-1c7760b10b6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:29.302801 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2f6eb-69c5-44be-a67b-1c7760b10b6f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:29.380501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1085/2158] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:53:29 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:53:29.384832 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11a783-bc1e-4d5a-ba63-cd068e4b4689 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:29.390755 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:29.399346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d11a783-bc1e-4d5a-ba63-cd068e4b4689 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:29.478089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee8760-6c2d-4165-8c74-31a2d354bcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:29.478935 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee8760-6c2d-4165-8c74-31a2d354bcef admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:29.479282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee8760-6c2d-4165-8c74-31a2d354bcef admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:29.479684 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee8760-6c2d-4165-8c74-31a2d354bcef admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:29.480667 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee8760-6c2d-4165-8c74-31a2d354bcef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:29.483109 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee8760-6c2d-4165-8c74-31a2d354bcef admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:29.572441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1074/2159] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:53:29 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:53:29.579151 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2f6eb-69c5-44be-a67b-1c7760b10b6f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:29.589904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2f6eb-69c5-44be-a67b-1c7760b10b6f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:29.594654 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42518525-0644-4775-b3ea-2d2c5208db6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:29.595335 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42518525-0644-4775-b3ea-2d2c5208db6d admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:29.595605 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42518525-0644-4775-b3ea-2d2c5208db6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:29.595883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42518525-0644-4775-b3ea-2d2c5208db6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:29.596645 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42518525-0644-4775-b3ea-2d2c5208db6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:29.598308 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42518525-0644-4775-b3ea-2d2c5208db6d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:29.609473 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1086/2160] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:53:29.613359 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee8760-6c2d-4165-8c74-31a2d354bcef admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:29.623342 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee8760-6c2d-4165-8c74-31a2d354bcef admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:29.628993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6677a6-ba62-463b-86c0-7c20d8a76502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:29.629709 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6677a6-ba62-463b-86c0-7c20d8a76502 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:29.629993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6677a6-ba62-463b-86c0-7c20d8a76502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:29.636299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6677a6-ba62-463b-86c0-7c20d8a76502 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:29.636299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6677a6-ba62-463b-86c0-7c20d8a76502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:29.636299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6677a6-ba62-463b-86c0-7c20d8a76502 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:29.643767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1075/2161] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:53:29.647897 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42518525-0644-4775-b3ea-2d2c5208db6d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:29.657914 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42518525-0644-4775-b3ea-2d2c5208db6d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:29.662530 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cf259-413d-4e05-8abd-499ca13a28d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:29.663404 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cf259-413d-4e05-8abd-499ca13a28d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:29.663689 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cf259-413d-4e05-8abd-499ca13a28d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:29.663969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8cf259-413d-4e05-8abd-499ca13a28d8 admin admin] PATH_INFO: `/v3/projects/432c45c384d94d5abac960559be97c58/users/eae65f54557d4ff19e627ef093d4ac3a/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:29.681312 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cf259-413d-4e05-8abd-499ca13a28d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=432c45c384d94d5abac960559be97c58, user_id=eae65f54557d4ff19e627ef093d4ac3a, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:29.684051 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8cf259-413d-4e05-8abd-499ca13a28d8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:29.808029 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1087/2162] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:53:29 2022] PUT /identity/v3/projects/432c45c384d94d5abac960559be97c58/users/eae65f54557d4ff19e627ef093d4ac3a/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:53:29.819018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e21b6-75c8-4200-a053-1fe2859ff0b8 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:29.819311 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e21b6-75c8-4200-a053-1fe2859ff0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:29.819597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e21b6-75c8-4200-a053-1fe2859ff0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:29.848726 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-471e21b6-75c8-4200-a053-1fe2859ff0b8 None None] MFA Rules not processed for user `eae65f54557d4ff19e627ef093d4ac3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:29.850002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-471e21b6-75c8-4200-a053-1fe2859ff0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:29.925866 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1076/2163] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:53:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:29.937353 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cf259-413d-4e05-8abd-499ca13a28d8 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:29.939832 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bf8cf259-413d-4e05-8abd-499ca13a28d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:29.963561 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:30.008375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8cf259-413d-4e05-8abd-499ca13a28d8 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:30.012643 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a90ac-ba21-47db-8add-8fb1d0e40227 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:30.013330 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a90ac-ba21-47db-8add-8fb1d0e40227 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:30.013617 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a90ac-ba21-47db-8add-8fb1d0e40227 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:30.013901 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a90ac-ba21-47db-8add-8fb1d0e40227 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:30.028885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a90ac-ba21-47db-8add-8fb1d0e40227 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:30.028885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a90ac-ba21-47db-8add-8fb1d0e40227 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:30.033266 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1088/2164] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:53:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:53:31.164464 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e21b6-75c8-4200-a053-1fe2859ff0b8 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:31.167310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-471e21b6-75c8-4200-a053-1fe2859ff0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:31.271784 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e21b6-75c8-4200-a053-1fe2859ff0b8 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:31.277812 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f23789-7991-4ed0-b6c3-8ae7d034b77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:31.291847 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f23789-7991-4ed0-b6c3-8ae7d034b77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:31.298879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f23789-7991-4ed0-b6c3-8ae7d034b77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:31.298879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f23789-7991-4ed0-b6c3-8ae7d034b77e admin admin] PATH_INFO: `/v3/users/6e8df8003c634508b17a9ea686a17d8c` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:31.298879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f23789-7991-4ed0-b6c3-8ae7d034b77e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e8df8003c634508b17a9ea686a17d8c)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:31.298879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f23789-7991-4ed0-b6c3-8ae7d034b77e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:31.320358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:31.535149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-53f23789-7991-4ed0-b6c3-8ae7d034b77e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e8df8003c634508b17a9ea686a17d8c'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:31.651960 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-53f23789-7991-4ed0-b6c3-8ae7d034b77e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e8df8003c634508b17a9ea686a17d8c'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:31.661129 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-53f23789-7991-4ed0-b6c3-8ae7d034b77e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e8df8003c634508b17a9ea686a17d8c'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:31.661833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-53f23789-7991-4ed0-b6c3-8ae7d034b77e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e8df8003c634508b17a9ea686a17d8c'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:31.674645 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-53f23789-7991-4ed0-b6c3-8ae7d034b77e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e8df8003c634508b17a9ea686a17d8c'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:31.680575 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1077/2165] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:53:31 2022] DELETE /identity/v3/users/6e8df8003c634508b17a9ea686a17d8c => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:53:31.685161 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834064c-5349-4464-8212-b71746e1c6f0 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:31.685688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834064c-5349-4464-8212-b71746e1c6f0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:31.685784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834064c-5349-4464-8212-b71746e1c6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:31.703092 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8834064c-5349-4464-8212-b71746e1c6f0 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:31.704530 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8834064c-5349-4464-8212-b71746e1c6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:31.768231 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1089/2166] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:53:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:31.778253 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f23789-7991-4ed0-b6c3-8ae7d034b77e admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:31.779775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-53f23789-7991-4ed0-b6c3-8ae7d034b77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:31.839771 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f23789-7991-4ed0-b6c3-8ae7d034b77e admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:31.843553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60cc9e0-1100-4cd7-89ac-5a7836d6169c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:31.844821 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cc9e0-1100-4cd7-89ac-5a7836d6169c service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:31.845148 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cc9e0-1100-4cd7-89ac-5a7836d6169c service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:31.845432 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60cc9e0-1100-4cd7-89ac-5a7836d6169c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:31.856548 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cc9e0-1100-4cd7-89ac-5a7836d6169c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:31.858476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60cc9e0-1100-4cd7-89ac-5a7836d6169c service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:31.872480 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1078/2167] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:53:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:53:32.320669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834064c-5349-4464-8212-b71746e1c6f0 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:32.322778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8834064c-5349-4464-8212-b71746e1c6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:32.348869 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8834064c-5349-4464-8212-b71746e1c6f0 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:32.360474 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b02b80-59c0-47e7-9061-333454f1db08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:32.361607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b02b80-59c0-47e7-9061-333454f1db08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:32.362005 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b02b80-59c0-47e7-9061-333454f1db08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:32.362713 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b02b80-59c0-47e7-9061-333454f1db08 admin admin] PATH_INFO: `/v3/projects/c74fdc78fd4b4f51a56bb012bd3a20e8` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:32.364384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b02b80-59c0-47e7-9061-333454f1db08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c74fdc78fd4b4f51a56bb012bd3a20e8)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:32.366774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b02b80-59c0-47e7-9061-333454f1db08 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:32.569820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-71b02b80-59c0-47e7-9061-333454f1db08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c74fdc78fd4b4f51a56bb012bd3a20e8', 'request_id': 'req-71b02b80-59c0-47e7-9061-333454f1db08'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:32.579713 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-71b02b80-59c0-47e7-9061-333454f1db08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c74fdc78fd4b4f51a56bb012bd3a20e8', 'request_id': 'req-71b02b80-59c0-47e7-9061-333454f1db08'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:32.587713 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-71b02b80-59c0-47e7-9061-333454f1db08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c74fdc78fd4b4f51a56bb012bd3a20e8', 'request_id': 'req-71b02b80-59c0-47e7-9061-333454f1db08'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:32.807915 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-71b02b80-59c0-47e7-9061-333454f1db08 admin admin] The token cache is being invalidate because project c74fdc78fd4b4f51a56bb012bd3a20e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:53:32.808530 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-71b02b80-59c0-47e7-9061-333454f1db08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:32.809177 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-71b02b80-59c0-47e7-9061-333454f1db08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:32.811154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1090/2168] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:53:32 2022] DELETE /identity/v3/projects/c74fdc78fd4b4f51a56bb012bd3a20e8 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:53:32.817272 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35510fab-486b-4d9e-95a2-540227574631 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:32.817728 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35510fab-486b-4d9e-95a2-540227574631 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:32.817842 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35510fab-486b-4d9e-95a2-540227574631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:32.839577 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-35510fab-486b-4d9e-95a2-540227574631 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:32.844660 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-35510fab-486b-4d9e-95a2-540227574631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:32.965345 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1079/2169] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:53:32.975136 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a357f-689e-4cc7-882b-c902082c0e6b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:32.976797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a357f-689e-4cc7-882b-c902082c0e6b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:32.978364 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549a357f-689e-4cc7-882b-c902082c0e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:33.007773 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-549a357f-689e-4cc7-882b-c902082c0e6b None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:33.009239 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-549a357f-689e-4cc7-882b-c902082c0e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:33.025356 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35510fab-486b-4d9e-95a2-540227574631 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:33.031537 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1091/2170] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:53:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:33.036643 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35510fab-486b-4d9e-95a2-540227574631 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:33.042068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f02ec-04db-4634-98d8-5836b8a37a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:33.043123 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f02ec-04db-4634-98d8-5836b8a37a33 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:33.043589 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f02ec-04db-4634-98d8-5836b8a37a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:33.044300 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f02ec-04db-4634-98d8-5836b8a37a33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:33.045785 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f02ec-04db-4634-98d8-5836b8a37a33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:53:33.046441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f02ec-04db-4634-98d8-5836b8a37a33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:33.049407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f02ec-04db-4634-98d8-5836b8a37a33 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:33.069836 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1080/2171] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:53:33.071248 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a357f-689e-4cc7-882b-c902082c0e6b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:33.085926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549a357f-689e-4cc7-882b-c902082c0e6b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:33.089520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb957ec-0805-47d2-8d68-24012e1bb5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:33.090292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb957ec-0805-47d2-8d68-24012e1bb5d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:33.090586 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb957ec-0805-47d2-8d68-24012e1bb5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:33.090866 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb957ec-0805-47d2-8d68-24012e1bb5d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:33.091586 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb957ec-0805-47d2-8d68-24012e1bb5d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:33.093542 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb957ec-0805-47d2-8d68-24012e1bb5d8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:33.275726 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1092/2172] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:53:33 2022] POST /identity/v3/projects => generated 377 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:53:33.277340 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f02ec-04db-4634-98d8-5836b8a37a33 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:33.288643 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f02ec-04db-4634-98d8-5836b8a37a33 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:33.311932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:33.352665 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae13149-4724-49cd-961f-ede3e12b4eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:33.353361 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae13149-4724-49cd-961f-ede3e12b4eb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:33.353647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae13149-4724-49cd-961f-ede3e12b4eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:33.353918 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae13149-4724-49cd-961f-ede3e12b4eb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:33.354610 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae13149-4724-49cd-961f-ede3e12b4eb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:33.357775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae13149-4724-49cd-961f-ede3e12b4eb4 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:33.492903 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb957ec-0805-47d2-8d68-24012e1bb5d8 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:33.494643 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bdb957ec-0805-47d2-8d68-24012e1bb5d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:33.508992 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb957ec-0805-47d2-8d68-24012e1bb5d8 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:33.512112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1081/2173] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:53:33 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:53:33.515378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165affbf-bc31-4ece-b053-f2d7b7fc9b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:33.516841 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165affbf-bc31-4ece-b053-f2d7b7fc9b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:33.517170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165affbf-bc31-4ece-b053-f2d7b7fc9b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:33.517558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165affbf-bc31-4ece-b053-f2d7b7fc9b35 admin admin] PATH_INFO: `/v3/users/0e8445cbb93a4579875c51b559697687` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:33.517660 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae13149-4724-49cd-961f-ede3e12b4eb4 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:33.518795 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165affbf-bc31-4ece-b053-f2d7b7fc9b35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e8445cbb93a4579875c51b559697687)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:33.520716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165affbf-bc31-4ece-b053-f2d7b7fc9b35 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:33.529551 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae13149-4724-49cd-961f-ede3e12b4eb4 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:33.535683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:33.536606 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c2f4c-8473-4814-89f2-c4f5ec5fc87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:33.537332 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c2f4c-8473-4814-89f2-c4f5ec5fc87c admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:33.537666 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c2f4c-8473-4814-89f2-c4f5ec5fc87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:33.537946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c2f4c-8473-4814-89f2-c4f5ec5fc87c admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:33.538676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c2f4c-8473-4814-89f2-c4f5ec5fc87c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:33.540489 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c2f4c-8473-4814-89f2-c4f5ec5fc87c admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:33.558180 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1082/2174] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:53:33.561878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c2f4c-8473-4814-89f2-c4f5ec5fc87c admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:33.575094 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c2f4c-8473-4814-89f2-c4f5ec5fc87c admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:33.582837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782cc04-28b1-4d93-bd62-ec505221f0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:33.583550 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782cc04-28b1-4d93-bd62-ec505221f0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:33.583835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782cc04-28b1-4d93-bd62-ec505221f0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:33.584346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a782cc04-28b1-4d93-bd62-ec505221f0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:33.585219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782cc04-28b1-4d93-bd62-ec505221f0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:33.588178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a782cc04-28b1-4d93-bd62-ec505221f0e8 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:33.604270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1083/2175] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:53:33 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:53:33.609098 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782cc04-28b1-4d93-bd62-ec505221f0e8 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:33.628860 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a782cc04-28b1-4d93-bd62-ec505221f0e8 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:33.635570 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2b9d69-3761-4c18-959c-265de076b212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:33.636321 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b9d69-3761-4c18-959c-265de076b212 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:33.636607 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b9d69-3761-4c18-959c-265de076b212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:33.636914 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b9d69-3761-4c18-959c-265de076b212 admin admin] PATH_INFO: `/v3/projects/997c256859f2484e8465c043b3d2299d/users/4ad27549c1824d45b1d55653e2c121a8/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:33.678334 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b9d69-3761-4c18-959c-265de076b212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=997c256859f2484e8465c043b3d2299d, user_id=4ad27549c1824d45b1d55653e2c121a8, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:33.679072 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2b9d69-3761-4c18-959c-265de076b212 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:33.768136 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-165affbf-bc31-4ece-b053-f2d7b7fc9b35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e8445cbb93a4579875c51b559697687'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:33.803014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1084/2176] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:53:33 2022] PUT /identity/v3/projects/997c256859f2484e8465c043b3d2299d/users/4ad27549c1824d45b1d55653e2c121a8/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:53:33.808031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7546ed-082d-45ae-aa94-821f70d09aff None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:33.808318 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7546ed-082d-45ae-aa94-821f70d09aff None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:33.808598 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7546ed-082d-45ae-aa94-821f70d09aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:33.834146 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-fa7546ed-082d-45ae-aa94-821f70d09aff None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:33.835388 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fa7546ed-082d-45ae-aa94-821f70d09aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:33.903512 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1085/2177] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:53:33.914322 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7546ed-082d-45ae-aa94-821f70d09aff None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:33.915844 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fa7546ed-082d-45ae-aa94-821f70d09aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:33.960995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-165affbf-bc31-4ece-b053-f2d7b7fc9b35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e8445cbb93a4579875c51b559697687'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:33.971034 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-165affbf-bc31-4ece-b053-f2d7b7fc9b35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e8445cbb93a4579875c51b559697687'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:33.972155 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-165affbf-bc31-4ece-b053-f2d7b7fc9b35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e8445cbb93a4579875c51b559697687'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:33.985131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7546ed-082d-45ae-aa94-821f70d09aff None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:33.987904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-165affbf-bc31-4ece-b053-f2d7b7fc9b35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e8445cbb93a4579875c51b559697687'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:33.989266 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fb1b2-d7e5-40e1-890a-fd6f2c416529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:33.990032 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fb1b2-d7e5-40e1-890a-fd6f2c416529 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:33.990396 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fb1b2-d7e5-40e1-890a-fd6f2c416529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:33.990743 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fb1b2-d7e5-40e1-890a-fd6f2c416529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:33.992725 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-139fb1b2-d7e5-40e1-890a-fd6f2c416529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:33.994743 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1093/2178] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:53:33 2022] DELETE /identity/v3/users/0e8445cbb93a4579875c51b559697687 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:53:33.998993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964368a-5e05-4289-aaf7-db4ff1ba5114 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:33.999352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964368a-5e05-4289-aaf7-db4ff1ba5114 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:33.999713 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964368a-5e05-4289-aaf7-db4ff1ba5114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:34.020389 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fb1b2-d7e5-40e1-890a-fd6f2c416529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:34.020389 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fb1b2-d7e5-40e1-890a-fd6f2c416529 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:34.021898 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0964368a-5e05-4289-aaf7-db4ff1ba5114 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:34.023181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0964368a-5e05-4289-aaf7-db4ff1ba5114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:34.023312 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1086/2179] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:53:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:53:34.083935 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1094/2180] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:53:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:53:34.095779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fb1b2-d7e5-40e1-890a-fd6f2c416529 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:34.098439 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-139fb1b2-d7e5-40e1-890a-fd6f2c416529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:34.109717 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fb1b2-d7e5-40e1-890a-fd6f2c416529 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:34.180658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811768e-1e9c-4221-b0aa-235890077219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:34.181351 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811768e-1e9c-4221-b0aa-235890077219 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:34.187504 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811768e-1e9c-4221-b0aa-235890077219 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:34.187504 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811768e-1e9c-4221-b0aa-235890077219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:34.192464 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811768e-1e9c-4221-b0aa-235890077219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:34.194382 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811768e-1e9c-4221-b0aa-235890077219 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:34.210072 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1087/2181] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:53:34.343404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:34.820815 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964368a-5e05-4289-aaf7-db4ff1ba5114 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:34.822416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0964368a-5e05-4289-aaf7-db4ff1ba5114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:34.837636 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964368a-5e05-4289-aaf7-db4ff1ba5114 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:34.845195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50c3c7-5616-4879-85bf-a0faf83ee7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:34.846886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50c3c7-5616-4879-85bf-a0faf83ee7c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:34.847341 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50c3c7-5616-4879-85bf-a0faf83ee7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:34.847623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50c3c7-5616-4879-85bf-a0faf83ee7c7 admin admin] PATH_INFO: `/v3/projects/a1bfcc64565642ef99b5cda5e03d59ed` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:34.848963 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50c3c7-5616-4879-85bf-a0faf83ee7c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1bfcc64565642ef99b5cda5e03d59ed)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:34.850936 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50c3c7-5616-4879-85bf-a0faf83ee7c7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:34.994386 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7f50c3c7-5616-4879-85bf-a0faf83ee7c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1bfcc64565642ef99b5cda5e03d59ed', 'request_id': 'req-7f50c3c7-5616-4879-85bf-a0faf83ee7c7'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:35.003130 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7f50c3c7-5616-4879-85bf-a0faf83ee7c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1bfcc64565642ef99b5cda5e03d59ed', 'request_id': 'req-7f50c3c7-5616-4879-85bf-a0faf83ee7c7'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:35.015135 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7f50c3c7-5616-4879-85bf-a0faf83ee7c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1bfcc64565642ef99b5cda5e03d59ed', 'request_id': 'req-7f50c3c7-5616-4879-85bf-a0faf83ee7c7'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:35.124957 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7f50c3c7-5616-4879-85bf-a0faf83ee7c7 admin admin] The token cache is being invalidate because project a1bfcc64565642ef99b5cda5e03d59ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:53:35.124957 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7f50c3c7-5616-4879-85bf-a0faf83ee7c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:35.124957 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-7f50c3c7-5616-4879-85bf-a0faf83ee7c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:35.124957 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1095/2182] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:53:34 2022] DELETE /identity/v3/projects/a1bfcc64565642ef99b5cda5e03d59ed => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:53:35.129561 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cae99d-86a5-4f6f-846d-01a5acccb3b4 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:35.130065 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cae99d-86a5-4f6f-846d-01a5acccb3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:35.130175 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cae99d-86a5-4f6f-846d-01a5acccb3b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:35.152016 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-41cae99d-86a5-4f6f-846d-01a5acccb3b4 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:35.152016 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-41cae99d-86a5-4f6f-846d-01a5acccb3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:35.216824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1088/2183] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:35.224847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fb783-4b8c-455d-944d-75a46d787db8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:35.227065 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fb783-4b8c-455d-944d-75a46d787db8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:35.227065 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92fb783-4b8c-455d-944d-75a46d787db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:35.246496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f92fb783-4b8c-455d-944d-75a46d787db8 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:35.247755 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f92fb783-4b8c-455d-944d-75a46d787db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:35.256941 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1096/2184] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:53:35.261414 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cae99d-86a5-4f6f-846d-01a5acccb3b4 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:35.272384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cae99d-86a5-4f6f-846d-01a5acccb3b4 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:35.277485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacde0d-d6c4-4c3f-91a4-1f2b4b5f9cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:35.278179 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacde0d-d6c4-4c3f-91a4-1f2b4b5f9cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:35.278465 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacde0d-d6c4-4c3f-91a4-1f2b4b5f9cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:35.278854 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bacde0d-d6c4-4c3f-91a4-1f2b4b5f9cc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:35.279528 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacde0d-d6c4-4c3f-91a4-1f2b4b5f9cc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:53:35.279838 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacde0d-d6c4-4c3f-91a4-1f2b4b5f9cc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:35.281560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bacde0d-d6c4-4c3f-91a4-1f2b4b5f9cc6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:35.295938 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1089/2185] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:53:35.301135 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fb783-4b8c-455d-944d-75a46d787db8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:35.311222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92fb783-4b8c-455d-944d-75a46d787db8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:35.326148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f156b-6fa5-433f-b62c-e0a2cd24df20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:35.326837 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f156b-6fa5-433f-b62c-e0a2cd24df20 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:35.327125 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f156b-6fa5-433f-b62c-e0a2cd24df20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:35.327399 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f156b-6fa5-433f-b62c-e0a2cd24df20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:35.328195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f156b-6fa5-433f-b62c-e0a2cd24df20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:35.332640 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841f156b-6fa5-433f-b62c-e0a2cd24df20 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:35.337943 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:35.468167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1097/2186] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:53:35 2022] POST /identity/v3/projects => generated 383 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:53:35.470201 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacde0d-d6c4-4c3f-91a4-1f2b4b5f9cc6 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:35.483363 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bacde0d-d6c4-4c3f-91a4-1f2b4b5f9cc6 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:35.541721 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fa6d2-a83c-4cb6-9e9d-cf7647e7daef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:35.542404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fa6d2-a83c-4cb6-9e9d-cf7647e7daef admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:35.542689 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fa6d2-a83c-4cb6-9e9d-cf7647e7daef admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:35.542978 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026fa6d2-a83c-4cb6-9e9d-cf7647e7daef admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:35.543676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fa6d2-a83c-4cb6-9e9d-cf7647e7daef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:35.545632 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026fa6d2-a83c-4cb6-9e9d-cf7647e7daef admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:35.690058 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1090/2187] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:53:35 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:53:35.694148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f156b-6fa5-433f-b62c-e0a2cd24df20 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:35.704490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841f156b-6fa5-433f-b62c-e0a2cd24df20 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:35.708992 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fe2ea-912a-4430-bab9-bcf6a421bab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:35.709682 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fe2ea-912a-4430-bab9-bcf6a421bab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:35.709970 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fe2ea-912a-4430-bab9-bcf6a421bab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:35.710248 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fe2ea-912a-4430-bab9-bcf6a421bab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:35.710981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285fe2ea-912a-4430-bab9-bcf6a421bab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:35.712585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285fe2ea-912a-4430-bab9-bcf6a421bab6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:35.723366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1098/2188] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:53:35.727302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fa6d2-a83c-4cb6-9e9d-cf7647e7daef admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:35.739498 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026fa6d2-a83c-4cb6-9e9d-cf7647e7daef admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:35.744396 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1da682-6569-451c-ac58-0293bed6b0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:35.745239 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1da682-6569-451c-ac58-0293bed6b0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:35.745530 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1da682-6569-451c-ac58-0293bed6b0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:35.745808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1da682-6569-451c-ac58-0293bed6b0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:35.746608 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1da682-6569-451c-ac58-0293bed6b0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:35.748314 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1da682-6569-451c-ac58-0293bed6b0e9 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:35.760425 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1091/2189] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:53:35.764770 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fe2ea-912a-4430-bab9-bcf6a421bab6 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:35.775481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fe2ea-912a-4430-bab9-bcf6a421bab6 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:35.780724 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c97a32-445c-4ddd-a6b0-87a70ca82521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:35.782482 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c97a32-445c-4ddd-a6b0-87a70ca82521 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:35.786231 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c97a32-445c-4ddd-a6b0-87a70ca82521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:35.786231 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c97a32-445c-4ddd-a6b0-87a70ca82521 admin admin] PATH_INFO: `/v3/projects/da355bb537bc4c73bd1f20b6c9ba68f6/users/07c061b40cbe4d709e6e3f0065764d44/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:35.801718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c97a32-445c-4ddd-a6b0-87a70ca82521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da355bb537bc4c73bd1f20b6c9ba68f6, user_id=07c061b40cbe4d709e6e3f0065764d44, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:35.805153 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c97a32-445c-4ddd-a6b0-87a70ca82521 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:35.914702 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1099/2190] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:53:35 2022] PUT /identity/v3/projects/da355bb537bc4c73bd1f20b6c9ba68f6/users/07c061b40cbe4d709e6e3f0065764d44/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:53:35.926055 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c044a-29fd-4980-825b-fe4e9ba277d0 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:35.926353 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c044a-29fd-4980-825b-fe4e9ba277d0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:35.926631 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c044a-29fd-4980-825b-fe4e9ba277d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:35.956149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-174c044a-29fd-4980-825b-fe4e9ba277d0 None None] MFA Rules not processed for user `07c061b40cbe4d709e6e3f0065764d44`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:35.957419 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-174c044a-29fd-4980-825b-fe4e9ba277d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:35.961806 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:36.028181 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1092/2191] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:53:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:36.039646 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c97a32-445c-4ddd-a6b0-87a70ca82521 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:36.041731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e0c97a32-445c-4ddd-a6b0-87a70ca82521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:36.129916 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c97a32-445c-4ddd-a6b0-87a70ca82521 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:36.133959 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c579f05-1777-4fb5-9399-02dda257e970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:36.134695 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c579f05-1777-4fb5-9399-02dda257e970 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:36.135057 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c579f05-1777-4fb5-9399-02dda257e970 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:36.135425 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c579f05-1777-4fb5-9399-02dda257e970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:36.145425 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c579f05-1777-4fb5-9399-02dda257e970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:36.147133 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c579f05-1777-4fb5-9399-02dda257e970 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:36.157591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1100/2192] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:53:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:53:41.996892 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc38ef-8c5c-43eb-ac2a-c86a81f032ad None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:41.999449 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc38ef-8c5c-43eb-ac2a-c86a81f032ad None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:42.001895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc38ef-8c5c-43eb-ac2a-c86a81f032ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:42.043880 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-14fc38ef-8c5c-43eb-ac2a-c86a81f032ad None None] MFA Rules not processed for user `4ad27549c1824d45b1d55653e2c121a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:42.045649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-14fc38ef-8c5c-43eb-ac2a-c86a81f032ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:42.131445 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1093/2193] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:53:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:42.133263 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c579f05-1777-4fb5-9399-02dda257e970 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:42.134835 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9c579f05-1777-4fb5-9399-02dda257e970 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:42.223867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c579f05-1777-4fb5-9399-02dda257e970 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:42.228457 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada0790-14ba-4c01-a834-f2f5883c5a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:42.229159 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada0790-14ba-4c01-a834-f2f5883c5a55 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:42.229447 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada0790-14ba-4c01-a834-f2f5883c5a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:42.229724 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada0790-14ba-4c01-a834-f2f5883c5a55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:42.230436 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada0790-14ba-4c01-a834-f2f5883c5a55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:42.232590 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada0790-14ba-4c01-a834-f2f5883c5a55 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:42.321837 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1101/2194] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:53:42 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:53:42.326180 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc38ef-8c5c-43eb-ac2a-c86a81f032ad None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:42.336821 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc38ef-8c5c-43eb-ac2a-c86a81f032ad None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:42.393925 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc135dd-da36-4b91-a7f8-611f96da01ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:42.394610 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc135dd-da36-4b91-a7f8-611f96da01ff admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:42.394893 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc135dd-da36-4b91-a7f8-611f96da01ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:42.395173 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc135dd-da36-4b91-a7f8-611f96da01ff admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:42.395878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc135dd-da36-4b91-a7f8-611f96da01ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:42.397874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc135dd-da36-4b91-a7f8-611f96da01ff admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:42.501250 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1094/2195] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:53:42 2022] POST /identity/v3/users => generated 296 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:53:42.504648 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada0790-14ba-4c01-a834-f2f5883c5a55 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:42.517848 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada0790-14ba-4c01-a834-f2f5883c5a55 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:42.524005 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57caa00b-c7ca-4d5f-b8d2-b13e19f48bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:42.524708 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caa00b-c7ca-4d5f-b8d2-b13e19f48bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:42.525003 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caa00b-c7ca-4d5f-b8d2-b13e19f48bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:42.525315 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57caa00b-c7ca-4d5f-b8d2-b13e19f48bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:42.526061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57caa00b-c7ca-4d5f-b8d2-b13e19f48bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:42.527707 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57caa00b-c7ca-4d5f-b8d2-b13e19f48bd1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:42.545783 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1102/2196] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:53:42.550390 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc135dd-da36-4b91-a7f8-611f96da01ff admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:42.560927 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc135dd-da36-4b91-a7f8-611f96da01ff admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:42.566013 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d546f-6ca6-411c-bac9-1e5e68481668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:42.566933 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d546f-6ca6-411c-bac9-1e5e68481668 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:42.567215 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d546f-6ca6-411c-bac9-1e5e68481668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:42.567496 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d546f-6ca6-411c-bac9-1e5e68481668 admin admin] PATH_INFO: `/v3/projects/67c56b2cb75549c4a3e35941acfbed73/users/da79d652275341ecad56734db5665f87/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:42.586451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d546f-6ca6-411c-bac9-1e5e68481668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c56b2cb75549c4a3e35941acfbed73, user_id=da79d652275341ecad56734db5665f87, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:42.599392 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87d546f-6ca6-411c-bac9-1e5e68481668 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:42.746017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:42.750800 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1095/2197] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:53:42 2022] PUT /identity/v3/projects/67c56b2cb75549c4a3e35941acfbed73/users/da79d652275341ecad56734db5665f87/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:53:42.757869 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57caa00b-c7ca-4d5f-b8d2-b13e19f48bd1 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:42.770084 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57caa00b-c7ca-4d5f-b8d2-b13e19f48bd1 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:42.801294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:42.842564 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dcc5b-2163-4b20-bd30-9b7a1bcb3f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:42.843796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dcc5b-2163-4b20-bd30-9b7a1bcb3f70 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:42.845036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dcc5b-2163-4b20-bd30-9b7a1bcb3f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:42.851967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dcc5b-2163-4b20-bd30-9b7a1bcb3f70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:42.852834 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dcc5b-2163-4b20-bd30-9b7a1bcb3f70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:42.854576 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dcc5b-2163-4b20-bd30-9b7a1bcb3f70 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:42.871890 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1103/2198] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:53:42 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:53:42.876169 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d546f-6ca6-411c-bac9-1e5e68481668 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:42.887233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d546f-6ca6-411c-bac9-1e5e68481668 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:42.893670 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8949a7d-9223-4d99-8afc-120c56ea0ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:42.894794 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8949a7d-9223-4d99-8afc-120c56ea0ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:42.895164 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8949a7d-9223-4d99-8afc-120c56ea0ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:42.895504 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8949a7d-9223-4d99-8afc-120c56ea0ca0 admin admin] PATH_INFO: `/v3/projects/67c56b2cb75549c4a3e35941acfbed73/users/da79d652275341ecad56734db5665f87/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:42.897579 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8949a7d-9223-4d99-8afc-120c56ea0ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c56b2cb75549c4a3e35941acfbed73, user_id=da79d652275341ecad56734db5665f87, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:42.900738 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8949a7d-9223-4d99-8afc-120c56ea0ca0 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:42.912983 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1096/2199] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:53:42 2022] PUT /identity/v3/projects/67c56b2cb75549c4a3e35941acfbed73/users/da79d652275341ecad56734db5665f87/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:53:44.089974 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e269559-1e98-42e4-8936-4f49ba5066a3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:44.090430 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e269559-1e98-42e4-8936-4f49ba5066a3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:44.090557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e269559-1e98-42e4-8936-4f49ba5066a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:44.121944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3e269559-1e98-42e4-8936-4f49ba5066a3 None None] MFA Rules not processed for user `6809c29bee4041c393e6773643c63c2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:44.123554 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3e269559-1e98-42e4-8936-4f49ba5066a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:44.244941 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1104/2200] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:53:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:48.491736 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8949a7d-9223-4d99-8afc-120c56ea0ca0 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:48.494484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f8949a7d-9223-4d99-8afc-120c56ea0ca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:48.575501 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8949a7d-9223-4d99-8afc-120c56ea0ca0 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:48.580467 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67859cfc-1984-4b9c-aa81-cb591cac621f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:48.583314 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67859cfc-1984-4b9c-aa81-cb591cac621f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:48.583314 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67859cfc-1984-4b9c-aa81-cb591cac621f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:48.583314 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67859cfc-1984-4b9c-aa81-cb591cac621f admin admin] PATH_INFO: `/v3/users/eae65f54557d4ff19e627ef093d4ac3a` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:48.583596 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67859cfc-1984-4b9c-aa81-cb591cac621f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eae65f54557d4ff19e627ef093d4ac3a)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:48.585326 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67859cfc-1984-4b9c-aa81-cb591cac621f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:49.077858 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-67859cfc-1984-4b9c-aa81-cb591cac621f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eae65f54557d4ff19e627ef093d4ac3a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:49.279750 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-67859cfc-1984-4b9c-aa81-cb591cac621f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eae65f54557d4ff19e627ef093d4ac3a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:49.299348 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-67859cfc-1984-4b9c-aa81-cb591cac621f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eae65f54557d4ff19e627ef093d4ac3a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:49.300327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-67859cfc-1984-4b9c-aa81-cb591cac621f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eae65f54557d4ff19e627ef093d4ac3a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:49.331283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-67859cfc-1984-4b9c-aa81-cb591cac621f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eae65f54557d4ff19e627ef093d4ac3a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:49.343125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1097/2201] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:53:48 2022] DELETE /identity/v3/users/eae65f54557d4ff19e627ef093d4ac3a => generated 0 bytes in 852 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:53:49.351515 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9133900-6202-48ac-b54f-c5f310f93da8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:49.352471 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9133900-6202-48ac-b54f-c5f310f93da8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:49.352709 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9133900-6202-48ac-b54f-c5f310f93da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:49.376472 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d9133900-6202-48ac-b54f-c5f310f93da8 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:49.378968 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d9133900-6202-48ac-b54f-c5f310f93da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:49.451131 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1105/2202] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:53:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:53:49.461507 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67859cfc-1984-4b9c-aa81-cb591cac621f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:49.462989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-67859cfc-1984-4b9c-aa81-cb591cac621f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:49.549963 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9133900-6202-48ac-b54f-c5f310f93da8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:49.552095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d9133900-6202-48ac-b54f-c5f310f93da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:49.560808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67859cfc-1984-4b9c-aa81-cb591cac621f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:49.565216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e31ded-d91d-4c46-8f0b-2f0b53c0fa43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:49.566244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e31ded-d91d-4c46-8f0b-2f0b53c0fa43 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:49.566244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e31ded-d91d-4c46-8f0b-2f0b53c0fa43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:49.566569 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e31ded-d91d-4c46-8f0b-2f0b53c0fa43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:49.581210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e31ded-d91d-4c46-8f0b-2f0b53c0fa43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:49.582777 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e31ded-d91d-4c46-8f0b-2f0b53c0fa43 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:49.590894 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9133900-6202-48ac-b54f-c5f310f93da8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:49.597172 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1098/2203] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:53:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:53:49.597488 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7d64d-d381-4494-976c-909ae049f21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:49.598399 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7d64d-d381-4494-976c-909ae049f21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:49.599297 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7d64d-d381-4494-976c-909ae049f21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:49.599589 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f7d64d-d381-4494-976c-909ae049f21a admin admin] PATH_INFO: `/v3/users/07c061b40cbe4d709e6e3f0065764d44` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:49.600902 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7d64d-d381-4494-976c-909ae049f21a admin admin] RBAC: Authorizing `identity:delete_user(user_id=07c061b40cbe4d709e6e3f0065764d44)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:49.603576 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f7d64d-d381-4494-976c-909ae049f21a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:49.911657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e9f7d64d-d381-4494-976c-909ae049f21a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07c061b40cbe4d709e6e3f0065764d44'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:50.021081 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e9f7d64d-d381-4494-976c-909ae049f21a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07c061b40cbe4d709e6e3f0065764d44'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:50.034125 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e9f7d64d-d381-4494-976c-909ae049f21a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07c061b40cbe4d709e6e3f0065764d44'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:50.035538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e9f7d64d-d381-4494-976c-909ae049f21a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07c061b40cbe4d709e6e3f0065764d44'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:50.037133 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:50.054358 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e9f7d64d-d381-4494-976c-909ae049f21a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07c061b40cbe4d709e6e3f0065764d44'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:50.061272 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1106/2204] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:53:49 2022] DELETE /identity/v3/users/07c061b40cbe4d709e6e3f0065764d44 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:53:50.066773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235735b-5f58-4caf-aa5b-6f86c5dd94ea None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:50.067291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235735b-5f58-4caf-aa5b-6f86c5dd94ea None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:50.067591 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f235735b-5f58-4caf-aa5b-6f86c5dd94ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:50.088239 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-f235735b-5f58-4caf-aa5b-6f86c5dd94ea None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:50.089765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f235735b-5f58-4caf-aa5b-6f86c5dd94ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:50.098955 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:50.198742 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1099/2205] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:53:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:50.219836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7d64d-d381-4494-976c-909ae049f21a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:50.221330 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e9f7d64d-d381-4494-976c-909ae049f21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:50.370979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f7d64d-d381-4494-976c-909ae049f21a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:50.385067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cb8424-cc65-4924-94ea-dc0481c9064e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:50.386230 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb8424-cc65-4924-94ea-dc0481c9064e service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:50.388962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb8424-cc65-4924-94ea-dc0481c9064e service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:50.389599 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cb8424-cc65-4924-94ea-dc0481c9064e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:50.418762 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb8424-cc65-4924-94ea-dc0481c9064e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:50.420273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cb8424-cc65-4924-94ea-dc0481c9064e service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:50.435093 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1107/2206] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:53:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:53:50.661267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235735b-5f58-4caf-aa5b-6f86c5dd94ea None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:50.663290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f235735b-5f58-4caf-aa5b-6f86c5dd94ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:50.685751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f235735b-5f58-4caf-aa5b-6f86c5dd94ea None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:50.693264 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0e8e1-6a62-424c-bb2f-6ff61dc1b668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:50.693264 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0e8e1-6a62-424c-bb2f-6ff61dc1b668 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:50.693595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0e8e1-6a62-424c-bb2f-6ff61dc1b668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:50.694030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0e8e1-6a62-424c-bb2f-6ff61dc1b668 admin admin] PATH_INFO: `/v3/projects/432c45c384d94d5abac960559be97c58` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:50.695485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0e8e1-6a62-424c-bb2f-6ff61dc1b668 admin admin] RBAC: Authorizing `identity:delete_project(project_id=432c45c384d94d5abac960559be97c58)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:50.697996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0e8e1-6a62-424c-bb2f-6ff61dc1b668 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:50.942845 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dc85f-8159-4c8d-9310-672c7ebed7ef None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:50.943812 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dc85f-8159-4c8d-9310-672c7ebed7ef None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:50.944262 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497dc85f-8159-4c8d-9310-672c7ebed7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:50.976034 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-497dc85f-8159-4c8d-9310-672c7ebed7ef None None] MFA Rules not processed for user `da79d652275341ecad56734db5665f87`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:50.977295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-497dc85f-8159-4c8d-9310-672c7ebed7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:51.053865 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e7c0e8e1-6a62-424c-bb2f-6ff61dc1b668 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '432c45c384d94d5abac960559be97c58', 'request_id': 'req-e7c0e8e1-6a62-424c-bb2f-6ff61dc1b668'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:51.061393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e7c0e8e1-6a62-424c-bb2f-6ff61dc1b668 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '432c45c384d94d5abac960559be97c58', 'request_id': 'req-e7c0e8e1-6a62-424c-bb2f-6ff61dc1b668'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:51.071748 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e7c0e8e1-6a62-424c-bb2f-6ff61dc1b668 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '432c45c384d94d5abac960559be97c58', 'request_id': 'req-e7c0e8e1-6a62-424c-bb2f-6ff61dc1b668'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:51.101132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1108/2207] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:53:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:53:51.112438 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497dc85f-8159-4c8d-9310-672c7ebed7ef None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:51.114148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-497dc85f-8159-4c8d-9310-672c7ebed7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:51.191771 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e7c0e8e1-6a62-424c-bb2f-6ff61dc1b668 admin admin] The token cache is being invalidate because project 432c45c384d94d5abac960559be97c58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:53:51.192185 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e7c0e8e1-6a62-424c-bb2f-6ff61dc1b668 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:51.193039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-e7c0e8e1-6a62-424c-bb2f-6ff61dc1b668 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:51.198419 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1100/2208] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:53:50 2022] DELETE /identity/v3/projects/432c45c384d94d5abac960559be97c58 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:53:51.201962 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4814f9d-d85f-4453-ba2b-a63b7b5949d3 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:51.205337 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4814f9d-d85f-4453-ba2b-a63b7b5949d3 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:51.205675 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4814f9d-d85f-4453-ba2b-a63b7b5949d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:51.268980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-b4814f9d-d85f-4453-ba2b-a63b7b5949d3 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:51.275446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b4814f9d-d85f-4453-ba2b-a63b7b5949d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:51.327060 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497dc85f-8159-4c8d-9310-672c7ebed7ef None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:51.336350 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:51.392465 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1101/2209] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:51.400360 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f35c2-2a5e-4a9c-9970-b14e6482e621 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:51.400890 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f35c2-2a5e-4a9c-9970-b14e6482e621 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:51.401207 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9f35c2-2a5e-4a9c-9970-b14e6482e621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:51.425246 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-7f9f35c2-2a5e-4a9c-9970-b14e6482e621 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:51.427093 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7f9f35c2-2a5e-4a9c-9970-b14e6482e621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:51.441624 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1102/2210] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:53:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:51.442931 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f35c2-2a5e-4a9c-9970-b14e6482e621 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:51.445088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7f9f35c2-2a5e-4a9c-9970-b14e6482e621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:51.451325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80de2c-23e9-41c3-ad2d-aee83f74c36d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:51.453104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80de2c-23e9-41c3-ad2d-aee83f74c36d service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:51.453573 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80de2c-23e9-41c3-ad2d-aee83f74c36d service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:51.453881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f80de2c-23e9-41c3-ad2d-aee83f74c36d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:51.456412 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5f80de2c-23e9-41c3-ad2d-aee83f74c36d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:51.468742 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9f35c2-2a5e-4a9c-9970-b14e6482e621 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:51.489937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515712e1-0a9c-4310-9f77-8ccfe4b73242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:51.491847 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515712e1-0a9c-4310-9f77-8ccfe4b73242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:51.492370 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515712e1-0a9c-4310-9f77-8ccfe4b73242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:51.492868 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515712e1-0a9c-4310-9f77-8ccfe4b73242 admin admin] PATH_INFO: `/v3/projects/da355bb537bc4c73bd1f20b6c9ba68f6` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:51.494654 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515712e1-0a9c-4310-9f77-8ccfe4b73242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da355bb537bc4c73bd1f20b6c9ba68f6)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:51.497348 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515712e1-0a9c-4310-9f77-8ccfe4b73242 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:51.537339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:51.553153 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80de2c-23e9-41c3-ad2d-aee83f74c36d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:51.555529 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f80de2c-23e9-41c3-ad2d-aee83f74c36d service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:51.567841 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1109/2211] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:53:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:53:51.568809 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80de2c-23e9-41c3-ad2d-aee83f74c36d service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:51.583281 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f80de2c-23e9-41c3-ad2d-aee83f74c36d service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:51.590417 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c22fb-6831-4db7-ac7e-3db332827b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:51.591583 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c22fb-6831-4db7-ac7e-3db332827b4e admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:51.592050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c22fb-6831-4db7-ac7e-3db332827b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:51.592617 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c22fb-6831-4db7-ac7e-3db332827b4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:51.594624 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c22fb-6831-4db7-ac7e-3db332827b4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:53:51.595361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c22fb-6831-4db7-ac7e-3db332827b4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:51.598903 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c22fb-6831-4db7-ac7e-3db332827b4e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:51.625087 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1110/2212] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:53:51.629236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c22fb-6831-4db7-ac7e-3db332827b4e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:51.648172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c22fb-6831-4db7-ac7e-3db332827b4e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:51.657328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e049e4-17e9-4f22-919c-d3c5a7a18c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:51.658776 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e049e4-17e9-4f22-919c-d3c5a7a18c6d admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:51.659292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e049e4-17e9-4f22-919c-d3c5a7a18c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:51.659806 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e049e4-17e9-4f22-919c-d3c5a7a18c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:51.661149 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e049e4-17e9-4f22-919c-d3c5a7a18c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:51.664988 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e049e4-17e9-4f22-919c-d3c5a7a18c6d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:51.720999 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-515712e1-0a9c-4310-9f77-8ccfe4b73242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da355bb537bc4c73bd1f20b6c9ba68f6', 'request_id': 'req-515712e1-0a9c-4310-9f77-8ccfe4b73242'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:51.728866 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-515712e1-0a9c-4310-9f77-8ccfe4b73242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da355bb537bc4c73bd1f20b6c9ba68f6', 'request_id': 'req-515712e1-0a9c-4310-9f77-8ccfe4b73242'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:51.739096 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-515712e1-0a9c-4310-9f77-8ccfe4b73242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da355bb537bc4c73bd1f20b6c9ba68f6', 'request_id': 'req-515712e1-0a9c-4310-9f77-8ccfe4b73242'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:51.815283 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1111/2213] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:53:51 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:53:51.815283 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e049e4-17e9-4f22-919c-d3c5a7a18c6d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:51.837235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-515712e1-0a9c-4310-9f77-8ccfe4b73242 admin admin] The token cache is being invalidate because project da355bb537bc4c73bd1f20b6c9ba68f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:53:51.837632 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-515712e1-0a9c-4310-9f77-8ccfe4b73242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:51.839641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-515712e1-0a9c-4310-9f77-8ccfe4b73242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:53:51.842600 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1103/2214] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:53:51 2022] DELETE /identity/v3/projects/da355bb537bc4c73bd1f20b6c9ba68f6 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:53:51.953734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e049e4-17e9-4f22-919c-d3c5a7a18c6d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:51.962050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2beff-db63-464d-856c-28211dc2ef97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:51.962762 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2beff-db63-464d-856c-28211dc2ef97 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:51.963054 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2beff-db63-464d-856c-28211dc2ef97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:51.963335 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b2beff-db63-464d-856c-28211dc2ef97 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:51.964071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2beff-db63-464d-856c-28211dc2ef97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:51.966246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b2beff-db63-464d-856c-28211dc2ef97 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:52.106063 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1112/2215] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:53:51 2022] POST /identity/v3/users => generated 287 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:53:52.112017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515712e1-0a9c-4310-9f77-8ccfe4b73242 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:52.113526 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-515712e1-0a9c-4310-9f77-8ccfe4b73242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:52.218019 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515712e1-0a9c-4310-9f77-8ccfe4b73242 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:52.223601 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe96bee-a1d6-4ce0-959e-f09662b88d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:52.224393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe96bee-a1d6-4ce0-959e-f09662b88d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:52.224745 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe96bee-a1d6-4ce0-959e-f09662b88d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:52.225149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe96bee-a1d6-4ce0-959e-f09662b88d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:52.226069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe96bee-a1d6-4ce0-959e-f09662b88d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:52.228009 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe96bee-a1d6-4ce0-959e-f09662b88d41 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:52.239957 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1104/2216] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:53:52.244348 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2beff-db63-464d-856c-28211dc2ef97 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:52.256521 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b2beff-db63-464d-856c-28211dc2ef97 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:52.261511 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5627d5-42e4-4dd5-9fa5-2053c5edf5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:52.262420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5627d5-42e4-4dd5-9fa5-2053c5edf5ea admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:52.262776 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5627d5-42e4-4dd5-9fa5-2053c5edf5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:52.263150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5627d5-42e4-4dd5-9fa5-2053c5edf5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:52.263978 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5627d5-42e4-4dd5-9fa5-2053c5edf5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:52.266317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5627d5-42e4-4dd5-9fa5-2053c5edf5ea admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:52.281070 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1113/2217] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:53:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:53:52.284218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe96bee-a1d6-4ce0-959e-f09662b88d41 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:52.298442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe96bee-a1d6-4ce0-959e-f09662b88d41 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:52.302862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab509d05-d0e0-4001-a02b-5b5843efe826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:52.303782 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab509d05-d0e0-4001-a02b-5b5843efe826 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:52.304070 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab509d05-d0e0-4001-a02b-5b5843efe826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:52.304346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab509d05-d0e0-4001-a02b-5b5843efe826 admin admin] PATH_INFO: `/v3/projects/46abecf729dd426f9ffc02cee5d67150/users/9011730621194d0e8165de381177bd2e/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:52.322809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab509d05-d0e0-4001-a02b-5b5843efe826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46abecf729dd426f9ffc02cee5d67150, user_id=9011730621194d0e8165de381177bd2e, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:52.341871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab509d05-d0e0-4001-a02b-5b5843efe826 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:52.793259 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1105/2218] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:53:52 2022] PUT /identity/v3/projects/46abecf729dd426f9ffc02cee5d67150/users/9011730621194d0e8165de381177bd2e/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:53:52.797250 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e834fd-eeb8-4a15-b433-e5ce39f02e44 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:52.798132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e834fd-eeb8-4a15-b433-e5ce39f02e44 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:52.798132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e834fd-eeb8-4a15-b433-e5ce39f02e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:52.817482 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b4e834fd-eeb8-4a15-b433-e5ce39f02e44 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:53:52.832626 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b4e834fd-eeb8-4a15-b433-e5ce39f02e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:52.899720 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1114/2219] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:53:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:53:52.917818 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab509d05-d0e0-4001-a02b-5b5843efe826 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:53:52.917818 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ab509d05-d0e0-4001-a02b-5b5843efe826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:53:52.996067 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab509d05-d0e0-4001-a02b-5b5843efe826 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:53:53.002739 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f985a-3f30-4c73-9bdf-b4c18caa47d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:53:53.003428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f985a-3f30-4c73-9bdf-b4c18caa47d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:53:53.003709 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f985a-3f30-4c73-9bdf-b4c18caa47d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:53:53.003987 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f985a-3f30-4c73-9bdf-b4c18caa47d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:53:53.022384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f985a-3f30-4c73-9bdf-b4c18caa47d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:53:53.024714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f985a-3f30-4c73-9bdf-b4c18caa47d9 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:53:53.027436 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:53:53.038006 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1106/2220] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:53:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:54:01.116924 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0ee1c-f152-4b64-8f30-4c0917f535ee None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:01.117459 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0ee1c-f152-4b64-8f30-4c0917f535ee None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:01.117758 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0ee1c-f152-4b64-8f30-4c0917f535ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:01.151512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-65a0ee1c-f152-4b64-8f30-4c0917f535ee None None] MFA Rules not processed for user `9011730621194d0e8165de381177bd2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:54:01.153228 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-65a0ee1c-f152-4b64-8f30-4c0917f535ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:01.240715 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1115/2221] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:54:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:54:01.245400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f985a-3f30-4c73-9bdf-b4c18caa47d9 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:01.256939 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f985a-3f30-4c73-9bdf-b4c18caa47d9 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:01.261657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d30ae7-0437-4787-927b-7b213d9d993a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:01.262327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d30ae7-0437-4787-927b-7b213d9d993a admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:01.262609 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d30ae7-0437-4787-927b-7b213d9d993a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:01.262884 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d30ae7-0437-4787-927b-7b213d9d993a admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:01.263774 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d30ae7-0437-4787-927b-7b213d9d993a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:01.266403 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d30ae7-0437-4787-927b-7b213d9d993a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:01.364654 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1107/2222] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:54:01 2022] POST /identity/v3/projects => generated 373 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:54:01.369524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0ee1c-f152-4b64-8f30-4c0917f535ee None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:01.388318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0ee1c-f152-4b64-8f30-4c0917f535ee None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:01.470027 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadec591-a7e6-4c07-88ce-3aee3ce70dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:01.470776 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadec591-a7e6-4c07-88ce-3aee3ce70dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:01.471066 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadec591-a7e6-4c07-88ce-3aee3ce70dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:01.471350 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadec591-a7e6-4c07-88ce-3aee3ce70dc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:01.472055 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadec591-a7e6-4c07-88ce-3aee3ce70dc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:01.474149 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadec591-a7e6-4c07-88ce-3aee3ce70dc1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:01.561570 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1116/2223] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:54:01 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:54:01.566932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d30ae7-0437-4787-927b-7b213d9d993a admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:01.573873 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:01.581718 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d30ae7-0437-4787-927b-7b213d9d993a admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:01.595197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542f955-b443-492c-aa79-7ce250f45d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:01.596643 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542f955-b443-492c-aa79-7ce250f45d66 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:01.597555 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542f955-b443-492c-aa79-7ce250f45d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:01.597998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542f955-b443-492c-aa79-7ce250f45d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:01.599060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542f955-b443-492c-aa79-7ce250f45d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:01.600960 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542f955-b443-492c-aa79-7ce250f45d66 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:01.620932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1108/2224] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:54:01.622298 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadec591-a7e6-4c07-88ce-3aee3ce70dc1 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:01.645280 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadec591-a7e6-4c07-88ce-3aee3ce70dc1 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:01.652638 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6738dd-c62c-4ba3-a13e-17c51caa4ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:01.652638 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6738dd-c62c-4ba3-a13e-17c51caa4ffd admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:01.652638 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6738dd-c62c-4ba3-a13e-17c51caa4ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:01.652638 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6738dd-c62c-4ba3-a13e-17c51caa4ffd admin admin] PATH_INFO: `/v3/projects/93fc65b2ac524b219245858bbebb5ec1/users/76c26170fb5347659506326e3588469e/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:01.655013 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:01.670191 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6738dd-c62c-4ba3-a13e-17c51caa4ffd admin admin] RBAC: Authorizing `identity:create_grant(project_id=93fc65b2ac524b219245858bbebb5ec1, user_id=76c26170fb5347659506326e3588469e, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:01.673622 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6738dd-c62c-4ba3-a13e-17c51caa4ffd admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:01.788079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1117/2225] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:54:01 2022] PUT /identity/v3/projects/93fc65b2ac524b219245858bbebb5ec1/users/76c26170fb5347659506326e3588469e/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:54:01.796418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542f955-b443-492c-aa79-7ce250f45d66 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:01.809721 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542f955-b443-492c-aa79-7ce250f45d66 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:01.928891 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff629c5-18f5-47f2-9847-176d9636207f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:01.929440 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff629c5-18f5-47f2-9847-176d9636207f admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:01.929723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff629c5-18f5-47f2-9847-176d9636207f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:01.930000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff629c5-18f5-47f2-9847-176d9636207f admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:01.930865 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff629c5-18f5-47f2-9847-176d9636207f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:01.933421 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff629c5-18f5-47f2-9847-176d9636207f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:01.952810 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1109/2226] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:54:01.956977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6738dd-c62c-4ba3-a13e-17c51caa4ffd admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:01.968514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6738dd-c62c-4ba3-a13e-17c51caa4ffd admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:01.975618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc16f396-1d82-43b7-8683-8ebe3e34e001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:01.977733 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16f396-1d82-43b7-8683-8ebe3e34e001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:01.978082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16f396-1d82-43b7-8683-8ebe3e34e001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:01.978410 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc16f396-1d82-43b7-8683-8ebe3e34e001 admin admin] PATH_INFO: `/v3/projects/93fc65b2ac524b219245858bbebb5ec1/users/76c26170fb5347659506326e3588469e/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:01.981553 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16f396-1d82-43b7-8683-8ebe3e34e001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93fc65b2ac524b219245858bbebb5ec1, user_id=76c26170fb5347659506326e3588469e, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:01.985997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc16f396-1d82-43b7-8683-8ebe3e34e001 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:01.997474 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1118/2227] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:54:01 2022] PUT /identity/v3/projects/93fc65b2ac524b219245858bbebb5ec1/users/76c26170fb5347659506326e3588469e/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 16:54:09.829220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff629c5-18f5-47f2-9847-176d9636207f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:09.829893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49005d7-cc2c-47ec-bc9b-0fa320e306b4 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:09.830345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49005d7-cc2c-47ec-bc9b-0fa320e306b4 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:09.830451 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49005d7-cc2c-47ec-bc9b-0fa320e306b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:09.831132 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1ff629c5-18f5-47f2-9847-176d9636207f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:09.858122 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f49005d7-cc2c-47ec-bc9b-0fa320e306b4 None None] MFA Rules not processed for user `76c26170fb5347659506326e3588469e`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:54:09.860123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f49005d7-cc2c-47ec-bc9b-0fa320e306b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:09.916922 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff629c5-18f5-47f2-9847-176d9636207f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:09.948697 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1119/2228] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:54:09 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:54:09.962791 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49005d7-cc2c-47ec-bc9b-0fa320e306b4 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:09.964476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f49005d7-cc2c-47ec-bc9b-0fa320e306b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:09.985963 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd26d6-c7b7-4611-bc31-675789f85e70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c8d6afb4ccd41a5972e3241a3eebc7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:09.986631 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd26d6-c7b7-4611-bc31-675789f85e70 service placement] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:09.987998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd26d6-c7b7-4611-bc31-675789f85e70 service placement] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:09.987998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd26d6-c7b7-4611-bc31-675789f85e70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:09.989772 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3dbd26d6-c7b7-4611-bc31-675789f85e70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:10.002417 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd26d6-c7b7-4611-bc31-675789f85e70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:10.004078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd26d6-c7b7-4611-bc31-675789f85e70 service placement] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:10.015225 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1110/2229] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:54:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:54:10.071072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49005d7-cc2c-47ec-bc9b-0fa320e306b4 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:10.086027 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce51c7-4df1-4a07-a6da-2116e70570fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:10.086292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce51c7-4df1-4a07-a6da-2116e70570fd service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:10.086616 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce51c7-4df1-4a07-a6da-2116e70570fd service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:10.086895 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce51c7-4df1-4a07-a6da-2116e70570fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:10.159459 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:10.165092 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce51c7-4df1-4a07-a6da-2116e70570fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:10.166893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce51c7-4df1-4a07-a6da-2116e70570fd service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:10.183216 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1120/2230] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:54:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:54:13.438296 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafba9d-c26d-4e16-9a17-944a90a10e0c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:13.438824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafba9d-c26d-4e16-9a17-944a90a10e0c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:13.438824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafba9d-c26d-4e16-9a17-944a90a10e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:13.457789 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-2eafba9d-c26d-4e16-9a17-944a90a10e0c None None] MFA Rules not processed for user `4d27db5cdd9e453dbd93b862db694309`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:54:13.459169 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2eafba9d-c26d-4e16-9a17-944a90a10e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:13.474469 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:13.534488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1111/2231] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:54:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:54:14.072618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c291c-6b90-4291-ac79-8c12885d183f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:14.073466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c291c-6b90-4291-ac79-8c12885d183f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:14.073466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c291c-6b90-4291-ac79-8c12885d183f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:14.090769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-114c291c-6b90-4291-ac79-8c12885d183f None None] MFA Rules not processed for user `9011730621194d0e8165de381177bd2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:54:14.091980 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-114c291c-6b90-4291-ac79-8c12885d183f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:14.101920 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1121/2232] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:54:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:54:23.735627 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=16 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:24.085787 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=7 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:31.678601 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5da929-c0bd-49b0-9666-7a1a13f5f29c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:31.679257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5da929-c0bd-49b0-9666-7a1a13f5f29c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:31.679257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5da929-c0bd-49b0-9666-7a1a13f5f29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:31.697551 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-7c5da929-c0bd-49b0-9666-7a1a13f5f29c None None] MFA Rules not processed for user `ff65e481807b4344897b1499cd450f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:54:31.698752 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7c5da929-c0bd-49b0-9666-7a1a13f5f29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:31.769004 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1112/2233] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 16:54:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:54:31.815626 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c291c-6b90-4291-ac79-8c12885d183f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:31.817121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-114c291c-6b90-4291-ac79-8c12885d183f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:31.893528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c291c-6b90-4291-ac79-8c12885d183f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:31.898919 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de61512-87c2-4a23-801d-2bfca40bb8ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bc0fa34b414328a342d685bc1eaca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:31.899576 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de61512-87c2-4a23-801d-2bfca40bb8ba service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:31.900031 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de61512-87c2-4a23-801d-2bfca40bb8ba service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:31.900314 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de61512-87c2-4a23-801d-2bfca40bb8ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:31.914001 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de61512-87c2-4a23-801d-2bfca40bb8ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:31.916044 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de61512-87c2-4a23-801d-2bfca40bb8ba service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:31.926061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1122/2234] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 16:54:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:54:33.576175 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f2dce-b061-4773-977f-92cec0e90443 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:33.577001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f2dce-b061-4773-977f-92cec0e90443 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:33.577001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976f2dce-b061-4773-977f-92cec0e90443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:33.596912 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-976f2dce-b061-4773-977f-92cec0e90443 None None] MFA Rules not processed for user `4ad27549c1824d45b1d55653e2c121a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:54:33.598358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-976f2dce-b061-4773-977f-92cec0e90443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:33.665049 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1113/2235] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:54:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:54:41.923290 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=32 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:43.655326 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=50 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:52.845236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17fef1-7e2c-4c90-9ea8-f409c4b7c490 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:52.845740 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17fef1-7e2c-4c90-9ea8-f409c4b7c490 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:52.845846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17fef1-7e2c-4c90-9ea8-f409c4b7c490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:52.864927 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8c17fef1-7e2c-4c90-9ea8-f409c4b7c490 None None] MFA Rules not processed for user `ff65e481807b4344897b1499cd450f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:54:52.866187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8c17fef1-7e2c-4c90-9ea8-f409c4b7c490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:52.873580 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1123/2236] 10.222.0.76 () {58 vars in 967 bytes} [Mon Jul 18 16:54:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:54:52.886158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f2dce-b061-4773-977f-92cec0e90443 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:52.898222 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976f2dce-b061-4773-977f-92cec0e90443 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:52.906159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c41bc-945e-4906-8cee-8284378ed046 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bc0fa34b414328a342d685bc1eaca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:52.906159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c41bc-945e-4906-8cee-8284378ed046 service swift] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:52.906386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c41bc-945e-4906-8cee-8284378ed046 service swift] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:52.906538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8c41bc-945e-4906-8cee-8284378ed046 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:52.916189 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c41bc-945e-4906-8cee-8284378ed046 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:52.917942 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8c41bc-945e-4906-8cee-8284378ed046 service swift] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:52.927759 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1114/2237] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 16:54:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:54:56.586288 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17fef1-7e2c-4c90-9ea8-f409c4b7c490 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:56.588047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8c17fef1-7e2c-4c90-9ea8-f409c4b7c490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:56.682314 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17fef1-7e2c-4c90-9ea8-f409c4b7c490 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:56.688204 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1678016d-bd15-4bd1-9297-138880498de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:56.689147 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678016d-bd15-4bd1-9297-138880498de2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:56.689820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678016d-bd15-4bd1-9297-138880498de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:56.689820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1678016d-bd15-4bd1-9297-138880498de2 admin admin] PATH_INFO: `/v3/users/6809c29bee4041c393e6773643c63c2d` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:56.691122 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678016d-bd15-4bd1-9297-138880498de2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6809c29bee4041c393e6773643c63c2d)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:56.693317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1678016d-bd15-4bd1-9297-138880498de2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:56.958526 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1678016d-bd15-4bd1-9297-138880498de2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6809c29bee4041c393e6773643c63c2d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:54:57.046882 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1678016d-bd15-4bd1-9297-138880498de2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6809c29bee4041c393e6773643c63c2d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:54:57.059373 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1678016d-bd15-4bd1-9297-138880498de2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6809c29bee4041c393e6773643c63c2d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:54:57.060739 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1678016d-bd15-4bd1-9297-138880498de2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6809c29bee4041c393e6773643c63c2d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:54:57.084236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1678016d-bd15-4bd1-9297-138880498de2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6809c29bee4041c393e6773643c63c2d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:54:57.097047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1124/2238] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:54:56 2022] DELETE /identity/v3/users/6809c29bee4041c393e6773643c63c2d => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:54:57.440491 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c41bc-945e-4906-8cee-8284378ed046 service swift] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:57.451642 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8c41bc-945e-4906-8cee-8284378ed046 service swift] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:57.510749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffdba9-1c46-4592-8000-5abfe8e15bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:57.511660 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffdba9-1c46-4592-8000-5abfe8e15bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:57.511946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffdba9-1c46-4592-8000-5abfe8e15bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:57.512223 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffdba9-1c46-4592-8000-5abfe8e15bc5 admin admin] PATH_INFO: `/v3/projects/99ae4bdba9404be09aafe72858de5a18` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:57.513644 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffdba9-1c46-4592-8000-5abfe8e15bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99ae4bdba9404be09aafe72858de5a18)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:57.517077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffdba9-1c46-4592-8000-5abfe8e15bc5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:57.767275 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c2ffdba9-1c46-4592-8000-5abfe8e15bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99ae4bdba9404be09aafe72858de5a18', 'request_id': 'req-c2ffdba9-1c46-4592-8000-5abfe8e15bc5'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:54:57.772960 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c2ffdba9-1c46-4592-8000-5abfe8e15bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99ae4bdba9404be09aafe72858de5a18', 'request_id': 'req-c2ffdba9-1c46-4592-8000-5abfe8e15bc5'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:54:57.779200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c2ffdba9-1c46-4592-8000-5abfe8e15bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99ae4bdba9404be09aafe72858de5a18', 'request_id': 'req-c2ffdba9-1c46-4592-8000-5abfe8e15bc5'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:54:57.921200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c2ffdba9-1c46-4592-8000-5abfe8e15bc5 admin admin] The token cache is being invalidate because project 99ae4bdba9404be09aafe72858de5a18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:54:57.921925 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c2ffdba9-1c46-4592-8000-5abfe8e15bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:54:57.922864 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c2ffdba9-1c46-4592-8000-5abfe8e15bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:54:57.924999 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1115/2239] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:54:57 2022] DELETE /identity/v3/projects/99ae4bdba9404be09aafe72858de5a18 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:54:57.932217 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832db78a-9504-4273-baee-7802889a6593 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:57.932741 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832db78a-9504-4273-baee-7802889a6593 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:57.935278 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832db78a-9504-4273-baee-7802889a6593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:57.956569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-832db78a-9504-4273-baee-7802889a6593 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:54:57.958098 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-832db78a-9504-4273-baee-7802889a6593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:58.031964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1125/2240] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:54:58.040483 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5927230-a4a4-4173-b6f6-372a637759f9 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:58.040772 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5927230-a4a4-4173-b6f6-372a637759f9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:58.041095 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5927230-a4a4-4173-b6f6-372a637759f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:58.062517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d5927230-a4a4-4173-b6f6-372a637759f9 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:54:58.063917 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d5927230-a4a4-4173-b6f6-372a637759f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:58.072463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1116/2241] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:54:58.076721 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832db78a-9504-4273-baee-7802889a6593 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:58.089351 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832db78a-9504-4273-baee-7802889a6593 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:58.097464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b142f89-4b55-479a-9827-0dff478d09e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:58.098140 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b142f89-4b55-479a-9827-0dff478d09e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:58.098455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b142f89-4b55-479a-9827-0dff478d09e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:58.098706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b142f89-4b55-479a-9827-0dff478d09e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:58.099467 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b142f89-4b55-479a-9827-0dff478d09e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:54:58.099770 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b142f89-4b55-479a-9827-0dff478d09e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:58.101757 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b142f89-4b55-479a-9827-0dff478d09e7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:58.111685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:58.115113 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1126/2242] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:54:58.119521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5927230-a4a4-4173-b6f6-372a637759f9 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:58.130123 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5927230-a4a4-4173-b6f6-372a637759f9 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:58.135632 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f73da0-d253-483e-96bc-b7b0fd7fcd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:58.136330 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f73da0-d253-483e-96bc-b7b0fd7fcd55 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:58.136615 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f73da0-d253-483e-96bc-b7b0fd7fcd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:58.136888 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f73da0-d253-483e-96bc-b7b0fd7fcd55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:58.137691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f73da0-d253-483e-96bc-b7b0fd7fcd55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:58.139600 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f73da0-d253-483e-96bc-b7b0fd7fcd55 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:58.254073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1117/2243] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:54:58 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:54:58.258246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b142f89-4b55-479a-9827-0dff478d09e7 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:58.269659 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b142f89-4b55-479a-9827-0dff478d09e7 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:58.335086 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d8392-619d-44eb-bbad-b7caedc97287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:58.335846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d8392-619d-44eb-bbad-b7caedc97287 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:58.336051 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d8392-619d-44eb-bbad-b7caedc97287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:58.336328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305d8392-619d-44eb-bbad-b7caedc97287 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:58.337103 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d8392-619d-44eb-bbad-b7caedc97287 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:58.339026 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305d8392-619d-44eb-bbad-b7caedc97287 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:58.442041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1127/2244] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:54:58 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:54:58.445973 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f73da0-d253-483e-96bc-b7b0fd7fcd55 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:58.456505 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f73da0-d253-483e-96bc-b7b0fd7fcd55 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:58.462122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b83a8-2ab8-43f9-91a7-2aac784d0052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:58.462798 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b83a8-2ab8-43f9-91a7-2aac784d0052 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:58.463086 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b83a8-2ab8-43f9-91a7-2aac784d0052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:58.463366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b83a8-2ab8-43f9-91a7-2aac784d0052 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:58.464099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b83a8-2ab8-43f9-91a7-2aac784d0052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:58.465744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b83a8-2ab8-43f9-91a7-2aac784d0052 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:58.476618 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1118/2245] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:54:58.480863 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d8392-619d-44eb-bbad-b7caedc97287 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:58.492416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305d8392-619d-44eb-bbad-b7caedc97287 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:58.497153 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd89de4-95f8-4759-bb7d-f1510acb3599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:58.497843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd89de4-95f8-4759-bb7d-f1510acb3599 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:58.498131 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd89de4-95f8-4759-bb7d-f1510acb3599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:58.498412 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd89de4-95f8-4759-bb7d-f1510acb3599 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:58.499897 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd89de4-95f8-4759-bb7d-f1510acb3599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:58.501539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd89de4-95f8-4759-bb7d-f1510acb3599 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:58.513094 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1128/2246] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:54:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:54:58.517405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b83a8-2ab8-43f9-91a7-2aac784d0052 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:58.527746 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b83a8-2ab8-43f9-91a7-2aac784d0052 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:58.532756 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff143704-e562-4c0d-8bd6-aa908a1efcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:58.533695 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff143704-e562-4c0d-8bd6-aa908a1efcf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:58.533981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff143704-e562-4c0d-8bd6-aa908a1efcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:58.534258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff143704-e562-4c0d-8bd6-aa908a1efcf4 admin admin] PATH_INFO: `/v3/projects/fbde8a43b24043e1bbab860fcbe67c91/users/71a82de7d125480a9f23c8cdf0c05638/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:58.550126 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff143704-e562-4c0d-8bd6-aa908a1efcf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbde8a43b24043e1bbab860fcbe67c91, user_id=71a82de7d125480a9f23c8cdf0c05638, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:58.552793 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff143704-e562-4c0d-8bd6-aa908a1efcf4 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:58.681181 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1119/2247] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:54:58 2022] PUT /identity/v3/projects/fbde8a43b24043e1bbab860fcbe67c91/users/71a82de7d125480a9f23c8cdf0c05638/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:54:58.686112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d4085-c082-4987-9157-aa85b4da929f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:58.686407 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d4085-c082-4987-9157-aa85b4da929f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:58.687207 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d4085-c082-4987-9157-aa85b4da929f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:58.705594 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-860d4085-c082-4987-9157-aa85b4da929f None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:54:58.706810 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-860d4085-c082-4987-9157-aa85b4da929f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:58.768661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1129/2248] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:54:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:54:58.778506 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff143704-e562-4c0d-8bd6-aa908a1efcf4 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:54:58.780239 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ff143704-e562-4c0d-8bd6-aa908a1efcf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:54:58.794896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:54:58.838789 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff143704-e562-4c0d-8bd6-aa908a1efcf4 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:54:58.842455 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241b707a-5d81-4693-bbdd-8a7e6a870f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:54:58.843353 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b707a-5d81-4693-bbdd-8a7e6a870f75 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:54:58.843668 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b707a-5d81-4693-bbdd-8a7e6a870f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:54:58.843955 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241b707a-5d81-4693-bbdd-8a7e6a870f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:54:58.853094 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b707a-5d81-4693-bbdd-8a7e6a870f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:54:58.854543 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241b707a-5d81-4693-bbdd-8a7e6a870f75 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:54:58.864602 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1120/2249] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:54:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:55:01.338218 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d4085-c082-4987-9157-aa85b4da929f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:01.339674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-860d4085-c082-4987-9157-aa85b4da929f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:01.362883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d4085-c082-4987-9157-aa85b4da929f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:01.367197 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988644c-14e5-4952-acda-e30b39271882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:01.367995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988644c-14e5-4952-acda-e30b39271882 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:01.368383 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988644c-14e5-4952-acda-e30b39271882 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:01.369051 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988644c-14e5-4952-acda-e30b39271882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:01.371054 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f988644c-14e5-4952-acda-e30b39271882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:01.490643 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988644c-14e5-4952-acda-e30b39271882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:01.492117 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988644c-14e5-4952-acda-e30b39271882 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:01.507427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1130/2250] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:55:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:55:06.041686 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ca6bb-36bc-4e30-abe3-d4a4c6ae64e9 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:06.042275 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ca6bb-36bc-4e30-abe3-d4a4c6ae64e9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:06.042275 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464ca6bb-36bc-4e30-abe3-d4a4c6ae64e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:06.073844 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-464ca6bb-36bc-4e30-abe3-d4a4c6ae64e9 None None] MFA Rules not processed for user `71a82de7d125480a9f23c8cdf0c05638`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:55:06.075596 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-464ca6bb-36bc-4e30-abe3-d4a4c6ae64e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:06.154889 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1121/2251] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:55:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:55:06.156995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988644c-14e5-4952-acda-e30b39271882 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:06.174274 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988644c-14e5-4952-acda-e30b39271882 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:06.178986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35554748-312d-4cb1-af39-f7a73b1be5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:06.179705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35554748-312d-4cb1-af39-f7a73b1be5fa admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:06.179981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35554748-312d-4cb1-af39-f7a73b1be5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:06.180300 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35554748-312d-4cb1-af39-f7a73b1be5fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:06.181076 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35554748-312d-4cb1-af39-f7a73b1be5fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:06.183030 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35554748-312d-4cb1-af39-f7a73b1be5fa admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:06.193727 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:06.301806 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1131/2252] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:55:06 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:55:06.303264 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ca6bb-36bc-4e30-abe3-d4a4c6ae64e9 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:06.314717 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464ca6bb-36bc-4e30-abe3-d4a4c6ae64e9 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:06.377193 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe6317-0c11-40f0-81e6-db9889b64539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:06.377857 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe6317-0c11-40f0-81e6-db9889b64539 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:06.378145 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe6317-0c11-40f0-81e6-db9889b64539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:06.378421 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe6317-0c11-40f0-81e6-db9889b64539 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:06.379118 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe6317-0c11-40f0-81e6-db9889b64539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:06.381096 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe6317-0c11-40f0-81e6-db9889b64539 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:06.551000 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1122/2253] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:55:06 2022] POST /identity/v3/users => generated 298 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:55:06.552368 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35554748-312d-4cb1-af39-f7a73b1be5fa admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:06.564540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35554748-312d-4cb1-af39-f7a73b1be5fa admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:06.569847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4084560-82a9-4703-8016-b026bbcdf974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:06.570806 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4084560-82a9-4703-8016-b026bbcdf974 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:06.571202 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4084560-82a9-4703-8016-b026bbcdf974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:06.571582 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4084560-82a9-4703-8016-b026bbcdf974 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:06.572426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4084560-82a9-4703-8016-b026bbcdf974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:06.574252 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4084560-82a9-4703-8016-b026bbcdf974 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:06.588134 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1132/2254] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:55:06.590855 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe6317-0c11-40f0-81e6-db9889b64539 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:06.602430 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe6317-0c11-40f0-81e6-db9889b64539 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:06.608154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861befc-827a-4420-9b88-2c944786a187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:06.609365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861befc-827a-4420-9b88-2c944786a187 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:06.609751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861befc-827a-4420-9b88-2c944786a187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:06.609984 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861befc-827a-4420-9b88-2c944786a187 admin admin] PATH_INFO: `/v3/projects/2a9b96ed7b8b4c11a0c42e1864ca216d/users/3dec46bbe583454c8f730f992de50d78/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:06.627395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861befc-827a-4420-9b88-2c944786a187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9b96ed7b8b4c11a0c42e1864ca216d, user_id=3dec46bbe583454c8f730f992de50d78, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:06.630244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861befc-827a-4420-9b88-2c944786a187 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:06.726140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1123/2255] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:55:06 2022] PUT /identity/v3/projects/2a9b96ed7b8b4c11a0c42e1864ca216d/users/3dec46bbe583454c8f730f992de50d78/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:55:06.730523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4084560-82a9-4703-8016-b026bbcdf974 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:06.742207 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4084560-82a9-4703-8016-b026bbcdf974 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:06.808593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4345014b-a713-45be-ad98-54988241e161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:06.809308 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345014b-a713-45be-ad98-54988241e161 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:06.809599 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345014b-a713-45be-ad98-54988241e161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:06.809880 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4345014b-a713-45be-ad98-54988241e161 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:06.810639 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345014b-a713-45be-ad98-54988241e161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:06.813442 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4345014b-a713-45be-ad98-54988241e161 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:06.823546 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1133/2256] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:55:06 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:55:06.828347 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861befc-827a-4420-9b88-2c944786a187 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:06.839864 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861befc-827a-4420-9b88-2c944786a187 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:06.845699 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8338e-66e9-48ae-b12c-48ff072e5c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:06.846607 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8338e-66e9-48ae-b12c-48ff072e5c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:06.846893 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8338e-66e9-48ae-b12c-48ff072e5c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:06.847172 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8338e-66e9-48ae-b12c-48ff072e5c2d admin admin] PATH_INFO: `/v3/projects/2a9b96ed7b8b4c11a0c42e1864ca216d/users/3dec46bbe583454c8f730f992de50d78/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:06.849240 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8338e-66e9-48ae-b12c-48ff072e5c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9b96ed7b8b4c11a0c42e1864ca216d, user_id=3dec46bbe583454c8f730f992de50d78, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:06.851966 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8338e-66e9-48ae-b12c-48ff072e5c2d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:06.859467 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:06.864270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1124/2257] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:55:06 2022] PUT /identity/v3/projects/2a9b96ed7b8b4c11a0c42e1864ca216d/users/3dec46bbe583454c8f730f992de50d78/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:55:12.352171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c89136-b7f1-4999-9d67-b8bf776ce905 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:12.352692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c89136-b7f1-4999-9d67-b8bf776ce905 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:12.352969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c89136-b7f1-4999-9d67-b8bf776ce905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:12.383003 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b6c89136-b7f1-4999-9d67-b8bf776ce905 None None] MFA Rules not processed for user `ff65e481807b4344897b1499cd450f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:55:12.387758 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b6c89136-b7f1-4999-9d67-b8bf776ce905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:12.474287 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1134/2258] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 16:55:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:55:12.490820 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8338e-66e9-48ae-b12c-48ff072e5c2d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:12.492802 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8ca8338e-66e9-48ae-b12c-48ff072e5c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:12.589430 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8338e-66e9-48ae-b12c-48ff072e5c2d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:12.596716 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e0fc8-cd3a-40cb-a7f6-223cea4bbba1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bc0fa34b414328a342d685bc1eaca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:12.598581 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e0fc8-cd3a-40cb-a7f6-223cea4bbba1 service swift] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:12.599003 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e0fc8-cd3a-40cb-a7f6-223cea4bbba1 service swift] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:12.599354 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e0fc8-cd3a-40cb-a7f6-223cea4bbba1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:12.613295 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e0fc8-cd3a-40cb-a7f6-223cea4bbba1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:12.615722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e0fc8-cd3a-40cb-a7f6-223cea4bbba1 service swift] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:12.631052 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1125/2259] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 16:55:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:55:14.388576 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07843ae8-376a-4b05-9a7c-73575bb16058 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:14.389183 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07843ae8-376a-4b05-9a7c-73575bb16058 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:14.389540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07843ae8-376a-4b05-9a7c-73575bb16058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:14.429937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-07843ae8-376a-4b05-9a7c-73575bb16058 None None] MFA Rules not processed for user `3dec46bbe583454c8f730f992de50d78`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:55:14.431422 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-07843ae8-376a-4b05-9a7c-73575bb16058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:14.588626 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1135/2260] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:55:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:55:14.617891 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e0fc8-cd3a-40cb-a7f6-223cea4bbba1 service swift] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:14.619935 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3a4e0fc8-cd3a-40cb-a7f6-223cea4bbba1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:14.704470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e0fc8-cd3a-40cb-a7f6-223cea4bbba1 service swift] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:14.715672 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068076f-3537-4f59-8ae5-b6e3a2bb55f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e1900754214020931b202e98f660a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:14.716576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068076f-3537-4f59-8ae5-b6e3a2bb55f8 service glance] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:14.716993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068076f-3537-4f59-8ae5-b6e3a2bb55f8 service glance] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:14.729650 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a068076f-3537-4f59-8ae5-b6e3a2bb55f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:14.881254 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068076f-3537-4f59-8ae5-b6e3a2bb55f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:14.882948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a068076f-3537-4f59-8ae5-b6e3a2bb55f8 service glance] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:14.895939 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1126/2261] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:55:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:55:15.206582 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5ed08-226d-4a15-85ca-704c152c759f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:15.206885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5ed08-226d-4a15-85ca-704c152c759f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:15.207194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab5ed08-226d-4a15-85ca-704c152c759f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:15.222899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:15.229728 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9ab5ed08-226d-4a15-85ca-704c152c759f None None] MFA Rules not processed for user `ff65e481807b4344897b1499cd450f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:55:15.230948 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9ab5ed08-226d-4a15-85ca-704c152c759f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:15.247907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1136/2262] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 16:55:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:55:15.259804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068076f-3537-4f59-8ae5-b6e3a2bb55f8 service glance] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:15.275305 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a068076f-3537-4f59-8ae5-b6e3a2bb55f8 service glance] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:15.283651 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c0434-5d6f-4367-8548-39d1ec105377 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bc0fa34b414328a342d685bc1eaca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:15.284554 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c0434-5d6f-4367-8548-39d1ec105377 service swift] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:15.285047 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c0434-5d6f-4367-8548-39d1ec105377 service swift] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:15.285323 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c0434-5d6f-4367-8548-39d1ec105377 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:15.298174 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c0434-5d6f-4367-8548-39d1ec105377 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:15.299956 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c0434-5d6f-4367-8548-39d1ec105377 service swift] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:15.311180 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1127/2263] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 16:55:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 16:55:16.734616 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5ed08-226d-4a15-85ca-704c152c759f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:16.840416 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab5ed08-226d-4a15-85ca-704c152c759f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:16.851035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de8f63-caed-4993-97b7-5c37808165ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:16.851827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de8f63-caed-4993-97b7-5c37808165ef service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:16.852407 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de8f63-caed-4993-97b7-5c37808165ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:16.852771 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de8f63-caed-4993-97b7-5c37808165ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:16.854879 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-43de8f63-caed-4993-97b7-5c37808165ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:16.974989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de8f63-caed-4993-97b7-5c37808165ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:16.976874 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de8f63-caed-4993-97b7-5c37808165ef service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:16.991754 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1137/2264] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:55:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:55:25.194586 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca2d73-20e4-4c2b-a780-8ce74c301ddd None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:25.195031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca2d73-20e4-4c2b-a780-8ce74c301ddd None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:25.195198 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca2d73-20e4-4c2b-a780-8ce74c301ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:25.221665 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-71ca2d73-20e4-4c2b-a780-8ce74c301ddd None None] MFA Rules not processed for user `0cf277a2d03443c8af7a7bee2731d9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:55:25.223883 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-71ca2d73-20e4-4c2b-a780-8ce74c301ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:25.265898 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:25.328114 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1128/2265] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:55:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:55:26.986683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=50 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:31.806063 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d677b93-4875-4c0c-a812-2679f6396d80 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:31.806063 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d677b93-4875-4c0c-a812-2679f6396d80 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:31.806823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d677b93-4875-4c0c-a812-2679f6396d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:31.825128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8d677b93-4875-4c0c-a812-2679f6396d80 None None] MFA Rules not processed for user `71a82de7d125480a9f23c8cdf0c05638`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:55:31.826372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8d677b93-4875-4c0c-a812-2679f6396d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:31.838086 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1138/2266] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:55:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:55:34.641544 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1f160-86da-44bd-aa81-daed399bf8bd None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:34.642126 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1f160-86da-44bd-aa81-daed399bf8bd None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:34.642126 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1f160-86da-44bd-aa81-daed399bf8bd None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:34.643526 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1129/2267] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 16:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 18 16:55:34.650156 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7a0ba-d3e5-4b11-8cab-9843076c883f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:34.650992 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7a0ba-d3e5-4b11-8cab-9843076c883f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:34.650992 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7a0ba-d3e5-4b11-8cab-9843076c883f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:34.671878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-68c7a0ba-d3e5-4b11-8cab-9843076c883f None None] MFA Rules not processed for user `381cf4381ce64379b285d75e2909813d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:55:34.673233 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-68c7a0ba-d3e5-4b11-8cab-9843076c883f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:34.755501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1139/2268] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 16:55:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:55:34.768089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1f160-86da-44bd-aa81-daed399bf8bd None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:34.771746 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a7d1f160-86da-44bd-aa81-daed399bf8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:34.805346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1f160-86da-44bd-aa81-daed399bf8bd None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:34.809301 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d524e84-5d53-445d-a34c-933825d8b208 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e1900754214020931b202e98f660a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:34.810082 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d524e84-5d53-445d-a34c-933825d8b208 service glance] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:34.810439 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d524e84-5d53-445d-a34c-933825d8b208 service glance] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:34.810942 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d524e84-5d53-445d-a34c-933825d8b208 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:34.823169 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d524e84-5d53-445d-a34c-933825d8b208 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:34.824855 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d524e84-5d53-445d-a34c-933825d8b208 service glance] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:34.838915 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1130/2269] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:55:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:55:35.087241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc63167-b7a0-405f-90ca-c9c687ee5573 None None] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:35.087241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc63167-b7a0-405f-90ca-c9c687ee5573 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:35.087241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc63167-b7a0-405f-90ca-c9c687ee5573 None None] PATH_INFO: `/` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:35.087241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1140/2270] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 16:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:55:35.090621 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2242a-0f8d-4cdb-8b17-f0d10ec65e54 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:35.090994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2242a-0f8d-4cdb-8b17-f0d10ec65e54 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:35.091372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2242a-0f8d-4cdb-8b17-f0d10ec65e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:35.112771 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d3f2242a-0f8d-4cdb-8b17-f0d10ec65e54 None None] MFA Rules not processed for user `e9dcca05df70446090cd525c0644cfc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:55:35.114712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d3f2242a-0f8d-4cdb-8b17-f0d10ec65e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:35.127566 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1131/2271] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 16:55:35 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:55:35.144274 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc63167-b7a0-405f-90ca-c9c687ee5573 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:35.178147 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc63167-b7a0-405f-90ca-c9c687ee5573 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:35.190464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c5c3a3-e42d-4d9e-b233-966fa63f9664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:35.190464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5c3a3-e42d-4d9e-b233-966fa63f9664 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:35.190464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5c3a3-e42d-4d9e-b233-966fa63f9664 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:35.190464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c5c3a3-e42d-4d9e-b233-966fa63f9664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:35.208499 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5c3a3-e42d-4d9e-b233-966fa63f9664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:35.210080 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c5c3a3-e42d-4d9e-b233-966fa63f9664 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:35.221756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1141/2272] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:55:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:55:35.352670 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d940352-7ade-49f3-ac86-7bf0079080f0 None None] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:35.352992 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d940352-7ade-49f3-ac86-7bf0079080f0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:35.353300 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d940352-7ade-49f3-ac86-7bf0079080f0 None None] PATH_INFO: `/` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:35.354887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1132/2273] 10.222.0.76 () {54 vars in 921 bytes} [Mon Jul 18 16:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 18 16:55:35.362088 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab2dad-58c8-4e46-8564-0ee42bec34ce None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:35.362495 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab2dad-58c8-4e46-8564-0ee42bec34ce None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:35.362786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab2dad-58c8-4e46-8564-0ee42bec34ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:35.389938 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3dab2dad-58c8-4e46-8564-0ee42bec34ce None None] MFA Rules not processed for user `381cf4381ce64379b285d75e2909813d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:55:35.389938 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3dab2dad-58c8-4e46-8564-0ee42bec34ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:35.396636 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1142/2274] 10.222.0.76 () {58 vars in 1018 bytes} [Mon Jul 18 16:55:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:55:35.408070 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d940352-7ade-49f3-ac86-7bf0079080f0 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:35.421420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d940352-7ade-49f3-ac86-7bf0079080f0 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:35.427716 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a0ce8-d914-404c-8461-b184aba2f83b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:35.428385 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a0ce8-d914-404c-8461-b184aba2f83b service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:35.428676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a0ce8-d914-404c-8461-b184aba2f83b service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:35.428957 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a0ce8-d914-404c-8461-b184aba2f83b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:35.443795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a0ce8-d914-404c-8461-b184aba2f83b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:35.443795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a0ce8-d914-404c-8461-b184aba2f83b service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:35.456261 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1133/2275] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:55:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:55:36.114918 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d70dc-8f46-4900-b58a-8822f206b322 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:36.115452 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d70dc-8f46-4900-b58a-8822f206b322 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:36.115538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d70dc-8f46-4900-b58a-8822f206b322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:36.135603 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f37d70dc-8f46-4900-b58a-8822f206b322 None None] MFA Rules not processed for user `ff65e481807b4344897b1499cd450f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:55:36.137347 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f37d70dc-8f46-4900-b58a-8822f206b322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:55:36.146869 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1143/2276] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 16:55:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:55:36.175952 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a0ce8-d914-404c-8461-b184aba2f83b service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:55:36.189487 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a0ce8-d914-404c-8461-b184aba2f83b service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:55:36.195878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486c131-7a28-4e02-8a75-b8b5f71efe18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bc0fa34b414328a342d685bc1eaca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:55:36.196923 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486c131-7a28-4e02-8a75-b8b5f71efe18 service swift] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:55:36.197445 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486c131-7a28-4e02-8a75-b8b5f71efe18 service swift] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:55:36.198024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486c131-7a28-4e02-8a75-b8b5f71efe18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:55:36.208815 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486c131-7a28-4e02-8a75-b8b5f71efe18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:55:36.210541 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f486c131-7a28-4e02-8a75-b8b5f71efe18 service swift] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:55:36.221584 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1134/2277] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 16:55:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:55:46.129755 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=46 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:55:46.216519 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=33 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:03.389130 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001be91-7606-4803-98df-29dc514e0410 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:03.390422 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001be91-7606-4803-98df-29dc514e0410 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:03.391259 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001be91-7606-4803-98df-29dc514e0410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:03.416496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8001be91-7606-4803-98df-29dc514e0410 None None] MFA Rules not processed for user `ff65e481807b4344897b1499cd450f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:56:03.416496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8001be91-7606-4803-98df-29dc514e0410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:03.437803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1144/2278] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 16:56:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:56:03.439193 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486c131-7a28-4e02-8a75-b8b5f71efe18 service swift] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:56:03.454949 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f486c131-7a28-4e02-8a75-b8b5f71efe18 service swift] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:56:03.461817 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f8bfe-7209-4b34-af37-48df3158bc46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bc0fa34b414328a342d685bc1eaca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:56:03.474457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f8bfe-7209-4b34-af37-48df3158bc46 service swift] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:03.475093 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f8bfe-7209-4b34-af37-48df3158bc46 service swift] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:03.475763 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312f8bfe-7209-4b34-af37-48df3158bc46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:03.496137 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f8bfe-7209-4b34-af37-48df3158bc46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:56:03.498180 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312f8bfe-7209-4b34-af37-48df3158bc46 service swift] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:56:03.514136 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1135/2279] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 16:56:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 16:56:10.628466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001be91-7606-4803-98df-29dc514e0410 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:56:10.638421 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001be91-7606-4803-98df-29dc514e0410 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:56:10.642665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7ef22-29cc-4beb-b7db-e56bc531fc88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:56:10.643484 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7ef22-29cc-4beb-b7db-e56bc531fc88 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:10.643772 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7ef22-29cc-4beb-b7db-e56bc531fc88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:10.644054 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd7ef22-29cc-4beb-b7db-e56bc531fc88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:10.645920 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8fd7ef22-29cc-4beb-b7db-e56bc531fc88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:10.661957 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7ef22-29cc-4beb-b7db-e56bc531fc88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:56:10.663428 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd7ef22-29cc-4beb-b7db-e56bc531fc88 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:56:10.675898 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1145/2280] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:56:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:56:13.507040 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=6 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:14.361693 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f8bfe-7209-4b34-af37-48df3158bc46 service swift] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:56:14.371339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312f8bfe-7209-4b34-af37-48df3158bc46 service swift] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:56:14.375760 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ead7bb-8122-4851-85b5-c5b1574a7ac9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:56:14.376437 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ead7bb-8122-4851-85b5-c5b1574a7ac9 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:14.376732 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ead7bb-8122-4851-85b5-c5b1574a7ac9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:14.377041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ead7bb-8122-4851-85b5-c5b1574a7ac9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:14.378867 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-10ead7bb-8122-4851-85b5-c5b1574a7ac9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:14.393744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ead7bb-8122-4851-85b5-c5b1574a7ac9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:56:14.395231 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ead7bb-8122-4851-85b5-c5b1574a7ac9 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:56:14.408381 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1136/2281] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:56:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:56:20.670807 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=9 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:24.402490 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=6 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:27.379890 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7ef22-29cc-4beb-b7db-e56bc531fc88 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:56:27.381331 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8fd7ef22-29cc-4beb-b7db-e56bc531fc88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:27.395668 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd7ef22-29cc-4beb-b7db-e56bc531fc88 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:56:27.401106 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b907f7-a1aa-4de6-9679-71fa194467a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:56:27.401745 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b907f7-a1aa-4de6-9679-71fa194467a6 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:27.402029 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b907f7-a1aa-4de6-9679-71fa194467a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:27.402306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b907f7-a1aa-4de6-9679-71fa194467a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:27.404022 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c8b907f7-a1aa-4de6-9679-71fa194467a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:27.464485 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b907f7-a1aa-4de6-9679-71fa194467a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:56:27.466128 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b907f7-a1aa-4de6-9679-71fa194467a6 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:56:27.475568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1146/2282] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:56:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:56:34.093367 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ead7bb-8122-4851-85b5-c5b1574a7ac9 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:56:34.095083 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-10ead7bb-8122-4851-85b5-c5b1574a7ac9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:34.155019 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ead7bb-8122-4851-85b5-c5b1574a7ac9 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:56:34.159004 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84001101-b785-41f4-8175-dabeb64f74fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:56:34.159666 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84001101-b785-41f4-8175-dabeb64f74fb service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:34.159951 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84001101-b785-41f4-8175-dabeb64f74fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:34.160227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84001101-b785-41f4-8175-dabeb64f74fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:34.162044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-84001101-b785-41f4-8175-dabeb64f74fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:34.223689 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84001101-b785-41f4-8175-dabeb64f74fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:56:34.225195 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84001101-b785-41f4-8175-dabeb64f74fb service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:56:34.234350 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1137/2283] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:56:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:56:35.616070 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c29ab8-92ce-443f-8206-a541ba5f3cc6 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:35.616639 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c29ab8-92ce-443f-8206-a541ba5f3cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:35.616639 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c29ab8-92ce-443f-8206-a541ba5f3cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:35.643640 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d4c29ab8-92ce-443f-8206-a541ba5f3cc6 None None] MFA Rules not processed for user `ff65e481807b4344897b1499cd450f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:56:35.644886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d4c29ab8-92ce-443f-8206-a541ba5f3cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:35.652821 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1147/2284] 10.222.0.76 () {58 vars in 967 bytes} [Mon Jul 18 16:56:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:56:35.666499 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84001101-b785-41f4-8175-dabeb64f74fb service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:56:35.695360 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84001101-b785-41f4-8175-dabeb64f74fb service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:56:35.700694 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33eb76-7009-48e7-875b-48ea23b9dafe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bc0fa34b414328a342d685bc1eaca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:56:35.701790 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33eb76-7009-48e7-875b-48ea23b9dafe service swift] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:35.701891 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33eb76-7009-48e7-875b-48ea23b9dafe service swift] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:35.702244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33eb76-7009-48e7-875b-48ea23b9dafe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:35.711553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33eb76-7009-48e7-875b-48ea23b9dafe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:56:35.713223 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33eb76-7009-48e7-875b-48ea23b9dafe service swift] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:56:35.722626 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1138/2285] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 16:56:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 16:56:41.537579 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c29ab8-92ce-443f-8206-a541ba5f3cc6 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:56:41.547238 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c29ab8-92ce-443f-8206-a541ba5f3cc6 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:56:41.551157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffeb3bd-6829-4adc-b1cc-94682ead90b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:56:41.552262 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffeb3bd-6829-4adc-b1cc-94682ead90b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:41.552262 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffeb3bd-6829-4adc-b1cc-94682ead90b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:41.552602 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffeb3bd-6829-4adc-b1cc-94682ead90b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:41.554540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4ffeb3bd-6829-4adc-b1cc-94682ead90b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:41.566889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffeb3bd-6829-4adc-b1cc-94682ead90b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:56:41.568499 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffeb3bd-6829-4adc-b1cc-94682ead90b2 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:56:41.577997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1148/2286] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:56:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:56:45.718356 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=54 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:49.706409 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33eb76-7009-48e7-875b-48ea23b9dafe service swift] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:56:49.716291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33eb76-7009-48e7-875b-48ea23b9dafe service swift] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:56:49.722661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb93ef7-1f9e-42be-834b-16844d377c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:56:49.723333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb93ef7-1f9e-42be-834b-16844d377c6b service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:49.723623 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb93ef7-1f9e-42be-834b-16844d377c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:49.723898 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb93ef7-1f9e-42be-834b-16844d377c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:49.737829 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb93ef7-1f9e-42be-834b-16844d377c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:56:49.739298 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb93ef7-1f9e-42be-834b-16844d377c6b service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:56:49.757525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1139/2287] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:56:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:56:51.574413 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=37 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:56:52.150913 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffeb3bd-6829-4adc-b1cc-94682ead90b2 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:56:52.152399 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4ffeb3bd-6829-4adc-b1cc-94682ead90b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:52.170150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffeb3bd-6829-4adc-b1cc-94682ead90b2 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:56:52.184846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2d8c9-c6a1-44e0-89ac-51f25e68a1ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:56:52.185566 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2d8c9-c6a1-44e0-89ac-51f25e68a1ac service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:56:52.185860 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2d8c9-c6a1-44e0-89ac-51f25e68a1ac service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:56:52.186151 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b2d8c9-c6a1-44e0-89ac-51f25e68a1ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:56:52.188891 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e0b2d8c9-c6a1-44e0-89ac-51f25e68a1ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:56:52.204479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2d8c9-c6a1-44e0-89ac-51f25e68a1ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:56:52.206188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b2d8c9-c6a1-44e0-89ac-51f25e68a1ac service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:56:52.218760 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1149/2288] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:56:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:56:59.745774 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=6 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:02.213263 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=6 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:08.916503 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d24f57-13a6-440a-94fe-1e085b3a068d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:08.917102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d24f57-13a6-440a-94fe-1e085b3a068d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:08.917102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d24f57-13a6-440a-94fe-1e085b3a068d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:08.946235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c2d24f57-13a6-440a-94fe-1e085b3a068d None None] MFA Rules not processed for user `4d27db5cdd9e453dbd93b862db694309`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:57:08.947458 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c2d24f57-13a6-440a-94fe-1e085b3a068d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:08.972542 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1140/2289] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:57:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:57:18.969887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=15 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:57:49.400120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2d8c9-c6a1-44e0-89ac-51f25e68a1ac service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:57:49.449156 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b2d8c9-c6a1-44e0-89ac-51f25e68a1ac service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:57:49.455364 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26273d-15ca-4fcd-84f5-7fc92436b653 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:57:49.455872 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26273d-15ca-4fcd-84f5-7fc92436b653 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:49.456157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26273d-15ca-4fcd-84f5-7fc92436b653 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:49.456438 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26273d-15ca-4fcd-84f5-7fc92436b653 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:49.458288 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6a26273d-15ca-4fcd-84f5-7fc92436b653 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:49.484961 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26273d-15ca-4fcd-84f5-7fc92436b653 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:57:49.486924 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a26273d-15ca-4fcd-84f5-7fc92436b653 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:57:49.500569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1150/2290] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:57:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:57:51.928566 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ab036-5002-4b41-b96f-66e43b63e13c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:51.929112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ab036-5002-4b41-b96f-66e43b63e13c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:51.929405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ab036-5002-4b41-b96f-66e43b63e13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:51.947407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-fc0ab036-5002-4b41-b96f-66e43b63e13c None None] MFA Rules not processed for user `4ad27549c1824d45b1d55653e2c121a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:57:51.948620 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fc0ab036-5002-4b41-b96f-66e43b63e13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:52.007933 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1141/2291] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:57:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:57:52.335945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26273d-15ca-4fcd-84f5-7fc92436b653 service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:57:52.354940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a26273d-15ca-4fcd-84f5-7fc92436b653 service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:57:52.358589 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c54b16-30d2-4355-9451-6e0f0e5bb855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:57:52.359228 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c54b16-30d2-4355-9451-6e0f0e5bb855 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:52.359515 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c54b16-30d2-4355-9451-6e0f0e5bb855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:52.359859 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c54b16-30d2-4355-9451-6e0f0e5bb855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:52.361834 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e8c54b16-30d2-4355-9451-6e0f0e5bb855 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:52.384159 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c54b16-30d2-4355-9451-6e0f0e5bb855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:57:52.385648 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c54b16-30d2-4355-9451-6e0f0e5bb855 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:57:52.393957 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1151/2292] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:57:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:57:54.132424 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ab036-5002-4b41-b96f-66e43b63e13c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:57:54.133935 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fc0ab036-5002-4b41-b96f-66e43b63e13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:54.208841 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ab036-5002-4b41-b96f-66e43b63e13c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:57:54.214367 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba488c-46b3-4b18-9a64-a7dea5a78e38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c8d6afb4ccd41a5972e3241a3eebc7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:57:54.215025 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba488c-46b3-4b18-9a64-a7dea5a78e38 service placement] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:57:54.215306 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba488c-46b3-4b18-9a64-a7dea5a78e38 service placement] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:57:54.215581 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dba488c-46b3-4b18-9a64-a7dea5a78e38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:57:54.217398 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4dba488c-46b3-4b18-9a64-a7dea5a78e38 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:57:54.229933 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba488c-46b3-4b18-9a64-a7dea5a78e38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:57:54.231520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dba488c-46b3-4b18-9a64-a7dea5a78e38 service placement] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:57:54.242778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1142/2293] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:57:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:58:02.390261 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=39 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:04.237699 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=57 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:09.220143 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c54b16-30d2-4355-9451-6e0f0e5bb855 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:58:09.234203 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c54b16-30d2-4355-9451-6e0f0e5bb855 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:58:09.240099 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb3e91-92bd-4214-b94f-f6d053c60b32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:58:09.240797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb3e91-92bd-4214-b94f-f6d053c60b32 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:58:09.241116 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb3e91-92bd-4214-b94f-f6d053c60b32 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:58:09.241398 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb3e91-92bd-4214-b94f-f6d053c60b32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:58:09.243165 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-24cb3e91-92bd-4214-b94f-f6d053c60b32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:58:09.253768 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb3e91-92bd-4214-b94f-f6d053c60b32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:58:09.255357 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb3e91-92bd-4214-b94f-f6d053c60b32 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:58:09.265668 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1152/2294] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:58:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:58:09.653902 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba488c-46b3-4b18-9a64-a7dea5a78e38 service placement] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:58:09.666735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dba488c-46b3-4b18-9a64-a7dea5a78e38 service placement] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:58:09.673362 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60526228-150e-4595-8af3-5a413c7f2bfb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:58:09.674303 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60526228-150e-4595-8af3-5a413c7f2bfb service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:58:09.674590 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60526228-150e-4595-8af3-5a413c7f2bfb service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:58:09.674870 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60526228-150e-4595-8af3-5a413c7f2bfb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:58:09.676762 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-60526228-150e-4595-8af3-5a413c7f2bfb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:58:09.768419 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60526228-150e-4595-8af3-5a413c7f2bfb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:58:09.771601 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60526228-150e-4595-8af3-5a413c7f2bfb service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:58:09.781787 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1143/2295] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:58:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:58:11.058348 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1907a4-a168-4bc8-8875-aced6617e324 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:58:11.058928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1907a4-a168-4bc8-8875-aced6617e324 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:58:11.058928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1907a4-a168-4bc8-8875-aced6617e324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:58:11.079695 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1f1907a4-a168-4bc8-8875-aced6617e324 None None] MFA Rules not processed for user `9faf38f2ccec4b60a3612648073d06d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:58:11.081418 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1f1907a4-a168-4bc8-8875-aced6617e324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:58:11.089182 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1153/2296] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:58:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:58:11.274212 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60526228-150e-4595-8af3-5a413c7f2bfb service nova] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:58:11.286879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60526228-150e-4595-8af3-5a413c7f2bfb service nova] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:58:11.295788 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a25fe1a-3cb0-4a7e-bb30-358a6e9ceef5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:58:11.299066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25fe1a-3cb0-4a7e-bb30-358a6e9ceef5 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:58:11.299066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25fe1a-3cb0-4a7e-bb30-358a6e9ceef5 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:58:11.299066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a25fe1a-3cb0-4a7e-bb30-358a6e9ceef5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:58:11.299066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2a25fe1a-3cb0-4a7e-bb30-358a6e9ceef5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:58:11.316057 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a25fe1a-3cb0-4a7e-bb30-358a6e9ceef5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:58:11.318006 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a25fe1a-3cb0-4a7e-bb30-358a6e9ceef5 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:58:11.332407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1144/2297] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:58:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:58:11.451360 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1907a4-a168-4bc8-8875-aced6617e324 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:58:11.462080 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1907a4-a168-4bc8-8875-aced6617e324 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:58:11.465907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16a6f0-27d1-4a0d-b996-b2a7391436d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:58:11.466575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16a6f0-27d1-4a0d-b996-b2a7391436d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:58:11.466864 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16a6f0-27d1-4a0d-b996-b2a7391436d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:58:11.467147 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16a6f0-27d1-4a0d-b996-b2a7391436d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:58:11.468978 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4d16a6f0-27d1-4a0d-b996-b2a7391436d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:58:11.479863 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16a6f0-27d1-4a0d-b996-b2a7391436d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:58:11.481320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16a6f0-27d1-4a0d-b996-b2a7391436d1 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:58:11.489693 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1154/2298] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:58:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:58:21.325398 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=34 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:21.485780 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=15 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:58:38.292692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698e965-f0b8-41e1-866d-9bc10844c6cd None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:58:38.293207 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698e965-f0b8-41e1-866d-9bc10844c6cd None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:58:38.293324 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698e965-f0b8-41e1-866d-9bc10844c6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:58:38.310895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-4698e965-f0b8-41e1-866d-9bc10844c6cd None None] MFA Rules not processed for user `0cf277a2d03443c8af7a7bee2731d9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:58:38.312337 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4698e965-f0b8-41e1-866d-9bc10844c6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:58:38.319982 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1145/2299] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:58:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:58:48.306061 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:00.204569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16a6f0-27d1-4a0d-b996-b2a7391436d1 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:00.215345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16a6f0-27d1-4a0d-b996-b2a7391436d1 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:00.218749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d03ba-3141-4222-a876-465b2f7f83b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:00.219485 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d03ba-3141-4222-a876-465b2f7f83b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:00.219847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d03ba-3141-4222-a876-465b2f7f83b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:00.220339 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d03ba-3141-4222-a876-465b2f7f83b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:00.222187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0d1d03ba-3141-4222-a876-465b2f7f83b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:00.325797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d03ba-3141-4222-a876-465b2f7f83b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:00.327696 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d03ba-3141-4222-a876-465b2f7f83b2 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:00.350468 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1155/2300] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:59:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:59:05.062848 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698e965-f0b8-41e1-866d-9bc10844c6cd None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:05.064516 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4698e965-f0b8-41e1-866d-9bc10844c6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:05.109892 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698e965-f0b8-41e1-866d-9bc10844c6cd None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:05.115947 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da7670-06f4-47fc-b7ed-925ae287ea14 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c8d6afb4ccd41a5972e3241a3eebc7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:05.116602 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da7670-06f4-47fc-b7ed-925ae287ea14 service placement] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:05.116886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da7670-06f4-47fc-b7ed-925ae287ea14 service placement] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:05.117210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da7670-06f4-47fc-b7ed-925ae287ea14 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:05.119022 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-54da7670-06f4-47fc-b7ed-925ae287ea14 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:05.134515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da7670-06f4-47fc-b7ed-925ae287ea14 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:05.136157 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da7670-06f4-47fc-b7ed-925ae287ea14 service placement] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:05.147040 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1146/2301] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:59:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 16:59:05.221338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d03ba-3141-4222-a876-465b2f7f83b2 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:05.223051 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0d1d03ba-3141-4222-a876-465b2f7f83b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:05.236124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d03ba-3141-4222-a876-465b2f7f83b2 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:05.241959 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab80e46-98b0-46af-8af2-6d5304d8de90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:05.242835 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab80e46-98b0-46af-8af2-6d5304d8de90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:05.243120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab80e46-98b0-46af-8af2-6d5304d8de90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:05.243400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab80e46-98b0-46af-8af2-6d5304d8de90 admin admin] PATH_INFO: `/v3/users/4d27db5cdd9e453dbd93b862db694309` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:05.244618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab80e46-98b0-46af-8af2-6d5304d8de90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d27db5cdd9e453dbd93b862db694309)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:05.246699 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab80e46-98b0-46af-8af2-6d5304d8de90 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:05.469762 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2ab80e46-98b0-46af-8af2-6d5304d8de90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d27db5cdd9e453dbd93b862db694309'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:05.557549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2ab80e46-98b0-46af-8af2-6d5304d8de90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d27db5cdd9e453dbd93b862db694309'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:05.566478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2ab80e46-98b0-46af-8af2-6d5304d8de90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d27db5cdd9e453dbd93b862db694309'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:05.567318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2ab80e46-98b0-46af-8af2-6d5304d8de90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d27db5cdd9e453dbd93b862db694309'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:05.580115 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2ab80e46-98b0-46af-8af2-6d5304d8de90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d27db5cdd9e453dbd93b862db694309'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:05.586424 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1156/2302] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:59:05 2022] DELETE /identity/v3/users/4d27db5cdd9e453dbd93b862db694309 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:59:05.903036 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da7670-06f4-47fc-b7ed-925ae287ea14 service placement] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:05.918237 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da7670-06f4-47fc-b7ed-925ae287ea14 service placement] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:05.978867 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01306579-d545-4027-95da-d69654e7177b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:05.979732 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01306579-d545-4027-95da-d69654e7177b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:05.980017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01306579-d545-4027-95da-d69654e7177b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:05.980292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01306579-d545-4027-95da-d69654e7177b admin admin] PATH_INFO: `/v3/projects/2e5e262f0ed548ee8a4450d0d4806667` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:05.981545 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01306579-d545-4027-95da-d69654e7177b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e5e262f0ed548ee8a4450d0d4806667)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:05.985660 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01306579-d545-4027-95da-d69654e7177b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:06.113457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-01306579-d545-4027-95da-d69654e7177b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e5e262f0ed548ee8a4450d0d4806667', 'request_id': 'req-01306579-d545-4027-95da-d69654e7177b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:06.119212 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-01306579-d545-4027-95da-d69654e7177b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e5e262f0ed548ee8a4450d0d4806667', 'request_id': 'req-01306579-d545-4027-95da-d69654e7177b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:06.125407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-01306579-d545-4027-95da-d69654e7177b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e5e262f0ed548ee8a4450d0d4806667', 'request_id': 'req-01306579-d545-4027-95da-d69654e7177b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:06.208730 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-01306579-d545-4027-95da-d69654e7177b admin admin] The token cache is being invalidate because project 2e5e262f0ed548ee8a4450d0d4806667 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:59:06.209089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-01306579-d545-4027-95da-d69654e7177b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:06.209781 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-01306579-d545-4027-95da-d69654e7177b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:06.211346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1147/2303] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:59:05 2022] DELETE /identity/v3/projects/2e5e262f0ed548ee8a4450d0d4806667 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:59:06.216373 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49773c-119c-436b-9d2c-cdfc8487688d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:06.219095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49773c-119c-436b-9d2c-cdfc8487688d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:06.219095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e49773c-119c-436b-9d2c-cdfc8487688d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:06.273506 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:06.276359 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1e49773c-119c-436b-9d2c-cdfc8487688d None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:59:06.277601 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1e49773c-119c-436b-9d2c-cdfc8487688d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:06.337825 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1157/2304] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:59:06.346219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6fc75-1872-4c8e-b50e-6ca9683b4940 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:06.346444 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6fc75-1872-4c8e-b50e-6ca9683b4940 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:06.346736 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6fc75-1872-4c8e-b50e-6ca9683b4940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:06.366183 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-bab6fc75-1872-4c8e-b50e-6ca9683b4940 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:59:06.367428 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-bab6fc75-1872-4c8e-b50e-6ca9683b4940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:06.376259 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1148/2305] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:59:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:59:06.380557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49773c-119c-436b-9d2c-cdfc8487688d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:06.391091 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e49773c-119c-436b-9d2c-cdfc8487688d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:06.395804 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76672d42-d2e4-4a7e-b1e1-854b69194bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:06.396552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76672d42-d2e4-4a7e-b1e1-854b69194bad admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:06.397495 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76672d42-d2e4-4a7e-b1e1-854b69194bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:06.397804 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76672d42-d2e4-4a7e-b1e1-854b69194bad admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:06.398680 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76672d42-d2e4-4a7e-b1e1-854b69194bad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:59:06.398995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76672d42-d2e4-4a7e-b1e1-854b69194bad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:06.400639 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76672d42-d2e4-4a7e-b1e1-854b69194bad admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:06.413196 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1158/2306] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:59:06.417710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6fc75-1872-4c8e-b50e-6ca9683b4940 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:06.427105 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6fc75-1872-4c8e-b50e-6ca9683b4940 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:06.432367 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64291b-1982-44f8-9cbd-6420d52a4cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:06.433120 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64291b-1982-44f8-9cbd-6420d52a4cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:06.433406 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64291b-1982-44f8-9cbd-6420d52a4cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:06.433680 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64291b-1982-44f8-9cbd-6420d52a4cb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:06.434372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64291b-1982-44f8-9cbd-6420d52a4cb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:06.436272 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db64291b-1982-44f8-9cbd-6420d52a4cb7 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:06.547346 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1149/2307] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:59:06 2022] POST /identity/v3/projects => generated 385 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:59:06.551403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76672d42-d2e4-4a7e-b1e1-854b69194bad admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:06.562927 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76672d42-d2e4-4a7e-b1e1-854b69194bad admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:06.621710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62543a-d974-4aa5-a7d9-9503ad0fbf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:06.622433 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62543a-d974-4aa5-a7d9-9503ad0fbf5e admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:06.622749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62543a-d974-4aa5-a7d9-9503ad0fbf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:06.623025 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62543a-d974-4aa5-a7d9-9503ad0fbf5e admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:06.623713 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62543a-d974-4aa5-a7d9-9503ad0fbf5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:06.625757 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62543a-d974-4aa5-a7d9-9503ad0fbf5e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:06.699317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1159/2308] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:59:06 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:59:06.703471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64291b-1982-44f8-9cbd-6420d52a4cb7 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:06.714295 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64291b-1982-44f8-9cbd-6420d52a4cb7 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:06.719019 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116e0e5-c4e5-45f5-8c00-61cb444468d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:06.719677 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116e0e5-c4e5-45f5-8c00-61cb444468d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:06.719963 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116e0e5-c4e5-45f5-8c00-61cb444468d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:06.720242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116e0e5-c4e5-45f5-8c00-61cb444468d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:06.720977 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116e0e5-c4e5-45f5-8c00-61cb444468d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:06.722607 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116e0e5-c4e5-45f5-8c00-61cb444468d0 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:06.734102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1150/2309] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:59:06.738458 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62543a-d974-4aa5-a7d9-9503ad0fbf5e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:06.749106 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62543a-d974-4aa5-a7d9-9503ad0fbf5e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:06.753674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367cf7b5-3a94-4fea-96c5-83395e4f9ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:06.754305 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cf7b5-3a94-4fea-96c5-83395e4f9ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:06.754615 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cf7b5-3a94-4fea-96c5-83395e4f9ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:06.754890 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367cf7b5-3a94-4fea-96c5-83395e4f9ad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:06.755612 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cf7b5-3a94-4fea-96c5-83395e4f9ad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:06.757663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367cf7b5-3a94-4fea-96c5-83395e4f9ad0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:06.768056 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1160/2310] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:59:06.779926 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116e0e5-c4e5-45f5-8c00-61cb444468d0 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:06.790736 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116e0e5-c4e5-45f5-8c00-61cb444468d0 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:06.795437 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ceba1a-b653-4d0c-9a91-79fb3de33fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:06.796333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceba1a-b653-4d0c-9a91-79fb3de33fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:06.796619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceba1a-b653-4d0c-9a91-79fb3de33fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:06.796896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceba1a-b653-4d0c-9a91-79fb3de33fa1 admin admin] PATH_INFO: `/v3/projects/fbf0d5ecebc44142a4cb2428f005cc74/users/43ed3a04e3ab4c9eb2b8b92af1613a32/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:06.811704 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ceba1a-b653-4d0c-9a91-79fb3de33fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf0d5ecebc44142a4cb2428f005cc74, user_id=43ed3a04e3ab4c9eb2b8b92af1613a32, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:06.814340 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ceba1a-b653-4d0c-9a91-79fb3de33fa1 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:06.816570 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:06.901291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1151/2311] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:59:06 2022] PUT /identity/v3/projects/fbf0d5ecebc44142a4cb2428f005cc74/users/43ed3a04e3ab4c9eb2b8b92af1613a32/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:59:06.911473 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4775d-a06f-49a0-965c-531e7fd57a1d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:06.911768 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4775d-a06f-49a0-965c-531e7fd57a1d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:06.912052 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4775d-a06f-49a0-965c-531e7fd57a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:06.939317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-b6c4775d-a06f-49a0-965c-531e7fd57a1d None None] MFA Rules not processed for user `43ed3a04e3ab4c9eb2b8b92af1613a32`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:59:06.940576 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b6c4775d-a06f-49a0-965c-531e7fd57a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:07.007172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1161/2312] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:59:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:59:07.018575 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ceba1a-b653-4d0c-9a91-79fb3de33fa1 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:07.020292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d8ceba1a-b653-4d0c-9a91-79fb3de33fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:07.125897 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ceba1a-b653-4d0c-9a91-79fb3de33fa1 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:07.132055 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc5d7b-cd2e-49c7-851f-a078ff7b5d4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:07.132719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc5d7b-cd2e-49c7-851f-a078ff7b5d4d service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:07.133001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc5d7b-cd2e-49c7-851f-a078ff7b5d4d service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:07.133302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc5d7b-cd2e-49c7-851f-a078ff7b5d4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:07.141786 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc5d7b-cd2e-49c7-851f-a078ff7b5d4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:07.143719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc5d7b-cd2e-49c7-851f-a078ff7b5d4d service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:07.156129 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1152/2313] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:59:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:59:17.003753 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:17.151358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:INSERT=1,keystone:SELECT=48 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:18.588090 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4775d-a06f-49a0-965c-531e7fd57a1d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:18.649348 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c4775d-a06f-49a0-965c-531e7fd57a1d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:18.653895 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15abf5-8a4b-4a93-8e50-c8bc3989d437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:18.654760 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15abf5-8a4b-4a93-8e50-c8bc3989d437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:18.655041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15abf5-8a4b-4a93-8e50-c8bc3989d437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:18.655346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15abf5-8a4b-4a93-8e50-c8bc3989d437 admin admin] PATH_INFO: `/v3/users/43ed3a04e3ab4c9eb2b8b92af1613a32` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:18.656593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15abf5-8a4b-4a93-8e50-c8bc3989d437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43ed3a04e3ab4c9eb2b8b92af1613a32)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:18.658503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15abf5-8a4b-4a93-8e50-c8bc3989d437 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:18.869239 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-df15abf5-8a4b-4a93-8e50-c8bc3989d437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43ed3a04e3ab4c9eb2b8b92af1613a32'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:18.974343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-df15abf5-8a4b-4a93-8e50-c8bc3989d437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43ed3a04e3ab4c9eb2b8b92af1613a32'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:18.982224 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-df15abf5-8a4b-4a93-8e50-c8bc3989d437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43ed3a04e3ab4c9eb2b8b92af1613a32'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:18.982887 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-df15abf5-8a4b-4a93-8e50-c8bc3989d437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43ed3a04e3ab4c9eb2b8b92af1613a32'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:18.995250 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-df15abf5-8a4b-4a93-8e50-c8bc3989d437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43ed3a04e3ab4c9eb2b8b92af1613a32'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:19.001327 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1162/2314] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:59:18 2022] DELETE /identity/v3/users/43ed3a04e3ab4c9eb2b8b92af1613a32 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:59:19.006245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c31a3e-4d03-4947-802e-193259a09e26 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:19.007328 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c31a3e-4d03-4947-802e-193259a09e26 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:19.007463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c31a3e-4d03-4947-802e-193259a09e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:19.026173 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-91c31a3e-4d03-4947-802e-193259a09e26 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:59:19.027372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-91c31a3e-4d03-4947-802e-193259a09e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:19.089881 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1153/2315] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:59:19.108448 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15abf5-8a4b-4a93-8e50-c8bc3989d437 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:19.109911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-df15abf5-8a4b-4a93-8e50-c8bc3989d437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:19.168956 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15abf5-8a4b-4a93-8e50-c8bc3989d437 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:19.172852 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf176b1c-273b-4322-adaa-34fc83f07a80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:19.173549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf176b1c-273b-4322-adaa-34fc83f07a80 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:19.174229 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf176b1c-273b-4322-adaa-34fc83f07a80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:19.174229 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf176b1c-273b-4322-adaa-34fc83f07a80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:19.185411 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf176b1c-273b-4322-adaa-34fc83f07a80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:19.186874 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf176b1c-273b-4322-adaa-34fc83f07a80 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:19.198168 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1163/2316] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:59:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:59:19.644984 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c31a3e-4d03-4947-802e-193259a09e26 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:19.646495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-91c31a3e-4d03-4947-802e-193259a09e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:19.659037 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c31a3e-4d03-4947-802e-193259a09e26 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:19.663879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916d7bb-6d9a-49e2-b1bc-7b3c4e7c5923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:19.664771 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916d7bb-6d9a-49e2-b1bc-7b3c4e7c5923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:19.665089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916d7bb-6d9a-49e2-b1bc-7b3c4e7c5923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:19.665466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916d7bb-6d9a-49e2-b1bc-7b3c4e7c5923 admin admin] PATH_INFO: `/v3/projects/fbf0d5ecebc44142a4cb2428f005cc74` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:19.666672 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916d7bb-6d9a-49e2-b1bc-7b3c4e7c5923 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf0d5ecebc44142a4cb2428f005cc74)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:19.668611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916d7bb-6d9a-49e2-b1bc-7b3c4e7c5923 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:19.806872 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f916d7bb-6d9a-49e2-b1bc-7b3c4e7c5923 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf0d5ecebc44142a4cb2428f005cc74', 'request_id': 'req-f916d7bb-6d9a-49e2-b1bc-7b3c4e7c5923'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:19.812693 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f916d7bb-6d9a-49e2-b1bc-7b3c4e7c5923 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf0d5ecebc44142a4cb2428f005cc74', 'request_id': 'req-f916d7bb-6d9a-49e2-b1bc-7b3c4e7c5923'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:19.819044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f916d7bb-6d9a-49e2-b1bc-7b3c4e7c5923 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf0d5ecebc44142a4cb2428f005cc74', 'request_id': 'req-f916d7bb-6d9a-49e2-b1bc-7b3c4e7c5923'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:19.905340 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f916d7bb-6d9a-49e2-b1bc-7b3c4e7c5923 admin admin] The token cache is being invalidate because project fbf0d5ecebc44142a4cb2428f005cc74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:59:19.905626 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f916d7bb-6d9a-49e2-b1bc-7b3c4e7c5923 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:19.906260 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f916d7bb-6d9a-49e2-b1bc-7b3c4e7c5923 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:19.907827 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1154/2317] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:59:19 2022] DELETE /identity/v3/projects/fbf0d5ecebc44142a4cb2428f005cc74 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:59:19.913927 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd76869-bd4f-42b0-8ff5-faca99398812 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:19.914421 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd76869-bd4f-42b0-8ff5-faca99398812 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:19.914767 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd76869-bd4f-42b0-8ff5-faca99398812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:19.933744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0bd76869-bd4f-42b0-8ff5-faca99398812 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:59:19.934956 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0bd76869-bd4f-42b0-8ff5-faca99398812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:19.952780 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:19.995578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1164/2318] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:59:20.003394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23945b-c582-4d50-941d-6250bd669165 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:20.003685 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23945b-c582-4d50-941d-6250bd669165 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:20.003973 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23945b-c582-4d50-941d-6250bd669165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:20.022479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-6e23945b-c582-4d50-941d-6250bd669165 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:59:20.023693 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6e23945b-c582-4d50-941d-6250bd669165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:20.031777 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1155/2319] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:59:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:59:20.035997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd76869-bd4f-42b0-8ff5-faca99398812 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:20.046555 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd76869-bd4f-42b0-8ff5-faca99398812 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:20.051844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a71749-8de6-464a-a1a4-3674dd591d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:20.052503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a71749-8de6-464a-a1a4-3674dd591d37 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:20.052789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a71749-8de6-464a-a1a4-3674dd591d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:20.053101 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a71749-8de6-464a-a1a4-3674dd591d37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:20.054535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a71749-8de6-464a-a1a4-3674dd591d37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:59:20.054861 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a71749-8de6-464a-a1a4-3674dd591d37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:20.058719 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a71749-8de6-464a-a1a4-3674dd591d37 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:20.069157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1165/2320] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 16:59:20.073775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23945b-c582-4d50-941d-6250bd669165 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:20.084017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e23945b-c582-4d50-941d-6250bd669165 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:20.092112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352e969-89d7-4bda-9b9b-43fe15724064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:20.092768 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352e969-89d7-4bda-9b9b-43fe15724064 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:20.093091 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352e969-89d7-4bda-9b9b-43fe15724064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:20.093365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5352e969-89d7-4bda-9b9b-43fe15724064 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:20.094111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352e969-89d7-4bda-9b9b-43fe15724064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:20.096207 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5352e969-89d7-4bda-9b9b-43fe15724064 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:20.399951 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1156/2321] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:59:20 2022] POST /identity/v3/projects => generated 375 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:59:20.404245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a71749-8de6-464a-a1a4-3674dd591d37 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:20.414990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a71749-8de6-464a-a1a4-3674dd591d37 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:20.471443 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822d6b1-690f-411c-8cca-ed4241cef51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:20.472115 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822d6b1-690f-411c-8cca-ed4241cef51a admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:20.472400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822d6b1-690f-411c-8cca-ed4241cef51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:20.472677 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822d6b1-690f-411c-8cca-ed4241cef51a admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:20.473406 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822d6b1-690f-411c-8cca-ed4241cef51a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:20.475404 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822d6b1-690f-411c-8cca-ed4241cef51a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:20.603587 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1166/2322] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:59:20 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:59:20.607727 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352e969-89d7-4bda-9b9b-43fe15724064 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:20.618366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5352e969-89d7-4bda-9b9b-43fe15724064 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:20.622926 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d1e3b-e1e3-4b45-86d5-c2f3c86c7aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:20.623591 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d1e3b-e1e3-4b45-86d5-c2f3c86c7aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:20.623876 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d1e3b-e1e3-4b45-86d5-c2f3c86c7aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:20.624156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d1e3b-e1e3-4b45-86d5-c2f3c86c7aa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:20.624910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d1e3b-e1e3-4b45-86d5-c2f3c86c7aa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:20.626530 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d1e3b-e1e3-4b45-86d5-c2f3c86c7aa0 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:20.638127 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1157/2323] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:59:20.642728 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822d6b1-690f-411c-8cca-ed4241cef51a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:20.656184 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822d6b1-690f-411c-8cca-ed4241cef51a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:20.661078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f872ce-3e27-419d-92a2-1f64e9d1d13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:20.661772 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f872ce-3e27-419d-92a2-1f64e9d1d13b admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:20.662068 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f872ce-3e27-419d-92a2-1f64e9d1d13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:20.662348 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f872ce-3e27-419d-92a2-1f64e9d1d13b admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:20.663175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f872ce-3e27-419d-92a2-1f64e9d1d13b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:20.664758 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f872ce-3e27-419d-92a2-1f64e9d1d13b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:20.675273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1167/2324] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:59:20.680375 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d1e3b-e1e3-4b45-86d5-c2f3c86c7aa0 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:20.690302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d1e3b-e1e3-4b45-86d5-c2f3c86c7aa0 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:20.695785 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd00808-82f3-4302-816f-63db17debd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:20.696680 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd00808-82f3-4302-816f-63db17debd98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:20.696963 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd00808-82f3-4302-816f-63db17debd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:20.697271 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd00808-82f3-4302-816f-63db17debd98 admin admin] PATH_INFO: `/v3/projects/5fd9fdac59f84165968e8fea0aa8cecf/users/3788a5f76e9442268b73fc2cd17a5a15/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:20.713550 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd00808-82f3-4302-816f-63db17debd98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fd9fdac59f84165968e8fea0aa8cecf, user_id=3788a5f76e9442268b73fc2cd17a5a15, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:20.716248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd00808-82f3-4302-816f-63db17debd98 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:20.832020 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1158/2325] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:59:20 2022] PUT /identity/v3/projects/5fd9fdac59f84165968e8fea0aa8cecf/users/3788a5f76e9442268b73fc2cd17a5a15/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:59:20.843791 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce5e80-1719-42e9-b06e-4a3d2898d883 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:20.844085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce5e80-1719-42e9-b06e-4a3d2898d883 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:20.844367 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce5e80-1719-42e9-b06e-4a3d2898d883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:20.872656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2bce5e80-1719-42e9-b06e-4a3d2898d883 None None] MFA Rules not processed for user `3788a5f76e9442268b73fc2cd17a5a15`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:59:20.873913 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2bce5e80-1719-42e9-b06e-4a3d2898d883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:20.938884 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1168/2326] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:59:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:59:20.951336 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd00808-82f3-4302-816f-63db17debd98 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:20.953377 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1dd00808-82f3-4302-816f-63db17debd98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:20.976381 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:21.028889 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd00808-82f3-4302-816f-63db17debd98 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:21.034552 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8822e30-899d-48fd-ba4a-c2c1479d5651 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:21.035205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8822e30-899d-48fd-ba4a-c2c1479d5651 service nova] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:21.035489 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8822e30-899d-48fd-ba4a-c2c1479d5651 service nova] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:21.035764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8822e30-899d-48fd-ba4a-c2c1479d5651 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:21.043908 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8822e30-899d-48fd-ba4a-c2c1479d5651 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:21.045537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8822e30-899d-48fd-ba4a-c2c1479d5651 service nova] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:21.055764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1159/2327] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:59:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:59:21.315465 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce5e80-1719-42e9-b06e-4a3d2898d883 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:21.337273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:21.384651 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce5e80-1719-42e9-b06e-4a3d2898d883 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:21.390075 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f76fe-08a4-42f7-91c1-d67a3d50b765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:21.390962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f76fe-08a4-42f7-91c1-d67a3d50b765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:21.391249 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f76fe-08a4-42f7-91c1-d67a3d50b765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:21.391527 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f76fe-08a4-42f7-91c1-d67a3d50b765 admin admin] PATH_INFO: `/v3/users/3788a5f76e9442268b73fc2cd17a5a15` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:21.392729 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f76fe-08a4-42f7-91c1-d67a3d50b765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3788a5f76e9442268b73fc2cd17a5a15)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:21.394927 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f76fe-08a4-42f7-91c1-d67a3d50b765 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:21.549706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-738f76fe-08a4-42f7-91c1-d67a3d50b765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3788a5f76e9442268b73fc2cd17a5a15'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:21.625651 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-738f76fe-08a4-42f7-91c1-d67a3d50b765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3788a5f76e9442268b73fc2cd17a5a15'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:21.633552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-738f76fe-08a4-42f7-91c1-d67a3d50b765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3788a5f76e9442268b73fc2cd17a5a15'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:21.637148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-738f76fe-08a4-42f7-91c1-d67a3d50b765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3788a5f76e9442268b73fc2cd17a5a15'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:21.646786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-738f76fe-08a4-42f7-91c1-d67a3d50b765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3788a5f76e9442268b73fc2cd17a5a15'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:21.654000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1169/2328] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 16:59:21 2022] DELETE /identity/v3/users/3788a5f76e9442268b73fc2cd17a5a15 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:59:21.658770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c71c44-d8ee-4db7-9fc2-14489b1abf46 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:21.659062 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c71c44-d8ee-4db7-9fc2-14489b1abf46 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:21.659343 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c71c44-d8ee-4db7-9fc2-14489b1abf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:21.678337 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-b5c71c44-d8ee-4db7-9fc2-14489b1abf46 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:59:21.680246 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b5c71c44-d8ee-4db7-9fc2-14489b1abf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:21.741994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1160/2329] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:59:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:59:21.752026 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f76fe-08a4-42f7-91c1-d67a3d50b765 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:21.753509 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-738f76fe-08a4-42f7-91c1-d67a3d50b765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:21.813142 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f76fe-08a4-42f7-91c1-d67a3d50b765 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:21.816536 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ec8e3-ec13-410c-9fd5-873ef03b8a44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:21.817215 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ec8e3-ec13-410c-9fd5-873ef03b8a44 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:21.817509 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ec8e3-ec13-410c-9fd5-873ef03b8a44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:21.817788 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ec8e3-ec13-410c-9fd5-873ef03b8a44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:21.827402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ec8e3-ec13-410c-9fd5-873ef03b8a44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:21.828879 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ec8e3-ec13-410c-9fd5-873ef03b8a44 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:21.839398 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1170/2330] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:59:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:59:22.288142 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c71c44-d8ee-4db7-9fc2-14489b1abf46 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:22.290518 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b5c71c44-d8ee-4db7-9fc2-14489b1abf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:22.305881 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c71c44-d8ee-4db7-9fc2-14489b1abf46 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:22.310754 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa197801-e81b-4163-b7a7-ca6a36f82347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:22.311649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa197801-e81b-4163-b7a7-ca6a36f82347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:22.311939 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa197801-e81b-4163-b7a7-ca6a36f82347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:22.312223 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa197801-e81b-4163-b7a7-ca6a36f82347 admin admin] PATH_INFO: `/v3/projects/5fd9fdac59f84165968e8fea0aa8cecf` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:22.313470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa197801-e81b-4163-b7a7-ca6a36f82347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fd9fdac59f84165968e8fea0aa8cecf)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:22.315556 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa197801-e81b-4163-b7a7-ca6a36f82347 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:22.474387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-aa197801-e81b-4163-b7a7-ca6a36f82347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fd9fdac59f84165968e8fea0aa8cecf', 'request_id': 'req-aa197801-e81b-4163-b7a7-ca6a36f82347'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:22.481741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-aa197801-e81b-4163-b7a7-ca6a36f82347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fd9fdac59f84165968e8fea0aa8cecf', 'request_id': 'req-aa197801-e81b-4163-b7a7-ca6a36f82347'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:22.488607 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-aa197801-e81b-4163-b7a7-ca6a36f82347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fd9fdac59f84165968e8fea0aa8cecf', 'request_id': 'req-aa197801-e81b-4163-b7a7-ca6a36f82347'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:22.585443 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-aa197801-e81b-4163-b7a7-ca6a36f82347 admin admin] The token cache is being invalidate because project 5fd9fdac59f84165968e8fea0aa8cecf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 16:59:22.585744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-aa197801-e81b-4163-b7a7-ca6a36f82347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:22.586395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-aa197801-e81b-4163-b7a7-ca6a36f82347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 16:59:22.588257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1161/2331] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 16:59:22 2022] DELETE /identity/v3/projects/5fd9fdac59f84165968e8fea0aa8cecf => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:59:22.593687 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa445620-dd23-4e14-a842-b6f22294875f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:22.594239 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa445620-dd23-4e14-a842-b6f22294875f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:22.594424 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa445620-dd23-4e14-a842-b6f22294875f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:22.619367 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-aa445620-dd23-4e14-a842-b6f22294875f None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:59:22.620701 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-aa445620-dd23-4e14-a842-b6f22294875f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:22.662115 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:22.698345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1171/2332] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:59:22.708440 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b62e2-86c8-4c46-aaa9-2dcb62e03f51 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:22.708966 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b62e2-86c8-4c46-aaa9-2dcb62e03f51 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:22.708966 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b62e2-86c8-4c46-aaa9-2dcb62e03f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:22.731482 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-044b62e2-86c8-4c46-aaa9-2dcb62e03f51 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:59:22.732946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-044b62e2-86c8-4c46-aaa9-2dcb62e03f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:22.745383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1162/2333] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:59:22.751113 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa445620-dd23-4e14-a842-b6f22294875f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:22.761548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa445620-dd23-4e14-a842-b6f22294875f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:22.766437 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37325a6d-3431-45a8-bfd2-351472cc6cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:22.767166 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37325a6d-3431-45a8-bfd2-351472cc6cba admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:22.767457 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37325a6d-3431-45a8-bfd2-351472cc6cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:22.767741 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37325a6d-3431-45a8-bfd2-351472cc6cba admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:22.768504 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37325a6d-3431-45a8-bfd2-351472cc6cba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 16:59:22.768814 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37325a6d-3431-45a8-bfd2-351472cc6cba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:22.770529 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37325a6d-3431-45a8-bfd2-351472cc6cba admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:22.784350 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1172/2334] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 16:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 16:59:22.790881 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b62e2-86c8-4c46-aaa9-2dcb62e03f51 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:22.802977 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b62e2-86c8-4c46-aaa9-2dcb62e03f51 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:22.808591 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47014fd3-da22-406b-96a8-2d9d27ac3644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:22.809415 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47014fd3-da22-406b-96a8-2d9d27ac3644 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:22.809704 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47014fd3-da22-406b-96a8-2d9d27ac3644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:22.810006 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47014fd3-da22-406b-96a8-2d9d27ac3644 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:22.810777 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47014fd3-da22-406b-96a8-2d9d27ac3644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:22.813536 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47014fd3-da22-406b-96a8-2d9d27ac3644 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:22.888674 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:22.899687 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1163/2335] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:59:22 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:59:22.901555 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37325a6d-3431-45a8-bfd2-351472cc6cba admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:22.916398 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37325a6d-3431-45a8-bfd2-351472cc6cba admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:22.982827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ec22a-3ff1-4898-8501-a9cdf4fbe60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:22.983438 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ec22a-3ff1-4898-8501-a9cdf4fbe60e admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:22.983775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ec22a-3ff1-4898-8501-a9cdf4fbe60e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:22.984014 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ec22a-3ff1-4898-8501-a9cdf4fbe60e admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:22.984791 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ec22a-3ff1-4898-8501-a9cdf4fbe60e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:22.987051 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ec22a-3ff1-4898-8501-a9cdf4fbe60e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:23.098377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1173/2336] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:59:22 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 16:59:23.103401 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47014fd3-da22-406b-96a8-2d9d27ac3644 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:23.115069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47014fd3-da22-406b-96a8-2d9d27ac3644 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:23.119715 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b554d-453d-4496-a816-e5e1c6c6707a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:23.120397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b554d-453d-4496-a816-e5e1c6c6707a admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:23.120687 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b554d-453d-4496-a816-e5e1c6c6707a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:23.120969 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b554d-453d-4496-a816-e5e1c6c6707a admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:23.121780 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b554d-453d-4496-a816-e5e1c6c6707a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:23.123395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477b554d-453d-4496-a816-e5e1c6c6707a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:23.135288 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1164/2337] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:59:23.139718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ec22a-3ff1-4898-8501-a9cdf4fbe60e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:23.152254 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ec22a-3ff1-4898-8501-a9cdf4fbe60e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:23.157705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8440a2-db70-49bc-8613-559a338bde6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:23.158286 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8440a2-db70-49bc-8613-559a338bde6e admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:23.158569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8440a2-db70-49bc-8613-559a338bde6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:23.158845 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8440a2-db70-49bc-8613-559a338bde6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:23.159588 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8440a2-db70-49bc-8613-559a338bde6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:23.161246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8440a2-db70-49bc-8613-559a338bde6e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:23.173687 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1174/2338] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 16:59:23.178348 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b554d-453d-4496-a816-e5e1c6c6707a admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:23.191212 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b554d-453d-4496-a816-e5e1c6c6707a admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:23.196581 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512e531-8fa6-4cb0-ac6c-e940726d3ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:23.197549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512e531-8fa6-4cb0-ac6c-e940726d3ec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:23.197832 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512e531-8fa6-4cb0-ac6c-e940726d3ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:23.198111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512e531-8fa6-4cb0-ac6c-e940726d3ec3 admin admin] PATH_INFO: `/v3/projects/5c159188b1114c0bbf297787b0888c99/users/3567a2ce80c34fc3935c07faabc15806/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:23.214617 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512e531-8fa6-4cb0-ac6c-e940726d3ec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c159188b1114c0bbf297787b0888c99, user_id=3567a2ce80c34fc3935c07faabc15806, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:23.217531 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512e531-8fa6-4cb0-ac6c-e940726d3ec3 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:23.306548 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1165/2339] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:59:23 2022] PUT /identity/v3/projects/5c159188b1114c0bbf297787b0888c99/users/3567a2ce80c34fc3935c07faabc15806/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:59:23.316858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f2b1b-c7ea-4b81-8756-e82d50f90569 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:23.317187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f2b1b-c7ea-4b81-8756-e82d50f90569 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:23.317474 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412f2b1b-c7ea-4b81-8756-e82d50f90569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:23.344595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-412f2b1b-c7ea-4b81-8756-e82d50f90569 None None] MFA Rules not processed for user `3567a2ce80c34fc3935c07faabc15806`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:59:23.345823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-412f2b1b-c7ea-4b81-8756-e82d50f90569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:23.411797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1175/2340] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:59:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 16:59:23.416961 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512e531-8fa6-4cb0-ac6c-e940726d3ec3 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:23.480682 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512e531-8fa6-4cb0-ac6c-e940726d3ec3 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:23.486592 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04fa0c-9d56-4969-827e-8409a868b4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:23.487648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04fa0c-9d56-4969-827e-8409a868b4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:23.487941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04fa0c-9d56-4969-827e-8409a868b4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:23.488217 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04fa0c-9d56-4969-827e-8409a868b4c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:23.488936 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04fa0c-9d56-4969-827e-8409a868b4c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:23.491946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04fa0c-9d56-4969-827e-8409a868b4c2 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:23.588507 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1166/2341] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 16:59:23 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:59:23.594388 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f2b1b-c7ea-4b81-8756-e82d50f90569 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:23.614036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412f2b1b-c7ea-4b81-8756-e82d50f90569 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:23.652774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:23.684403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76f31c-91a2-4cff-be92-a4da2dd0a9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:23.685141 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76f31c-91a2-4cff-be92-a4da2dd0a9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:23.685436 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76f31c-91a2-4cff-be92-a4da2dd0a9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:23.685719 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76f31c-91a2-4cff-be92-a4da2dd0a9e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:23.686426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76f31c-91a2-4cff-be92-a4da2dd0a9e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:23.688367 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76f31c-91a2-4cff-be92-a4da2dd0a9e6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:23.804902 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1176/2342] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 16:59:23 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 16:59:23.810307 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04fa0c-9d56-4969-827e-8409a868b4c2 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:23.822330 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04fa0c-9d56-4969-827e-8409a868b4c2 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:23.827192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8cd5a-484f-4ef5-ab46-7c725bcd77ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:23.843112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8cd5a-484f-4ef5-ab46-7c725bcd77ff admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:23.843112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8cd5a-484f-4ef5-ab46-7c725bcd77ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:23.843112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8cd5a-484f-4ef5-ab46-7c725bcd77ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:23.843112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8cd5a-484f-4ef5-ab46-7c725bcd77ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:23.843112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb8cd5a-484f-4ef5-ab46-7c725bcd77ff admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:23.843112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1167/2343] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:59:23.846553 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76f31c-91a2-4cff-be92-a4da2dd0a9e6 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:23.856982 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76f31c-91a2-4cff-be92-a4da2dd0a9e6 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:23.862297 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f52d67-6584-4f08-b036-7434237d1053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:23.863206 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f52d67-6584-4f08-b036-7434237d1053 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:23.863490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f52d67-6584-4f08-b036-7434237d1053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:23.863770 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f52d67-6584-4f08-b036-7434237d1053 admin admin] PATH_INFO: `/v3/projects/c401463c39714228b084cecd044a7007/users/cb0da94742f34f22b8c9b1bf347dcd41/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:23.880718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f52d67-6584-4f08-b036-7434237d1053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c401463c39714228b084cecd044a7007, user_id=cb0da94742f34f22b8c9b1bf347dcd41, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:23.884848 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f52d67-6584-4f08-b036-7434237d1053 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:23.998394 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1177/2344] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:59:23 2022] PUT /identity/v3/projects/c401463c39714228b084cecd044a7007/users/cb0da94742f34f22b8c9b1bf347dcd41/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:59:24.002446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8cd5a-484f-4ef5-ab46-7c725bcd77ff admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:24.013256 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb8cd5a-484f-4ef5-ab46-7c725bcd77ff admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:24.069535 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9971d-d7e3-4d25-ad6a-e8bc8bbd44cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:24.070199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9971d-d7e3-4d25-ad6a-e8bc8bbd44cc admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:24.070486 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9971d-d7e3-4d25-ad6a-e8bc8bbd44cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:24.070768 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9971d-d7e3-4d25-ad6a-e8bc8bbd44cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:24.071498 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9971d-d7e3-4d25-ad6a-e8bc8bbd44cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:24.073125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9971d-d7e3-4d25-ad6a-e8bc8bbd44cc admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:24.082927 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1168/2345] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 16:59:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 16:59:24.088316 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f52d67-6584-4f08-b036-7434237d1053 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:24.099236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f52d67-6584-4f08-b036-7434237d1053 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:24.104630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7719816-f020-49b1-b60e-f45da97431a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:24.105548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7719816-f020-49b1-b60e-f45da97431a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:24.105839 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7719816-f020-49b1-b60e-f45da97431a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:24.106119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7719816-f020-49b1-b60e-f45da97431a7 admin admin] PATH_INFO: `/v3/projects/c401463c39714228b084cecd044a7007/users/cb0da94742f34f22b8c9b1bf347dcd41/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:24.108167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7719816-f020-49b1-b60e-f45da97431a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c401463c39714228b084cecd044a7007, user_id=cb0da94742f34f22b8c9b1bf347dcd41, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:24.110856 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7719816-f020-49b1-b60e-f45da97431a7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:24.122187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1178/2346] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 16:59:24 2022] PUT /identity/v3/projects/c401463c39714228b084cecd044a7007/users/cb0da94742f34f22b8c9b1bf347dcd41/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 16:59:24.134306 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2359ce-aa83-4c54-b1bd-d5de7690ca54 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:24.134597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2359ce-aa83-4c54-b1bd-d5de7690ca54 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:24.134894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2359ce-aa83-4c54-b1bd-d5de7690ca54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:24.164562 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-fe2359ce-aa83-4c54-b1bd-d5de7690ca54 None None] MFA Rules not processed for user `cb0da94742f34f22b8c9b1bf347dcd41`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 16:59:24.165820 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fe2359ce-aa83-4c54-b1bd-d5de7690ca54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:24.190423 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:24.236141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1169/2347] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 16:59:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 16:59:24.248653 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7719816-f020-49b1-b60e-f45da97431a7 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:24.250404 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e7719816-f020-49b1-b60e-f45da97431a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 16:59:24.331372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7719816-f020-49b1-b60e-f45da97431a7 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:24.335870 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6649611-8c3d-4422-bb17-e0b7007be571 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:24.336519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6649611-8c3d-4422-bb17-e0b7007be571 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:24.336803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6649611-8c3d-4422-bb17-e0b7007be571 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:24.337138 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6649611-8c3d-4422-bb17-e0b7007be571 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:24.346514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6649611-8c3d-4422-bb17-e0b7007be571 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:24.347972 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6649611-8c3d-4422-bb17-e0b7007be571 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:24.358969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1179/2348] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:59:24 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:59:24.639303 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2359ce-aa83-4c54-b1bd-d5de7690ca54 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 16:59:24.650009 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2359ce-aa83-4c54-b1bd-d5de7690ca54 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 16:59:24.653727 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b494f4d-cdb0-421d-aaa3-a86e254e3cf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 16:59:24.654386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b494f4d-cdb0-421d-aaa3-a86e254e3cf2 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 16:59:24.654673 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b494f4d-cdb0-421d-aaa3-a86e254e3cf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 16:59:24.654954 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b494f4d-cdb0-421d-aaa3-a86e254e3cf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 16:59:24.711945 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b494f4d-cdb0-421d-aaa3-a86e254e3cf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 16:59:24.713420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b494f4d-cdb0-421d-aaa3-a86e254e3cf2 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 16:59:24.722315 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1170/2349] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 16:59:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 16:59:34.354612 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=63,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 16:59:34.718843 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=46 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:06.847051 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6649611-8c3d-4422-bb17-e0b7007be571 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:06.848514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c6649611-8c3d-4422-bb17-e0b7007be571 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:06.954215 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6649611-8c3d-4422-bb17-e0b7007be571 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:06.963673 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b937b65-47fc-4dea-ad62-214975a6c8ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c8d6afb4ccd41a5972e3241a3eebc7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:06.964681 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b937b65-47fc-4dea-ad62-214975a6c8ca service placement] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:06.965181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b937b65-47fc-4dea-ad62-214975a6c8ca service placement] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:06.965610 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b937b65-47fc-4dea-ad62-214975a6c8ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:06.968860 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4b937b65-47fc-4dea-ad62-214975a6c8ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:07.011986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b937b65-47fc-4dea-ad62-214975a6c8ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:07.017066 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b937b65-47fc-4dea-ad62-214975a6c8ca service placement] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:07.029861 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1180/2350] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:00:13.804597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c262f-5fd6-4ce4-b5b4-2493bb19a219 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:13.807293 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c262f-5fd6-4ce4-b5b4-2493bb19a219 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:13.807293 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c262f-5fd6-4ce4-b5b4-2493bb19a219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:13.822512 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-1a3c262f-5fd6-4ce4-b5b4-2493bb19a219 None None] MFA Rules not processed for user `7b98162f0ce8462fa1a20871ab1a6560`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:13.824277 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1a3c262f-5fd6-4ce4-b5b4-2493bb19a219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:13.888606 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1171/2351] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:00:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:15.531740 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b937b65-47fc-4dea-ad62-214975a6c8ca service placement] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:15.566506 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4b937b65-47fc-4dea-ad62-214975a6c8ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:15.611688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b937b65-47fc-4dea-ad62-214975a6c8ca service placement] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:15.617261 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b138bfe-6c00-4978-ae18-ffdcd8205492 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:15.617917 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b138bfe-6c00-4978-ae18-ffdcd8205492 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:15.618209 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b138bfe-6c00-4978-ae18-ffdcd8205492 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:15.618522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b138bfe-6c00-4978-ae18-ffdcd8205492 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:15.620345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5b138bfe-6c00-4978-ae18-ffdcd8205492 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:15.680258 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b138bfe-6c00-4978-ae18-ffdcd8205492 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:15.681893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b138bfe-6c00-4978-ae18-ffdcd8205492 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:15.692439 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1181/2352] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:17.022173 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72048a-1e80-47a9-ab50-257847f7139a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:17.022707 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72048a-1e80-47a9-ab50-257847f7139a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:17.022901 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f72048a-1e80-47a9-ab50-257847f7139a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:17.051735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-5f72048a-1e80-47a9-ab50-257847f7139a None None] MFA Rules not processed for user `ff65e481807b4344897b1499cd450f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:17.052968 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5f72048a-1e80-47a9-ab50-257847f7139a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:17.115311 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1172/2353] 10.222.0.76 () {58 vars in 967 bytes} [Mon Jul 18 17:00:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:17.251913 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b138bfe-6c00-4978-ae18-ffdcd8205492 service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:17.255843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5b138bfe-6c00-4978-ae18-ffdcd8205492 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:17.291118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:17.332586 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b138bfe-6c00-4978-ae18-ffdcd8205492 service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:17.337809 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da457b9-75b7-4816-badb-75ee8359b1ff service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bc0fa34b414328a342d685bc1eaca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:17.338405 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da457b9-75b7-4816-badb-75ee8359b1ff service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:17.338673 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da457b9-75b7-4816-badb-75ee8359b1ff service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:17.338955 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da457b9-75b7-4816-badb-75ee8359b1ff service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:17.348768 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da457b9-75b7-4816-badb-75ee8359b1ff service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:17.350664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da457b9-75b7-4816-badb-75ee8359b1ff service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:17.359150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1182/2354] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 17:00:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 17:00:18.696956 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72048a-1e80-47a9-ab50-257847f7139a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:18.698490 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5f72048a-1e80-47a9-ab50-257847f7139a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:18.754649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f72048a-1e80-47a9-ab50-257847f7139a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:18.758276 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef03524-4df4-470f-abe3-6681bb842f0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:18.758911 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef03524-4df4-470f-abe3-6681bb842f0f service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:18.759200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef03524-4df4-470f-abe3-6681bb842f0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:18.759484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef03524-4df4-470f-abe3-6681bb842f0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:18.761359 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-aef03524-4df4-470f-abe3-6681bb842f0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:18.814310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:18.826166 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef03524-4df4-470f-abe3-6681bb842f0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:18.827638 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef03524-4df4-470f-abe3-6681bb842f0f service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:18.837417 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1173/2355] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:23.083448 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da457b9-75b7-4816-badb-75ee8359b1ff service swift] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:23.085862 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8da457b9-75b7-4816-badb-75ee8359b1ff service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:23.104780 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da457b9-75b7-4816-badb-75ee8359b1ff service swift] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:23.112775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e143211-16b1-46ff-a953-b3475edec5cc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c8d6afb4ccd41a5972e3241a3eebc7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:23.113477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e143211-16b1-46ff-a953-b3475edec5cc service placement] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:23.113865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e143211-16b1-46ff-a953-b3475edec5cc service placement] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:23.114198 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e143211-16b1-46ff-a953-b3475edec5cc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:23.116040 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9e143211-16b1-46ff-a953-b3475edec5cc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:23.128568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e143211-16b1-46ff-a953-b3475edec5cc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:23.130356 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e143211-16b1-46ff-a953-b3475edec5cc service placement] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:23.143426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1183/2356] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:27.316450 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef03524-4df4-470f-abe3-6681bb842f0f service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:27.317944 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-aef03524-4df4-470f-abe3-6681bb842f0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:27.330526 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef03524-4df4-470f-abe3-6681bb842f0f service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:27.335288 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff6573-72df-432a-b26b-9dc39cdfe2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:27.337253 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff6573-72df-432a-b26b-9dc39cdfe2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:27.337546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff6573-72df-432a-b26b-9dc39cdfe2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:27.337853 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff6573-72df-432a-b26b-9dc39cdfe2ce admin admin] PATH_INFO: `/v3/users/71a82de7d125480a9f23c8cdf0c05638` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:27.339049 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff6573-72df-432a-b26b-9dc39cdfe2ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=71a82de7d125480a9f23c8cdf0c05638)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:27.341596 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff6573-72df-432a-b26b-9dc39cdfe2ce admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:27.410683 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e143211-16b1-46ff-a953-b3475edec5cc service placement] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:27.421656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e143211-16b1-46ff-a953-b3475edec5cc service placement] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:27.426334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181cca0-c753-46f1-96cd-39c2d6e92eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:27.427291 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181cca0-c753-46f1-96cd-39c2d6e92eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:27.427638 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181cca0-c753-46f1-96cd-39c2d6e92eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:27.427945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181cca0-c753-46f1-96cd-39c2d6e92eb8 admin admin] PATH_INFO: `/v3/users/3567a2ce80c34fc3935c07faabc15806` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:27.429305 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181cca0-c753-46f1-96cd-39c2d6e92eb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3567a2ce80c34fc3935c07faabc15806)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:27.431562 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181cca0-c753-46f1-96cd-39c2d6e92eb8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:27.690560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b5ff6573-72df-432a-b26b-9dc39cdfe2ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71a82de7d125480a9f23c8cdf0c05638'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:27.724479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d181cca0-c753-46f1-96cd-39c2d6e92eb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3567a2ce80c34fc3935c07faabc15806'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:27.789966 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b5ff6573-72df-432a-b26b-9dc39cdfe2ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71a82de7d125480a9f23c8cdf0c05638'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:27.800657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b5ff6573-72df-432a-b26b-9dc39cdfe2ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71a82de7d125480a9f23c8cdf0c05638'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:27.800657 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b5ff6573-72df-432a-b26b-9dc39cdfe2ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71a82de7d125480a9f23c8cdf0c05638'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:27.813583 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-b5ff6573-72df-432a-b26b-9dc39cdfe2ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71a82de7d125480a9f23c8cdf0c05638'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:27.820275 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1174/2357] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:00:27 2022] DELETE /identity/v3/users/71a82de7d125480a9f23c8cdf0c05638 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:27.858532 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d181cca0-c753-46f1-96cd-39c2d6e92eb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3567a2ce80c34fc3935c07faabc15806'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:27.867028 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d181cca0-c753-46f1-96cd-39c2d6e92eb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3567a2ce80c34fc3935c07faabc15806'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:27.867729 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d181cca0-c753-46f1-96cd-39c2d6e92eb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3567a2ce80c34fc3935c07faabc15806'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:27.881865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d181cca0-c753-46f1-96cd-39c2d6e92eb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3567a2ce80c34fc3935c07faabc15806'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:27.888829 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1184/2358] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:00:27 2022] DELETE /identity/v3/users/3567a2ce80c34fc3935c07faabc15806 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:00:27.893683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008295b-c43b-47d2-92d3-69c6fe6d570d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:27.893976 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008295b-c43b-47d2-92d3-69c6fe6d570d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:27.894253 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008295b-c43b-47d2-92d3-69c6fe6d570d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:27.914876 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-9008295b-c43b-47d2-92d3-69c6fe6d570d None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:27.916549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9008295b-c43b-47d2-92d3-69c6fe6d570d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:27.982374 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1175/2359] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:00:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:27.992620 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181cca0-c753-46f1-96cd-39c2d6e92eb8 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:27.994132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d181cca0-c753-46f1-96cd-39c2d6e92eb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:28.076250 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181cca0-c753-46f1-96cd-39c2d6e92eb8 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:28.086922 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537b64c-6c5a-45ef-bc87-7c9a738ce6dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:28.086922 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537b64c-6c5a-45ef-bc87-7c9a738ce6dd service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:28.086922 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537b64c-6c5a-45ef-bc87-7c9a738ce6dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:28.086922 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537b64c-6c5a-45ef-bc87-7c9a738ce6dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:28.092744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537b64c-6c5a-45ef-bc87-7c9a738ce6dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:28.094246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537b64c-6c5a-45ef-bc87-7c9a738ce6dd service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:28.104606 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1185/2360] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:28.239880 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008295b-c43b-47d2-92d3-69c6fe6d570d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:28.239880 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9008295b-c43b-47d2-92d3-69c6fe6d570d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:28.252981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008295b-c43b-47d2-92d3-69c6fe6d570d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:28.258144 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7146bc-f21b-400e-bc84-74ad97f0f018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:28.259102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7146bc-f21b-400e-bc84-74ad97f0f018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:28.259453 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7146bc-f21b-400e-bc84-74ad97f0f018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:28.259795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7146bc-f21b-400e-bc84-74ad97f0f018 admin admin] PATH_INFO: `/v3/projects/fbde8a43b24043e1bbab860fcbe67c91` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:28.261098 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7146bc-f21b-400e-bc84-74ad97f0f018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbde8a43b24043e1bbab860fcbe67c91)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:28.263244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7146bc-f21b-400e-bc84-74ad97f0f018 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:28.403663 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6f7146bc-f21b-400e-bc84-74ad97f0f018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbde8a43b24043e1bbab860fcbe67c91', 'request_id': 'req-6f7146bc-f21b-400e-bc84-74ad97f0f018'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:28.411171 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6f7146bc-f21b-400e-bc84-74ad97f0f018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbde8a43b24043e1bbab860fcbe67c91', 'request_id': 'req-6f7146bc-f21b-400e-bc84-74ad97f0f018'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:28.412395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:28.421084 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6f7146bc-f21b-400e-bc84-74ad97f0f018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbde8a43b24043e1bbab860fcbe67c91', 'request_id': 'req-6f7146bc-f21b-400e-bc84-74ad97f0f018'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:28.527725 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6f7146bc-f21b-400e-bc84-74ad97f0f018 admin admin] The token cache is being invalidate because project fbde8a43b24043e1bbab860fcbe67c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:00:28.529867 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6f7146bc-f21b-400e-bc84-74ad97f0f018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:28.529867 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-6f7146bc-f21b-400e-bc84-74ad97f0f018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:28.531030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1176/2361] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:00:28 2022] DELETE /identity/v3/projects/fbde8a43b24043e1bbab860fcbe67c91 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:28.535882 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537b64c-6c5a-45ef-bc87-7c9a738ce6dd service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:28.546489 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537b64c-6c5a-45ef-bc87-7c9a738ce6dd service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:28.561961 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:28.607831 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e39960-702e-47f4-8141-34a9735525ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:28.608621 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e39960-702e-47f4-8141-34a9735525ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:28.608911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e39960-702e-47f4-8141-34a9735525ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:28.609297 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e39960-702e-47f4-8141-34a9735525ac admin admin] PATH_INFO: `/v3/users/3dec46bbe583454c8f730f992de50d78` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:28.610541 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e39960-702e-47f4-8141-34a9735525ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dec46bbe583454c8f730f992de50d78)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:28.612781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e39960-702e-47f4-8141-34a9735525ac admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:28.648381 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7146bc-f21b-400e-bc84-74ad97f0f018 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:28.653421 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6f7146bc-f21b-400e-bc84-74ad97f0f018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:28.664473 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7146bc-f21b-400e-bc84-74ad97f0f018 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:28.670052 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb30da5-08e7-4763-ae79-de3458bf926d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:28.670944 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb30da5-08e7-4763-ae79-de3458bf926d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:28.671231 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb30da5-08e7-4763-ae79-de3458bf926d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:28.671513 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb30da5-08e7-4763-ae79-de3458bf926d admin admin] PATH_INFO: `/v3/projects/5c159188b1114c0bbf297787b0888c99` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:28.672820 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb30da5-08e7-4763-ae79-de3458bf926d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c159188b1114c0bbf297787b0888c99)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:28.674890 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb30da5-08e7-4763-ae79-de3458bf926d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:28.818045 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fcb30da5-08e7-4763-ae79-de3458bf926d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c159188b1114c0bbf297787b0888c99', 'request_id': 'req-fcb30da5-08e7-4763-ae79-de3458bf926d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:28.818351 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-54e39960-702e-47f4-8141-34a9735525ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dec46bbe583454c8f730f992de50d78'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:28.823934 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fcb30da5-08e7-4763-ae79-de3458bf926d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c159188b1114c0bbf297787b0888c99', 'request_id': 'req-fcb30da5-08e7-4763-ae79-de3458bf926d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:28.830798 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fcb30da5-08e7-4763-ae79-de3458bf926d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c159188b1114c0bbf297787b0888c99', 'request_id': 'req-fcb30da5-08e7-4763-ae79-de3458bf926d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:29.058390 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-54e39960-702e-47f4-8141-34a9735525ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dec46bbe583454c8f730f992de50d78'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:29.068651 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-54e39960-702e-47f4-8141-34a9735525ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dec46bbe583454c8f730f992de50d78'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:29.068651 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-54e39960-702e-47f4-8141-34a9735525ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dec46bbe583454c8f730f992de50d78'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:29.080124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-54e39960-702e-47f4-8141-34a9735525ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dec46bbe583454c8f730f992de50d78'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:29.086516 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1186/2362] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:00:28 2022] DELETE /identity/v3/users/3dec46bbe583454c8f730f992de50d78 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:29.160248 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fcb30da5-08e7-4763-ae79-de3458bf926d admin admin] The token cache is being invalidate because project 5c159188b1114c0bbf297787b0888c99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:00:29.160582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fcb30da5-08e7-4763-ae79-de3458bf926d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:29.161419 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fcb30da5-08e7-4763-ae79-de3458bf926d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:29.163016 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1177/2363] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:00:28 2022] DELETE /identity/v3/projects/5c159188b1114c0bbf297787b0888c99 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:00:29.167482 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e39960-702e-47f4-8141-34a9735525ac admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:29.169814 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-54e39960-702e-47f4-8141-34a9735525ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:29.246164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e39960-702e-47f4-8141-34a9735525ac admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:29.251462 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f61205-2b54-4111-b7ab-eb98f1845e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:29.251915 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f61205-2b54-4111-b7ab-eb98f1845e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:29.252263 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f61205-2b54-4111-b7ab-eb98f1845e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:29.252606 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f61205-2b54-4111-b7ab-eb98f1845e9c admin admin] PATH_INFO: `/v3/users/cb0da94742f34f22b8c9b1bf347dcd41` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:29.254054 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f61205-2b54-4111-b7ab-eb98f1845e9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb0da94742f34f22b8c9b1bf347dcd41)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:29.256142 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f61205-2b54-4111-b7ab-eb98f1845e9c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:29.414441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb30da5-08e7-4763-ae79-de3458bf926d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:29.415976 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fcb30da5-08e7-4763-ae79-de3458bf926d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:29.483763 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb30da5-08e7-4763-ae79-de3458bf926d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:29.488900 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa7b50-6def-4512-bfbf-bc3e6367ee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:29.489802 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa7b50-6def-4512-bfbf-bc3e6367ee49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:29.490122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa7b50-6def-4512-bfbf-bc3e6367ee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:29.490402 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa7b50-6def-4512-bfbf-bc3e6367ee49 admin admin] PATH_INFO: `/v3/projects/2a9b96ed7b8b4c11a0c42e1864ca216d` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:29.491602 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa7b50-6def-4512-bfbf-bc3e6367ee49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a9b96ed7b8b4c11a0c42e1864ca216d)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:29.493555 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa7b50-6def-4512-bfbf-bc3e6367ee49 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:29.519968 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:29.526353 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c3f61205-2b54-4111-b7ab-eb98f1845e9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb0da94742f34f22b8c9b1bf347dcd41'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:29.640923 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c3f61205-2b54-4111-b7ab-eb98f1845e9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb0da94742f34f22b8c9b1bf347dcd41'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:29.651450 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c3f61205-2b54-4111-b7ab-eb98f1845e9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb0da94742f34f22b8c9b1bf347dcd41'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:29.653173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c3f61205-2b54-4111-b7ab-eb98f1845e9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb0da94742f34f22b8c9b1bf347dcd41'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:29.663544 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-94fa7b50-6def-4512-bfbf-bc3e6367ee49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a9b96ed7b8b4c11a0c42e1864ca216d', 'request_id': 'req-94fa7b50-6def-4512-bfbf-bc3e6367ee49'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:29.666194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c3f61205-2b54-4111-b7ab-eb98f1845e9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb0da94742f34f22b8c9b1bf347dcd41'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:29.670042 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-94fa7b50-6def-4512-bfbf-bc3e6367ee49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a9b96ed7b8b4c11a0c42e1864ca216d', 'request_id': 'req-94fa7b50-6def-4512-bfbf-bc3e6367ee49'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:29.672901 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1187/2364] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:00:29 2022] DELETE /identity/v3/users/cb0da94742f34f22b8c9b1bf347dcd41 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:29.677357 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-94fa7b50-6def-4512-bfbf-bc3e6367ee49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a9b96ed7b8b4c11a0c42e1864ca216d', 'request_id': 'req-94fa7b50-6def-4512-bfbf-bc3e6367ee49'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:29.768065 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:29.773852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-94fa7b50-6def-4512-bfbf-bc3e6367ee49 admin admin] The token cache is being invalidate because project 2a9b96ed7b8b4c11a0c42e1864ca216d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:00:29.774282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-94fa7b50-6def-4512-bfbf-bc3e6367ee49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:29.775137 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-94fa7b50-6def-4512-bfbf-bc3e6367ee49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:29.777213 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1178/2365] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:00:29 2022] DELETE /identity/v3/projects/2a9b96ed7b8b4c11a0c42e1864ca216d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:00:30.210081 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f61205-2b54-4111-b7ab-eb98f1845e9c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:30.211692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c3f61205-2b54-4111-b7ab-eb98f1845e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:30.328934 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f61205-2b54-4111-b7ab-eb98f1845e9c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:30.335391 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bbd0d-2d7a-4e69-8c65-b1f79290f18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:30.337052 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bbd0d-2d7a-4e69-8c65-b1f79290f18b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:30.337052 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bbd0d-2d7a-4e69-8c65-b1f79290f18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:30.337293 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bbd0d-2d7a-4e69-8c65-b1f79290f18b admin admin] PATH_INFO: `/v3/projects/c401463c39714228b084cecd044a7007` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:30.338450 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39bbd0d-2d7a-4e69-8c65-b1f79290f18b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c401463c39714228b084cecd044a7007)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:30.340880 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39bbd0d-2d7a-4e69-8c65-b1f79290f18b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:30.477860 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c39bbd0d-2d7a-4e69-8c65-b1f79290f18b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c401463c39714228b084cecd044a7007', 'request_id': 'req-c39bbd0d-2d7a-4e69-8c65-b1f79290f18b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:30.487460 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c39bbd0d-2d7a-4e69-8c65-b1f79290f18b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c401463c39714228b084cecd044a7007', 'request_id': 'req-c39bbd0d-2d7a-4e69-8c65-b1f79290f18b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:30.493726 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c39bbd0d-2d7a-4e69-8c65-b1f79290f18b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c401463c39714228b084cecd044a7007', 'request_id': 'req-c39bbd0d-2d7a-4e69-8c65-b1f79290f18b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:30.573214 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c39bbd0d-2d7a-4e69-8c65-b1f79290f18b admin admin] The token cache is being invalidate because project c401463c39714228b084cecd044a7007 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:00:30.573508 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c39bbd0d-2d7a-4e69-8c65-b1f79290f18b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:30.575171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c39bbd0d-2d7a-4e69-8c65-b1f79290f18b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:00:30.576492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1188/2366] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:00:30 2022] DELETE /identity/v3/projects/c401463c39714228b084cecd044a7007 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:30.582533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da926037-15a2-4f28-a0cd-6e89743ca6fa None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:30.583132 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da926037-15a2-4f28-a0cd-6e89743ca6fa None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:30.583132 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da926037-15a2-4f28-a0cd-6e89743ca6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:30.603556 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-da926037-15a2-4f28-a0cd-6e89743ca6fa None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:30.604785 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-da926037-15a2-4f28-a0cd-6e89743ca6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:30.666523 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1179/2367] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:00:30.675010 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8306ce-e8f4-4597-bc1a-441277b3e1e8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:30.675542 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8306ce-e8f4-4597-bc1a-441277b3e1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:30.675542 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8306ce-e8f4-4597-bc1a-441277b3e1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:30.696427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1e8306ce-e8f4-4597-bc1a-441277b3e1e8 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:30.697710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1e8306ce-e8f4-4597-bc1a-441277b3e1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:30.706534 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1189/2368] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:00:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:30.710936 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da926037-15a2-4f28-a0cd-6e89743ca6fa None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:30.720914 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da926037-15a2-4f28-a0cd-6e89743ca6fa None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:30.726373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737a6df-9c92-4ef1-8606-57f775aaf9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:30.727343 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737a6df-9c92-4ef1-8606-57f775aaf9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:30.727343 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737a6df-9c92-4ef1-8606-57f775aaf9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:30.727602 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5737a6df-9c92-4ef1-8606-57f775aaf9c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:30.728331 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737a6df-9c92-4ef1-8606-57f775aaf9c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:00:30.728635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737a6df-9c92-4ef1-8606-57f775aaf9c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:30.730371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5737a6df-9c92-4ef1-8606-57f775aaf9c8 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:30.746272 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1180/2369] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:00:30.747397 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8306ce-e8f4-4597-bc1a-441277b3e1e8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:30.758755 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8306ce-e8f4-4597-bc1a-441277b3e1e8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:30.764739 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28413177-b90c-489c-86ac-6bbbb7b2f793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:30.765543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28413177-b90c-489c-86ac-6bbbb7b2f793 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:30.765894 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28413177-b90c-489c-86ac-6bbbb7b2f793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:30.766259 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28413177-b90c-489c-86ac-6bbbb7b2f793 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:30.766979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28413177-b90c-489c-86ac-6bbbb7b2f793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:30.768956 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28413177-b90c-489c-86ac-6bbbb7b2f793 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:30.885565 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1190/2370] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:00:30 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:00:30.888913 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737a6df-9c92-4ef1-8606-57f775aaf9c8 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:30.898941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5737a6df-9c92-4ef1-8606-57f775aaf9c8 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:30.957715 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25038024-b56a-4e7c-b6eb-b35f641ee820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:30.958321 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25038024-b56a-4e7c-b6eb-b35f641ee820 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:30.958605 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25038024-b56a-4e7c-b6eb-b35f641ee820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:30.958884 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25038024-b56a-4e7c-b6eb-b35f641ee820 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:30.959718 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25038024-b56a-4e7c-b6eb-b35f641ee820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:30.961675 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25038024-b56a-4e7c-b6eb-b35f641ee820 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:31.053417 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1181/2371] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:00:30 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:00:31.057691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28413177-b90c-489c-86ac-6bbbb7b2f793 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:31.069548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28413177-b90c-489c-86ac-6bbbb7b2f793 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:31.074332 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbcb7e-7823-4a36-abc0-b6704dbebd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:31.074976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbcb7e-7823-4a36-abc0-b6704dbebd75 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:31.077316 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbcb7e-7823-4a36-abc0-b6704dbebd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:31.077316 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dbcb7e-7823-4a36-abc0-b6704dbebd75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:31.077316 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dbcb7e-7823-4a36-abc0-b6704dbebd75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:31.077922 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dbcb7e-7823-4a36-abc0-b6704dbebd75 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:31.090439 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1191/2372] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:31.094337 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25038024-b56a-4e7c-b6eb-b35f641ee820 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:31.104738 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25038024-b56a-4e7c-b6eb-b35f641ee820 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:31.110194 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f0c57-544e-4b47-82de-4c8cbefd09cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:31.110848 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f0c57-544e-4b47-82de-4c8cbefd09cd admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:31.111391 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f0c57-544e-4b47-82de-4c8cbefd09cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:31.111675 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f0c57-544e-4b47-82de-4c8cbefd09cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:31.112408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f0c57-544e-4b47-82de-4c8cbefd09cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:31.114172 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f0c57-544e-4b47-82de-4c8cbefd09cd admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:31.125492 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1182/2373] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:31.129611 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbcb7e-7823-4a36-abc0-b6704dbebd75 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:31.140258 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dbcb7e-7823-4a36-abc0-b6704dbebd75 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:31.144883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b9c86-d12f-43fb-a6f0-5fc67d5a1cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:31.145806 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b9c86-d12f-43fb-a6f0-5fc67d5a1cef admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:31.146105 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b9c86-d12f-43fb-a6f0-5fc67d5a1cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:31.146369 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b9c86-d12f-43fb-a6f0-5fc67d5a1cef admin admin] PATH_INFO: `/v3/projects/b5651894bb09423fa2c562ce11bc0b64/users/bae3da8a2bd14440998f1f862ab02bef/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:31.148730 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:31.163852 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b9c86-d12f-43fb-a6f0-5fc67d5a1cef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5651894bb09423fa2c562ce11bc0b64, user_id=bae3da8a2bd14440998f1f862ab02bef, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:31.166570 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b9c86-d12f-43fb-a6f0-5fc67d5a1cef admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:31.253811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1192/2374] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:31 2022] PUT /identity/v3/projects/b5651894bb09423fa2c562ce11bc0b64/users/bae3da8a2bd14440998f1f862ab02bef/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:31.259152 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbf4d8-2c38-4836-8bc0-d3ba5448afb7 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:31.259451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbf4d8-2c38-4836-8bc0-d3ba5448afb7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:31.259734 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbf4d8-2c38-4836-8bc0-d3ba5448afb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:31.278659 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-17dbf4d8-2c38-4836-8bc0-d3ba5448afb7 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:31.279992 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-17dbf4d8-2c38-4836-8bc0-d3ba5448afb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:31.339302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1183/2375] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:00:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:31.349117 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b9c86-d12f-43fb-a6f0-5fc67d5a1cef admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:31.350831 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-332b9c86-d12f-43fb-a6f0-5fc67d5a1cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:31.407709 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b9c86-d12f-43fb-a6f0-5fc67d5a1cef admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:31.411331 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28432b-b1ba-4610-94ae-08bfdde83dbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:31.411973 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28432b-b1ba-4610-94ae-08bfdde83dbd service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:31.412258 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28432b-b1ba-4610-94ae-08bfdde83dbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:31.412537 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28432b-b1ba-4610-94ae-08bfdde83dbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:31.421671 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28432b-b1ba-4610-94ae-08bfdde83dbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:31.423105 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28432b-b1ba-4610-94ae-08bfdde83dbd service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:31.432550 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1193/2376] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:32.893289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9752298-c2eb-4dff-9991-0148bcf0fe4d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:32.893857 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9752298-c2eb-4dff-9991-0148bcf0fe4d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:32.893857 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9752298-c2eb-4dff-9991-0148bcf0fe4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:32.915819 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:32.932392 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e9752298-c2eb-4dff-9991-0148bcf0fe4d None None] MFA Rules not processed for user `bae3da8a2bd14440998f1f862ab02bef`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:32.933785 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e9752298-c2eb-4dff-9991-0148bcf0fe4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:33.001524 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1184/2377] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:00:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:33.006048 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28432b-b1ba-4610-94ae-08bfdde83dbd service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:33.016314 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28432b-b1ba-4610-94ae-08bfdde83dbd service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:33.021382 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2710e-6441-4148-9396-0ed5dd0b96e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:33.022048 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2710e-6441-4148-9396-0ed5dd0b96e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:33.022338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2710e-6441-4148-9396-0ed5dd0b96e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:33.022619 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2710e-6441-4148-9396-0ed5dd0b96e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:33.023328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2710e-6441-4148-9396-0ed5dd0b96e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:33.025302 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d2710e-6441-4148-9396-0ed5dd0b96e0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:33.163624 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1194/2378] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:00:33 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:00:33.167844 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9752298-c2eb-4dff-9991-0148bcf0fe4d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:33.180562 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9752298-c2eb-4dff-9991-0148bcf0fe4d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:33.240235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cb4ce-c1aa-46dc-8240-3b858a471a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:33.240827 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cb4ce-c1aa-46dc-8240-3b858a471a23 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:33.241156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cb4ce-c1aa-46dc-8240-3b858a471a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:33.241442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cb4ce-c1aa-46dc-8240-3b858a471a23 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:33.242140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732cb4ce-c1aa-46dc-8240-3b858a471a23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:33.244065 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732cb4ce-c1aa-46dc-8240-3b858a471a23 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:33.338895 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2710e-6441-4148-9396-0ed5dd0b96e0 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:33.340737 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1185/2379] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:00:33 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:00:33.344095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b1d2710e-6441-4148-9396-0ed5dd0b96e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:33.344975 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cb4ce-c1aa-46dc-8240-3b858a471a23 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:33.356961 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cb4ce-c1aa-46dc-8240-3b858a471a23 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:33.362402 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2feff9-a809-4908-8b21-5190d4c96c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:33.363122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2feff9-a809-4908-8b21-5190d4c96c2d admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:33.363413 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2feff9-a809-4908-8b21-5190d4c96c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:33.363689 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2feff9-a809-4908-8b21-5190d4c96c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:33.364493 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2feff9-a809-4908-8b21-5190d4c96c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:33.366311 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2feff9-a809-4908-8b21-5190d4c96c2d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:33.377512 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1186/2380] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:00:33.381574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2feff9-a809-4908-8b21-5190d4c96c2d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:33.393257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2feff9-a809-4908-8b21-5190d4c96c2d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:33.398616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86eb99e-f5bb-4d3b-89fb-2308e4302c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:33.399499 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86eb99e-f5bb-4d3b-89fb-2308e4302c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:33.399814 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86eb99e-f5bb-4d3b-89fb-2308e4302c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:33.400089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86eb99e-f5bb-4d3b-89fb-2308e4302c23 admin admin] PATH_INFO: `/v3/projects/254753321561429581a9d681b36a6e6f/users/2df6f2ef451142019199c0e1bf770d5a/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:33.408974 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2710e-6441-4148-9396-0ed5dd0b96e0 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:33.412735 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad96de-efa1-455f-93df-e8dcfc3bb50a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:33.413424 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad96de-efa1-455f-93df-e8dcfc3bb50a service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:33.413715 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad96de-efa1-455f-93df-e8dcfc3bb50a service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:33.413994 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad96de-efa1-455f-93df-e8dcfc3bb50a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:33.415830 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0cad96de-efa1-455f-93df-e8dcfc3bb50a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:33.416979 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86eb99e-f5bb-4d3b-89fb-2308e4302c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=254753321561429581a9d681b36a6e6f, user_id=2df6f2ef451142019199c0e1bf770d5a, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:33.420266 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86eb99e-f5bb-4d3b-89fb-2308e4302c23 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:33.475977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad96de-efa1-455f-93df-e8dcfc3bb50a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:33.477506 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad96de-efa1-455f-93df-e8dcfc3bb50a service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:33.487245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1195/2381] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:00:33.509910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1187/2382] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:33 2022] PUT /identity/v3/projects/254753321561429581a9d681b36a6e6f/users/2df6f2ef451142019199c0e1bf770d5a/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:00:33.514597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad96de-efa1-455f-93df-e8dcfc3bb50a service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:33.525100 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad96de-efa1-455f-93df-e8dcfc3bb50a service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:33.537686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:33.582999 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf143c-535b-4776-9dcc-202d323c4a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:33.583675 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf143c-535b-4776-9dcc-202d323c4a9a admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:33.583966 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf143c-535b-4776-9dcc-202d323c4a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:33.584248 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf143c-535b-4776-9dcc-202d323c4a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:33.585031 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf143c-535b-4776-9dcc-202d323c4a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:33.586660 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf143c-535b-4776-9dcc-202d323c4a9a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:33.596842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1196/2383] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:00:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:00:33.600988 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86eb99e-f5bb-4d3b-89fb-2308e4302c23 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:33.612057 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86eb99e-f5bb-4d3b-89fb-2308e4302c23 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:33.616685 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939f71c-e877-4149-bf9a-98434f63d140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:33.617623 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939f71c-e877-4149-bf9a-98434f63d140 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:33.618024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939f71c-e877-4149-bf9a-98434f63d140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:33.618442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0939f71c-e877-4149-bf9a-98434f63d140 admin admin] PATH_INFO: `/v3/projects/254753321561429581a9d681b36a6e6f/users/2df6f2ef451142019199c0e1bf770d5a/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:33.620422 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939f71c-e877-4149-bf9a-98434f63d140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=254753321561429581a9d681b36a6e6f, user_id=2df6f2ef451142019199c0e1bf770d5a, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:33.623704 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0939f71c-e877-4149-bf9a-98434f63d140 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:33.635286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1188/2384] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:00:33 2022] PUT /identity/v3/projects/254753321561429581a9d681b36a6e6f/users/2df6f2ef451142019199c0e1bf770d5a/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:00:35.360747 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeca3e5-e007-4391-be82-74fd287da98e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:35.361561 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeca3e5-e007-4391-be82-74fd287da98e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:35.362007 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeca3e5-e007-4391-be82-74fd287da98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:35.393271 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5eeca3e5-e007-4391-be82-74fd287da98e None None] MFA Rules not processed for user `2df6f2ef451142019199c0e1bf770d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:35.394503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5eeca3e5-e007-4391-be82-74fd287da98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:35.468773 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1197/2385] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:00:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:35.480656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939f71c-e877-4149-bf9a-98434f63d140 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:35.483327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0939f71c-e877-4149-bf9a-98434f63d140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:35.530717 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:35.547818 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0939f71c-e877-4149-bf9a-98434f63d140 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:35.551567 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd34263a-fc45-4612-b9d6-8d87cc1ca777 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:35.552250 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34263a-fc45-4612-b9d6-8d87cc1ca777 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:35.552532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34263a-fc45-4612-b9d6-8d87cc1ca777 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:35.552809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd34263a-fc45-4612-b9d6-8d87cc1ca777 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:35.615877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34263a-fc45-4612-b9d6-8d87cc1ca777 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:35.617283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd34263a-fc45-4612-b9d6-8d87cc1ca777 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:35.627237 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1189/2386] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:39.667552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeca3e5-e007-4391-be82-74fd287da98e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:00:39.677651 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeca3e5-e007-4391-be82-74fd287da98e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:00:39.681514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f3da0-cd38-44c7-847b-ef8aed096210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:00:39.682240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f3da0-cd38-44c7-847b-ef8aed096210 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:39.682481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f3da0-cd38-44c7-847b-ef8aed096210 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:39.682765 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830f3da0-cd38-44c7-847b-ef8aed096210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:39.692592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f3da0-cd38-44c7-847b-ef8aed096210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:00:39.694085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830f3da0-cd38-44c7-847b-ef8aed096210 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:00:39.704627 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1198/2387] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:00:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:00:45.622813 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=31 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:46.577526 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b86507-49dd-4bb7-ace2-e1a1040834f1 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:00:46.577821 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b86507-49dd-4bb7-ace2-e1a1040834f1 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:00:46.578102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b86507-49dd-4bb7-ace2-e1a1040834f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:00:46.595681 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c2b86507-49dd-4bb7-ace2-e1a1040834f1 None None] MFA Rules not processed for user `4ad27549c1824d45b1d55653e2c121a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:00:46.596892 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c2b86507-49dd-4bb7-ace2-e1a1040834f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:00:46.653329 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1190/2388] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:00:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:00:49.699504 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=61 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:00:56.646577 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=25 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:03.915457 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f3da0-cd38-44c7-847b-ef8aed096210 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:03.986894 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830f3da0-cd38-44c7-847b-ef8aed096210 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:03.991057 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b055a-13f2-4848-879a-ecb1f122c951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:03.991975 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b055a-13f2-4848-879a-ecb1f122c951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:03.992264 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b055a-13f2-4848-879a-ecb1f122c951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:03.992546 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b055a-13f2-4848-879a-ecb1f122c951 admin admin] PATH_INFO: `/v3/users/bae3da8a2bd14440998f1f862ab02bef` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:03.993802 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b055a-13f2-4848-879a-ecb1f122c951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bae3da8a2bd14440998f1f862ab02bef)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:03.995766 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b055a-13f2-4848-879a-ecb1f122c951 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:04.064588 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b86507-49dd-4bb7-ace2-e1a1040834f1 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:04.066608 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c2b86507-49dd-4bb7-ace2-e1a1040834f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:04.133139 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b86507-49dd-4bb7-ace2-e1a1040834f1 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:04.138639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fac57-e472-4cf3-a762-fc0d2f3db619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:04.139680 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fac57-e472-4cf3-a762-fc0d2f3db619 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:04.139989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fac57-e472-4cf3-a762-fc0d2f3db619 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:04.140375 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fac57-e472-4cf3-a762-fc0d2f3db619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:04.142528 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8b3fac57-e472-4cf3-a762-fc0d2f3db619 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:04.211703 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fac57-e472-4cf3-a762-fc0d2f3db619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:04.213402 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fac57-e472-4cf3-a762-fc0d2f3db619 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:04.223563 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1191/2389] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:01:04.268269 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ff1b055a-13f2-4848-879a-ecb1f122c951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bae3da8a2bd14440998f1f862ab02bef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:04.360572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ff1b055a-13f2-4848-879a-ecb1f122c951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bae3da8a2bd14440998f1f862ab02bef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:04.369804 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ff1b055a-13f2-4848-879a-ecb1f122c951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bae3da8a2bd14440998f1f862ab02bef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:04.372304 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ff1b055a-13f2-4848-879a-ecb1f122c951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bae3da8a2bd14440998f1f862ab02bef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:04.386357 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ff1b055a-13f2-4848-879a-ecb1f122c951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bae3da8a2bd14440998f1f862ab02bef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:04.396033 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1199/2390] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:01:03 2022] DELETE /identity/v3/users/bae3da8a2bd14440998f1f862ab02bef => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:04.665511 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fac57-e472-4cf3-a762-fc0d2f3db619 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:04.683947 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fac57-e472-4cf3-a762-fc0d2f3db619 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:04.746694 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ce2d8-d390-44df-ad5c-93bc58eb7f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:04.747801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ce2d8-d390-44df-ad5c-93bc58eb7f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:04.748080 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ce2d8-d390-44df-ad5c-93bc58eb7f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:04.748358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267ce2d8-d390-44df-ad5c-93bc58eb7f19 admin admin] PATH_INFO: `/v3/projects/b5651894bb09423fa2c562ce11bc0b64` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:04.749588 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ce2d8-d390-44df-ad5c-93bc58eb7f19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5651894bb09423fa2c562ce11bc0b64)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:04.751495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267ce2d8-d390-44df-ad5c-93bc58eb7f19 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:04.873064 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-267ce2d8-d390-44df-ad5c-93bc58eb7f19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5651894bb09423fa2c562ce11bc0b64', 'request_id': 'req-267ce2d8-d390-44df-ad5c-93bc58eb7f19'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:04.878001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:04.879218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-267ce2d8-d390-44df-ad5c-93bc58eb7f19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5651894bb09423fa2c562ce11bc0b64', 'request_id': 'req-267ce2d8-d390-44df-ad5c-93bc58eb7f19'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:04.886519 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-267ce2d8-d390-44df-ad5c-93bc58eb7f19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5651894bb09423fa2c562ce11bc0b64', 'request_id': 'req-267ce2d8-d390-44df-ad5c-93bc58eb7f19'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:05.006379 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-267ce2d8-d390-44df-ad5c-93bc58eb7f19 admin admin] The token cache is being invalidate because project b5651894bb09423fa2c562ce11bc0b64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:01:05.006669 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-267ce2d8-d390-44df-ad5c-93bc58eb7f19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:05.007299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-267ce2d8-d390-44df-ad5c-93bc58eb7f19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:05.008872 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1192/2391] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:01:04 2022] DELETE /identity/v3/projects/b5651894bb09423fa2c562ce11bc0b64 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:05.013126 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b055a-13f2-4848-879a-ecb1f122c951 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:05.015245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ff1b055a-13f2-4848-879a-ecb1f122c951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:05.028993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b055a-13f2-4848-879a-ecb1f122c951 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:05.094925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d60eed-de22-4a0e-bf3e-0231ea48fdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:05.102352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d60eed-de22-4a0e-bf3e-0231ea48fdc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:05.102352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d60eed-de22-4a0e-bf3e-0231ea48fdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:05.102352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d60eed-de22-4a0e-bf3e-0231ea48fdc7 admin admin] PATH_INFO: `/v3/users/2df6f2ef451142019199c0e1bf770d5a` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:05.102352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d60eed-de22-4a0e-bf3e-0231ea48fdc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2df6f2ef451142019199c0e1bf770d5a)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:05.102352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d60eed-de22-4a0e-bf3e-0231ea48fdc7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:05.125266 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:05.336880 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-38d60eed-de22-4a0e-bf3e-0231ea48fdc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2df6f2ef451142019199c0e1bf770d5a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:05.441268 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-38d60eed-de22-4a0e-bf3e-0231ea48fdc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2df6f2ef451142019199c0e1bf770d5a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:05.460152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-38d60eed-de22-4a0e-bf3e-0231ea48fdc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2df6f2ef451142019199c0e1bf770d5a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:05.461106 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-38d60eed-de22-4a0e-bf3e-0231ea48fdc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2df6f2ef451142019199c0e1bf770d5a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:05.477900 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-38d60eed-de22-4a0e-bf3e-0231ea48fdc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2df6f2ef451142019199c0e1bf770d5a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:05.488281 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1200/2392] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:01:05 2022] DELETE /identity/v3/users/2df6f2ef451142019199c0e1bf770d5a => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:05.875601 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ce2d8-d390-44df-ad5c-93bc58eb7f19 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:05.878226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-267ce2d8-d390-44df-ad5c-93bc58eb7f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:05.896266 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267ce2d8-d390-44df-ad5c-93bc58eb7f19 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:05.964521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d44c7-d195-4a61-a3d6-e5a4c21a2f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:05.966128 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d44c7-d195-4a61-a3d6-e5a4c21a2f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:05.966397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d44c7-d195-4a61-a3d6-e5a4c21a2f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:05.966683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d44c7-d195-4a61-a3d6-e5a4c21a2f4b admin admin] PATH_INFO: `/v3/projects/254753321561429581a9d681b36a6e6f` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:05.967906 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d44c7-d195-4a61-a3d6-e5a4c21a2f4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=254753321561429581a9d681b36a6e6f)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:05.970007 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d44c7-d195-4a61-a3d6-e5a4c21a2f4b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:06.180513 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-926d44c7-d195-4a61-a3d6-e5a4c21a2f4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '254753321561429581a9d681b36a6e6f', 'request_id': 'req-926d44c7-d195-4a61-a3d6-e5a4c21a2f4b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:06.187280 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-926d44c7-d195-4a61-a3d6-e5a4c21a2f4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '254753321561429581a9d681b36a6e6f', 'request_id': 'req-926d44c7-d195-4a61-a3d6-e5a4c21a2f4b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:06.196296 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-926d44c7-d195-4a61-a3d6-e5a4c21a2f4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '254753321561429581a9d681b36a6e6f', 'request_id': 'req-926d44c7-d195-4a61-a3d6-e5a4c21a2f4b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:06.286896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-926d44c7-d195-4a61-a3d6-e5a4c21a2f4b admin admin] The token cache is being invalidate because project 254753321561429581a9d681b36a6e6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:01:06.287311 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-926d44c7-d195-4a61-a3d6-e5a4c21a2f4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:06.292312 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-926d44c7-d195-4a61-a3d6-e5a4c21a2f4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:06.292312 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1193/2393] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:01:05 2022] DELETE /identity/v3/projects/254753321561429581a9d681b36a6e6f => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:06.297499 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc9b73-625e-4d5d-ac15-3dd38523f92b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:06.298267 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc9b73-625e-4d5d-ac15-3dd38523f92b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:06.298267 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc9b73-625e-4d5d-ac15-3dd38523f92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:06.328600 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d8dc9b73-625e-4d5d-ac15-3dd38523f92b None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:06.331033 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d8dc9b73-625e-4d5d-ac15-3dd38523f92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:06.414586 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1201/2394] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:06.423163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b829e6-6088-4a36-b9e2-dbe03d3ac0ee None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:06.423476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b829e6-6088-4a36-b9e2-dbe03d3ac0ee None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:06.423749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b829e6-6088-4a36-b9e2-dbe03d3ac0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:06.444479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e6b829e6-6088-4a36-b9e2-dbe03d3ac0ee None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:06.445777 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e6b829e6-6088-4a36-b9e2-dbe03d3ac0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:06.454446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1194/2395] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:01:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:06.458718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc9b73-625e-4d5d-ac15-3dd38523f92b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:06.469779 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc9b73-625e-4d5d-ac15-3dd38523f92b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:06.475964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e772a-b7aa-4fcf-8f87-af87c4c0027c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:06.476648 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e772a-b7aa-4fcf-8f87-af87c4c0027c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:06.476939 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e772a-b7aa-4fcf-8f87-af87c4c0027c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:06.477265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e772a-b7aa-4fcf-8f87-af87c4c0027c admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:06.478004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e772a-b7aa-4fcf-8f87-af87c4c0027c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:01:06.478494 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e772a-b7aa-4fcf-8f87-af87c4c0027c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:06.480117 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e772a-b7aa-4fcf-8f87-af87c4c0027c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:06.494692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1202/2396] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:01:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:01:06.499488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b829e6-6088-4a36-b9e2-dbe03d3ac0ee None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:06.509487 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b829e6-6088-4a36-b9e2-dbe03d3ac0ee None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:06.515641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbea7c-5d44-4a61-8c7e-83e3181b5697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:06.516419 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbea7c-5d44-4a61-8c7e-83e3181b5697 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:06.516781 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbea7c-5d44-4a61-8c7e-83e3181b5697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:06.517185 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cbea7c-5d44-4a61-8c7e-83e3181b5697 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:06.517980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbea7c-5d44-4a61-8c7e-83e3181b5697 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:06.520005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cbea7c-5d44-4a61-8c7e-83e3181b5697 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:06.623595 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1195/2397] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:01:06 2022] POST /identity/v3/projects => generated 363 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:01:06.625817 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e772a-b7aa-4fcf-8f87-af87c4c0027c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:06.637678 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e772a-b7aa-4fcf-8f87-af87c4c0027c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:06.698188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5fc76-53f2-4f82-8ef3-6aad61e88a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:06.698864 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5fc76-53f2-4f82-8ef3-6aad61e88a51 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:06.699152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5fc76-53f2-4f82-8ef3-6aad61e88a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:06.699427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5fc76-53f2-4f82-8ef3-6aad61e88a51 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:06.700755 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5fc76-53f2-4f82-8ef3-6aad61e88a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:06.702721 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c5fc76-53f2-4f82-8ef3-6aad61e88a51 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:06.784346 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1203/2398] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:01:06 2022] POST /identity/v3/users => generated 282 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:01:06.788615 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbea7c-5d44-4a61-8c7e-83e3181b5697 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:06.799683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cbea7c-5d44-4a61-8c7e-83e3181b5697 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:06.804734 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee31e5-8763-46c4-a5ab-0677daac7ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:06.805442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee31e5-8763-46c4-a5ab-0677daac7ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:06.805733 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee31e5-8763-46c4-a5ab-0677daac7ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:06.806017 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee31e5-8763-46c4-a5ab-0677daac7ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:06.806755 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee31e5-8763-46c4-a5ab-0677daac7ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:06.808355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ee31e5-8763-46c4-a5ab-0677daac7ee4 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:06.818747 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1196/2399] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:01:06.823387 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5fc76-53f2-4f82-8ef3-6aad61e88a51 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:06.834630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5fc76-53f2-4f82-8ef3-6aad61e88a51 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:06.839184 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537525ed-8020-47fb-9555-d49b7c96234f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:06.839865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537525ed-8020-47fb-9555-d49b7c96234f admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:06.840785 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537525ed-8020-47fb-9555-d49b7c96234f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:06.841109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537525ed-8020-47fb-9555-d49b7c96234f admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:06.841858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537525ed-8020-47fb-9555-d49b7c96234f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:06.843476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537525ed-8020-47fb-9555-d49b7c96234f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:06.857253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1204/2400] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:01:06.861771 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee31e5-8763-46c4-a5ab-0677daac7ee4 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:06.873690 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee31e5-8763-46c4-a5ab-0677daac7ee4 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:06.878800 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e70a2-3ce7-4ed8-9cca-ae6e2df81619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:06.879709 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e70a2-3ce7-4ed8-9cca-ae6e2df81619 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:06.880086 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e70a2-3ce7-4ed8-9cca-ae6e2df81619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:06.880486 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e70a2-3ce7-4ed8-9cca-ae6e2df81619 admin admin] PATH_INFO: `/v3/projects/7f0b607cdb864b31a12d493401e81c5c/users/a82379857bff47b0b2becd4b858a8f0d/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:06.897401 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e70a2-3ce7-4ed8-9cca-ae6e2df81619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f0b607cdb864b31a12d493401e81c5c, user_id=a82379857bff47b0b2becd4b858a8f0d, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:06.900433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e70a2-3ce7-4ed8-9cca-ae6e2df81619 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:07.025521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1197/2401] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:01:06 2022] PUT /identity/v3/projects/7f0b607cdb864b31a12d493401e81c5c/users/a82379857bff47b0b2becd4b858a8f0d/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:07.038513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169190ad-2c02-497d-85a7-c1908ed1a80f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:07.039552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169190ad-2c02-497d-85a7-c1908ed1a80f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:07.039924 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169190ad-2c02-497d-85a7-c1908ed1a80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:07.048745 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:07.070039 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-169190ad-2c02-497d-85a7-c1908ed1a80f None None] MFA Rules not processed for user `a82379857bff47b0b2becd4b858a8f0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:07.071388 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-169190ad-2c02-497d-85a7-c1908ed1a80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:07.138557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1205/2402] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:01:07 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:07.149982 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e70a2-3ce7-4ed8-9cca-ae6e2df81619 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:07.151753 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b55e70a2-3ce7-4ed8-9cca-ae6e2df81619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:07.158138 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:07.216220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e70a2-3ce7-4ed8-9cca-ae6e2df81619 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:07.219879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb84702-fdc0-4cb7-83fc-fbfa1d92033e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:07.220574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb84702-fdc0-4cb7-83fc-fbfa1d92033e service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:07.220862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb84702-fdc0-4cb7-83fc-fbfa1d92033e service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:07.221239 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb84702-fdc0-4cb7-83fc-fbfa1d92033e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:07.230251 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb84702-fdc0-4cb7-83fc-fbfa1d92033e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:07.232069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb84702-fdc0-4cb7-83fc-fbfa1d92033e service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:07.241583 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1198/2403] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:07 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:11.134829 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169190ad-2c02-497d-85a7-c1908ed1a80f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:11.144917 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169190ad-2c02-497d-85a7-c1908ed1a80f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:11.148653 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a908388-ac6e-4ef4-a857-169a1a280e94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:11.149347 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a908388-ac6e-4ef4-a857-169a1a280e94 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:11.154853 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a908388-ac6e-4ef4-a857-169a1a280e94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:11.154853 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a908388-ac6e-4ef4-a857-169a1a280e94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:11.154853 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4a908388-ac6e-4ef4-a857-169a1a280e94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:11.241878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a908388-ac6e-4ef4-a857-169a1a280e94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:11.243390 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a908388-ac6e-4ef4-a857-169a1a280e94 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:11.256215 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1206/2404] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:13.800893 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb84702-fdc0-4cb7-83fc-fbfa1d92033e service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:13.802683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0fb84702-fdc0-4cb7-83fc-fbfa1d92033e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:13.861155 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb84702-fdc0-4cb7-83fc-fbfa1d92033e service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:13.864730 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09fe65-460d-4134-804f-382c8f1f975e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:13.865423 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09fe65-460d-4134-804f-382c8f1f975e service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:13.865707 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09fe65-460d-4134-804f-382c8f1f975e service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:13.865983 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09fe65-460d-4134-804f-382c8f1f975e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:13.867784 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fb09fe65-460d-4134-804f-382c8f1f975e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:13.881630 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09fe65-460d-4134-804f-382c8f1f975e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:13.883065 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09fe65-460d-4134-804f-382c8f1f975e service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:13.894684 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1199/2405] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:14.033570 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a908388-ac6e-4ef4-a857-169a1a280e94 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:14.041040 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a908388-ac6e-4ef4-a857-169a1a280e94 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:14.050259 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa7111-7557-49f9-b1f3-ff16a5c2770f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:14.051012 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa7111-7557-49f9-b1f3-ff16a5c2770f service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:14.051379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa7111-7557-49f9-b1f3-ff16a5c2770f service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:14.051662 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa7111-7557-49f9-b1f3-ff16a5c2770f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:14.063747 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-47aa7111-7557-49f9-b1f3-ff16a5c2770f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:14.148740 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa7111-7557-49f9-b1f3-ff16a5c2770f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:14.150759 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aa7111-7557-49f9-b1f3-ff16a5c2770f service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:14.166122 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1207/2406] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:15.079846 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b9f83-12ee-4260-8e96-481e1079d32c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:15.080932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b9f83-12ee-4260-8e96-481e1079d32c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:15.081557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757b9f83-12ee-4260-8e96-481e1079d32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:15.102583 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-757b9f83-12ee-4260-8e96-481e1079d32c None None] MFA Rules not processed for user `ff65e481807b4344897b1499cd450f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:15.103852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-757b9f83-12ee-4260-8e96-481e1079d32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:15.226388 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1200/2407] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 17:01:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:15.233941 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa7111-7557-49f9-b1f3-ff16a5c2770f service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:15.235439 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-47aa7111-7557-49f9-b1f3-ff16a5c2770f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:15.262961 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:15.352786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa7111-7557-49f9-b1f3-ff16a5c2770f service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:15.358576 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac3930-0c29-4b9e-9af8-6dde91f0942b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bc0fa34b414328a342d685bc1eaca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:15.359987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac3930-0c29-4b9e-9af8-6dde91f0942b service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:15.360355 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac3930-0c29-4b9e-9af8-6dde91f0942b service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:15.360709 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac3930-0c29-4b9e-9af8-6dde91f0942b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:15.370371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac3930-0c29-4b9e-9af8-6dde91f0942b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:15.372187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac3930-0c29-4b9e-9af8-6dde91f0942b service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:15.382413 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1208/2408] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 17:01:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 17:01:15.634747 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b9f83-12ee-4260-8e96-481e1079d32c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:15.636639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-757b9f83-12ee-4260-8e96-481e1079d32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:15.651856 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757b9f83-12ee-4260-8e96-481e1079d32c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:15.656106 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633363b3-7e3d-4fe2-b8a3-440a5cdfb14c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:15.656805 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633363b3-7e3d-4fe2-b8a3-440a5cdfb14c service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:15.657133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633363b3-7e3d-4fe2-b8a3-440a5cdfb14c service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:15.657418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633363b3-7e3d-4fe2-b8a3-440a5cdfb14c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:15.659425 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-633363b3-7e3d-4fe2-b8a3-440a5cdfb14c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:15.789162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:15.827106 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633363b3-7e3d-4fe2-b8a3-440a5cdfb14c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:15.829193 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633363b3-7e3d-4fe2-b8a3-440a5cdfb14c service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:15.840715 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1201/2409] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:25.555106 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=26 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:25.920820 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=6 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:27.517603 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac3930-0c29-4b9e-9af8-6dde91f0942b service swift] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:27.520452 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f8ac3930-0c29-4b9e-9af8-6dde91f0942b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:27.578851 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac3930-0c29-4b9e-9af8-6dde91f0942b service swift] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:27.589419 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb4082-92a8-461c-adf4-2dc877445408 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:27.589419 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb4082-92a8-461c-adf4-2dc877445408 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:27.589419 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb4082-92a8-461c-adf4-2dc877445408 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:27.589419 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb4082-92a8-461c-adf4-2dc877445408 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:27.591569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-47eb4082-92a8-461c-adf4-2dc877445408 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:27.746677 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb4082-92a8-461c-adf4-2dc877445408 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:27.748856 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb4082-92a8-461c-adf4-2dc877445408 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:27.799733 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1209/2410] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:27.976200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc2c44-2477-459f-919a-5464667ba9b4 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:27.977189 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc2c44-2477-459f-919a-5464667ba9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:27.979101 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc2c44-2477-459f-919a-5464667ba9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:28.086473 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-cfcc2c44-2477-459f-919a-5464667ba9b4 None None] MFA Rules not processed for user `0cf277a2d03443c8af7a7bee2731d9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:28.087847 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-cfcc2c44-2477-459f-919a-5464667ba9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:28.172778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1202/2411] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:01:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:28.265550 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb4082-92a8-461c-adf4-2dc877445408 service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:28.267470 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-47eb4082-92a8-461c-adf4-2dc877445408 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:28.288638 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb4082-92a8-461c-adf4-2dc877445408 service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:28.295723 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e77dd4-bff5-446e-aef1-3a3b103d1bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:28.297207 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e77dd4-bff5-446e-aef1-3a3b103d1bc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:28.297670 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e77dd4-bff5-446e-aef1-3a3b103d1bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:28.298169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e77dd4-bff5-446e-aef1-3a3b103d1bc6 admin admin] PATH_INFO: `/v3/users/9011730621194d0e8165de381177bd2e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:28.299827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e77dd4-bff5-446e-aef1-3a3b103d1bc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9011730621194d0e8165de381177bd2e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:28.302146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e77dd4-bff5-446e-aef1-3a3b103d1bc6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:28.555896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f0e77dd4-bff5-446e-aef1-3a3b103d1bc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9011730621194d0e8165de381177bd2e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:28.663684 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f0e77dd4-bff5-446e-aef1-3a3b103d1bc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9011730621194d0e8165de381177bd2e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:28.678403 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f0e77dd4-bff5-446e-aef1-3a3b103d1bc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9011730621194d0e8165de381177bd2e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:28.679775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f0e77dd4-bff5-446e-aef1-3a3b103d1bc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9011730621194d0e8165de381177bd2e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:28.711893 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f0e77dd4-bff5-446e-aef1-3a3b103d1bc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9011730621194d0e8165de381177bd2e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:28.729766 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1210/2412] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:01:28 2022] DELETE /identity/v3/users/9011730621194d0e8165de381177bd2e => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:29.071174 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc2c44-2477-459f-919a-5464667ba9b4 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:29.130362 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc2c44-2477-459f-919a-5464667ba9b4 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:29.240555 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65eb7f3-0c7d-4a36-bfe8-49b0bad0b760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:29.241732 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65eb7f3-0c7d-4a36-bfe8-49b0bad0b760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:29.242113 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65eb7f3-0c7d-4a36-bfe8-49b0bad0b760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:29.242575 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65eb7f3-0c7d-4a36-bfe8-49b0bad0b760 admin admin] PATH_INFO: `/v3/projects/46abecf729dd426f9ffc02cee5d67150` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:29.244622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65eb7f3-0c7d-4a36-bfe8-49b0bad0b760 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46abecf729dd426f9ffc02cee5d67150)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:29.246809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65eb7f3-0c7d-4a36-bfe8-49b0bad0b760 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:29.886824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d65eb7f3-0c7d-4a36-bfe8-49b0bad0b760 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46abecf729dd426f9ffc02cee5d67150', 'request_id': 'req-d65eb7f3-0c7d-4a36-bfe8-49b0bad0b760'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:29.893143 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d65eb7f3-0c7d-4a36-bfe8-49b0bad0b760 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46abecf729dd426f9ffc02cee5d67150', 'request_id': 'req-d65eb7f3-0c7d-4a36-bfe8-49b0bad0b760'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:29.899443 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d65eb7f3-0c7d-4a36-bfe8-49b0bad0b760 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46abecf729dd426f9ffc02cee5d67150', 'request_id': 'req-d65eb7f3-0c7d-4a36-bfe8-49b0bad0b760'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:30.086918 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d65eb7f3-0c7d-4a36-bfe8-49b0bad0b760 admin admin] The token cache is being invalidate because project 46abecf729dd426f9ffc02cee5d67150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:01:30.088958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d65eb7f3-0c7d-4a36-bfe8-49b0bad0b760 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:30.088958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d65eb7f3-0c7d-4a36-bfe8-49b0bad0b760 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:30.094154 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1203/2413] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:01:29 2022] DELETE /identity/v3/projects/46abecf729dd426f9ffc02cee5d67150 => generated 0 bytes in 1021 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:30.095073 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e77dd4-bff5-446e-aef1-3a3b103d1bc6 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:30.096854 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f0e77dd4-bff5-446e-aef1-3a3b103d1bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:30.127220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e77dd4-bff5-446e-aef1-3a3b103d1bc6 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:30.182725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:30.212675 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182da93-c704-49ce-ac89-d7091915b191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:30.213593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182da93-c704-49ce-ac89-d7091915b191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:30.213875 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182da93-c704-49ce-ac89-d7091915b191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:30.214172 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182da93-c704-49ce-ac89-d7091915b191 admin admin] PATH_INFO: `/v3/users/76c26170fb5347659506326e3588469e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:30.216065 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182da93-c704-49ce-ac89-d7091915b191 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76c26170fb5347659506326e3588469e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:30.218388 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182da93-c704-49ce-ac89-d7091915b191 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:30.493605 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5182da93-c704-49ce-ac89-d7091915b191 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76c26170fb5347659506326e3588469e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:30.574699 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5182da93-c704-49ce-ac89-d7091915b191 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76c26170fb5347659506326e3588469e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:30.586050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5182da93-c704-49ce-ac89-d7091915b191 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76c26170fb5347659506326e3588469e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:30.586851 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5182da93-c704-49ce-ac89-d7091915b191 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76c26170fb5347659506326e3588469e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:30.606967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5182da93-c704-49ce-ac89-d7091915b191 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76c26170fb5347659506326e3588469e'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:30.615351 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1211/2414] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:01:30 2022] DELETE /identity/v3/users/76c26170fb5347659506326e3588469e => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:31.030674 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65eb7f3-0c7d-4a36-bfe8-49b0bad0b760 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:31.032388 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d65eb7f3-0c7d-4a36-bfe8-49b0bad0b760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:31.047397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65eb7f3-0c7d-4a36-bfe8-49b0bad0b760 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:31.067792 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:31.109228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92acc6-52b8-4444-a0e7-1eae0a259204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:31.110128 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92acc6-52b8-4444-a0e7-1eae0a259204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:31.110416 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92acc6-52b8-4444-a0e7-1eae0a259204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:31.110955 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92acc6-52b8-4444-a0e7-1eae0a259204 admin admin] PATH_INFO: `/v3/projects/93fc65b2ac524b219245858bbebb5ec1` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:31.112190 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92acc6-52b8-4444-a0e7-1eae0a259204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93fc65b2ac524b219245858bbebb5ec1)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:31.114224 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92acc6-52b8-4444-a0e7-1eae0a259204 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:31.258593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0e92acc6-52b8-4444-a0e7-1eae0a259204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93fc65b2ac524b219245858bbebb5ec1', 'request_id': 'req-0e92acc6-52b8-4444-a0e7-1eae0a259204'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:31.266785 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0e92acc6-52b8-4444-a0e7-1eae0a259204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93fc65b2ac524b219245858bbebb5ec1', 'request_id': 'req-0e92acc6-52b8-4444-a0e7-1eae0a259204'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:31.274120 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0e92acc6-52b8-4444-a0e7-1eae0a259204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93fc65b2ac524b219245858bbebb5ec1', 'request_id': 'req-0e92acc6-52b8-4444-a0e7-1eae0a259204'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:31.356878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0e92acc6-52b8-4444-a0e7-1eae0a259204 admin admin] The token cache is being invalidate because project 93fc65b2ac524b219245858bbebb5ec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:01:31.357506 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0e92acc6-52b8-4444-a0e7-1eae0a259204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:31.359401 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-0e92acc6-52b8-4444-a0e7-1eae0a259204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:01:31.360445 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1204/2415] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:01:31 2022] DELETE /identity/v3/projects/93fc65b2ac524b219245858bbebb5ec1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:01:39.179538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182da93-c704-49ce-ac89-d7091915b191 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:39.184637 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5182da93-c704-49ce-ac89-d7091915b191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:39.253157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182da93-c704-49ce-ac89-d7091915b191 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:39.305159 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ec2a2-08fc-4171-ab25-951cf2b42dc3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e1900754214020931b202e98f660a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:39.305820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ec2a2-08fc-4171-ab25-951cf2b42dc3 service glance] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:39.306109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ec2a2-08fc-4171-ab25-951cf2b42dc3 service glance] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:39.306520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ec2a2-08fc-4171-ab25-951cf2b42dc3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:39.308347 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1d6ec2a2-08fc-4171-ab25-951cf2b42dc3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:39.340862 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:39.382828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ec2a2-08fc-4171-ab25-951cf2b42dc3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:39.384280 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ec2a2-08fc-4171-ab25-951cf2b42dc3 service glance] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:39.396766 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1212/2416] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:39.621490 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92acc6-52b8-4444-a0e7-1eae0a259204 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:39.623100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0e92acc6-52b8-4444-a0e7-1eae0a259204 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:39.684922 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92acc6-52b8-4444-a0e7-1eae0a259204 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:39.688818 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04f072-4fa3-4aa2-acdd-b5e5eed63f8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:39.689626 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04f072-4fa3-4aa2-acdd-b5e5eed63f8d service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:39.690065 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04f072-4fa3-4aa2-acdd-b5e5eed63f8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:39.690345 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04f072-4fa3-4aa2-acdd-b5e5eed63f8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:39.692199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ee04f072-4fa3-4aa2-acdd-b5e5eed63f8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:39.702740 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04f072-4fa3-4aa2-acdd-b5e5eed63f8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:39.704164 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04f072-4fa3-4aa2-acdd-b5e5eed63f8d service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:39.713018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1205/2417] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:39.794157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ec2a2-08fc-4171-ab25-951cf2b42dc3 service glance] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:39.796265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1d6ec2a2-08fc-4171-ab25-951cf2b42dc3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:39.809278 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ec2a2-08fc-4171-ab25-951cf2b42dc3 service glance] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:39.813901 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45316fe7-bcc1-423d-beba-4832c496be18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:39.815369 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45316fe7-bcc1-423d-beba-4832c496be18 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:39.815369 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45316fe7-bcc1-423d-beba-4832c496be18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:39.815369 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45316fe7-bcc1-423d-beba-4832c496be18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:39.816935 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-45316fe7-bcc1-423d-beba-4832c496be18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:39.832064 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45316fe7-bcc1-423d-beba-4832c496be18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:39.833617 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45316fe7-bcc1-423d-beba-4832c496be18 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:39.845617 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1213/2418] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:01:41.969090 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04f072-4fa3-4aa2-acdd-b5e5eed63f8d service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:41.977939 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04f072-4fa3-4aa2-acdd-b5e5eed63f8d service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:41.982515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad4481-ed0a-4a01-ab74-c05176c6d1e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:41.983180 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad4481-ed0a-4a01-ab74-c05176c6d1e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:41.983461 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad4481-ed0a-4a01-ab74-c05176c6d1e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:41.983738 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad4481-ed0a-4a01-ab74-c05176c6d1e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:41.985953 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ccad4481-ed0a-4a01-ab74-c05176c6d1e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:41.997184 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad4481-ed0a-4a01-ab74-c05176c6d1e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:41.999211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad4481-ed0a-4a01-ab74-c05176c6d1e5 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:42.008372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1206/2419] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:01:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:01:43.150581 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef58f6-5bfa-4f87-9dfe-c1a3ead2fdb9 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:43.151431 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef58f6-5bfa-4f87-9dfe-c1a3ead2fdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:43.151431 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ef58f6-5bfa-4f87-9dfe-c1a3ead2fdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:43.210512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-50ef58f6-5bfa-4f87-9dfe-c1a3ead2fdb9 None None] MFA Rules not processed for user `ff65e481807b4344897b1499cd450f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:01:43.211724 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-50ef58f6-5bfa-4f87-9dfe-c1a3ead2fdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:43.282438 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1214/2420] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 17:01:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:01:43.294639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad4481-ed0a-4a01-ab74-c05176c6d1e5 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:01:43.296075 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ccad4481-ed0a-4a01-ab74-c05176c6d1e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:01:43.339394 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:43.401821 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad4481-ed0a-4a01-ab74-c05176c6d1e5 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:01:43.407854 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32711391-ea90-4c3a-80e5-0a6c27c5f5d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bc0fa34b414328a342d685bc1eaca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:01:43.408533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32711391-ea90-4c3a-80e5-0a6c27c5f5d6 service swift] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:01:43.408822 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32711391-ea90-4c3a-80e5-0a6c27c5f5d6 service swift] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:01:43.409139 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32711391-ea90-4c3a-80e5-0a6c27c5f5d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:01:43.418192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32711391-ea90-4c3a-80e5-0a6c27c5f5d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:01:43.420449 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32711391-ea90-4c3a-80e5-0a6c27c5f5d6 service swift] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:01:43.429647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1207/2421] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 17:01:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 17:01:53.279171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=65 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:01:53.453840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=25 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:11.695504 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef58f6-5bfa-4f87-9dfe-c1a3ead2fdb9 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:11.696961 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-50ef58f6-5bfa-4f87-9dfe-c1a3ead2fdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:11.769884 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ef58f6-5bfa-4f87-9dfe-c1a3ead2fdb9 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:11.774540 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43847378-08b0-4b16-9103-d516df73cf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:11.775551 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43847378-08b0-4b16-9103-d516df73cf11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:11.775842 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43847378-08b0-4b16-9103-d516df73cf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:11.776127 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43847378-08b0-4b16-9103-d516df73cf11 admin admin] PATH_INFO: `/v3/users/a82379857bff47b0b2becd4b858a8f0d` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:11.777418 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43847378-08b0-4b16-9103-d516df73cf11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a82379857bff47b0b2becd4b858a8f0d)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:11.779396 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43847378-08b0-4b16-9103-d516df73cf11 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:12.006746 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-43847378-08b0-4b16-9103-d516df73cf11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a82379857bff47b0b2becd4b858a8f0d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:12.083662 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-43847378-08b0-4b16-9103-d516df73cf11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a82379857bff47b0b2becd4b858a8f0d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:12.091658 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-43847378-08b0-4b16-9103-d516df73cf11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a82379857bff47b0b2becd4b858a8f0d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:12.092426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-43847378-08b0-4b16-9103-d516df73cf11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a82379857bff47b0b2becd4b858a8f0d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:12.105919 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-43847378-08b0-4b16-9103-d516df73cf11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a82379857bff47b0b2becd4b858a8f0d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:12.116716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1215/2422] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:02:11 2022] DELETE /identity/v3/users/a82379857bff47b0b2becd4b858a8f0d => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:02:12.118434 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7be2e5-38c5-46c7-82b1-beacab960722 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:12.118955 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7be2e5-38c5-46c7-82b1-beacab960722 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:12.119071 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7be2e5-38c5-46c7-82b1-beacab960722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:12.138692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-6e7be2e5-38c5-46c7-82b1-beacab960722 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:02:12.140007 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6e7be2e5-38c5-46c7-82b1-beacab960722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:12.209205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1208/2423] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:02:12.221769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43847378-08b0-4b16-9103-d516df73cf11 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:12.223334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-43847378-08b0-4b16-9103-d516df73cf11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:12.288342 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43847378-08b0-4b16-9103-d516df73cf11 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:12.292149 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd984b-7f79-4523-a23c-686e3d4db73a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:12.292805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd984b-7f79-4523-a23c-686e3d4db73a service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:12.293121 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd984b-7f79-4523-a23c-686e3d4db73a service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:12.293406 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd984b-7f79-4523-a23c-686e3d4db73a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:12.303538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd984b-7f79-4523-a23c-686e3d4db73a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:12.304986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd984b-7f79-4523-a23c-686e3d4db73a service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:12.317074 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1216/2424] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:02:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:02:12.740662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7be2e5-38c5-46c7-82b1-beacab960722 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:12.742799 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6e7be2e5-38c5-46c7-82b1-beacab960722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:12.757445 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7be2e5-38c5-46c7-82b1-beacab960722 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:12.762277 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9be12c-a810-495e-a288-d3a200af30ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:12.766332 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9be12c-a810-495e-a288-d3a200af30ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:12.766754 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9be12c-a810-495e-a288-d3a200af30ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:12.767037 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9be12c-a810-495e-a288-d3a200af30ae admin admin] PATH_INFO: `/v3/projects/7f0b607cdb864b31a12d493401e81c5c` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:12.768477 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9be12c-a810-495e-a288-d3a200af30ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f0b607cdb864b31a12d493401e81c5c)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:12.770651 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9be12c-a810-495e-a288-d3a200af30ae admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:12.907570 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-bd9be12c-a810-495e-a288-d3a200af30ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f0b607cdb864b31a12d493401e81c5c', 'request_id': 'req-bd9be12c-a810-495e-a288-d3a200af30ae'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:12.915218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-bd9be12c-a810-495e-a288-d3a200af30ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f0b607cdb864b31a12d493401e81c5c', 'request_id': 'req-bd9be12c-a810-495e-a288-d3a200af30ae'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:12.925075 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-bd9be12c-a810-495e-a288-d3a200af30ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f0b607cdb864b31a12d493401e81c5c', 'request_id': 'req-bd9be12c-a810-495e-a288-d3a200af30ae'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:13.045607 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-bd9be12c-a810-495e-a288-d3a200af30ae admin admin] The token cache is being invalidate because project 7f0b607cdb864b31a12d493401e81c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:02:13.046169 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-bd9be12c-a810-495e-a288-d3a200af30ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:13.046917 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-bd9be12c-a810-495e-a288-d3a200af30ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:13.048826 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1209/2425] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:02:12 2022] DELETE /identity/v3/projects/7f0b607cdb864b31a12d493401e81c5c => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:02:13.053987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bd1b0-fefd-4587-87b6-6cd43dafc41d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:13.054513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bd1b0-fefd-4587-87b6-6cd43dafc41d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:13.054617 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3bd1b0-fefd-4587-87b6-6cd43dafc41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:13.072920 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-7e3bd1b0-fefd-4587-87b6-6cd43dafc41d None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:02:13.074158 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7e3bd1b0-fefd-4587-87b6-6cd43dafc41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:13.094167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:13.138882 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1217/2426] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:02:13.152166 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a7e57-24fd-4eb8-a11c-69b54a2bec52 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:13.152699 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a7e57-24fd-4eb8-a11c-69b54a2bec52 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:13.158405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a7e57-24fd-4eb8-a11c-69b54a2bec52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:13.183069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a31a7e57-24fd-4eb8-a11c-69b54a2bec52 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:02:13.187106 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a31a7e57-24fd-4eb8-a11c-69b54a2bec52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:13.194003 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1210/2427] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:02:13.198422 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bd1b0-fefd-4587-87b6-6cd43dafc41d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:13.210276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3bd1b0-fefd-4587-87b6-6cd43dafc41d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:13.215453 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7842a-6b35-405d-9cb1-b36235d75b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:13.216278 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7842a-6b35-405d-9cb1-b36235d75b01 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:13.216593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7842a-6b35-405d-9cb1-b36235d75b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:13.216922 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc7842a-6b35-405d-9cb1-b36235d75b01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:13.217712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7842a-6b35-405d-9cb1-b36235d75b01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:02:13.218029 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7842a-6b35-405d-9cb1-b36235d75b01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:13.219839 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc7842a-6b35-405d-9cb1-b36235d75b01 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:13.237094 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1218/2428] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:02:13.239560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a7e57-24fd-4eb8-a11c-69b54a2bec52 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:13.250562 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a7e57-24fd-4eb8-a11c-69b54a2bec52 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:13.262382 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c3be0-14bc-4e6e-9fa0-b6295d9fa933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:13.263134 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c3be0-14bc-4e6e-9fa0-b6295d9fa933 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:13.264544 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c3be0-14bc-4e6e-9fa0-b6295d9fa933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:13.265241 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331c3be0-14bc-4e6e-9fa0-b6295d9fa933 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:13.266227 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c3be0-14bc-4e6e-9fa0-b6295d9fa933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:13.269948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331c3be0-14bc-4e6e-9fa0-b6295d9fa933 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:13.360751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1211/2429] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:02:13 2022] POST /identity/v3/projects => generated 397 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:02:13.361900 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7842a-6b35-405d-9cb1-b36235d75b01 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:13.372243 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc7842a-6b35-405d-9cb1-b36235d75b01 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:13.435310 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364e519-7a59-44e2-ba88-d0ccb2cc5e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:13.436845 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364e519-7a59-44e2-ba88-d0ccb2cc5e57 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:13.437177 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364e519-7a59-44e2-ba88-d0ccb2cc5e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:13.437456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364e519-7a59-44e2-ba88-d0ccb2cc5e57 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:13.438180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364e519-7a59-44e2-ba88-d0ccb2cc5e57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:13.440155 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364e519-7a59-44e2-ba88-d0ccb2cc5e57 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:13.530502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1219/2430] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:02:13 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:02:13.531683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c3be0-14bc-4e6e-9fa0-b6295d9fa933 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:13.544550 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331c3be0-14bc-4e6e-9fa0-b6295d9fa933 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:13.551707 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa08c7-2e9c-4d4b-b9b0-3f1aa85df09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:13.552413 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa08c7-2e9c-4d4b-b9b0-3f1aa85df09f admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:13.552788 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa08c7-2e9c-4d4b-b9b0-3f1aa85df09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:13.553081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efa08c7-2e9c-4d4b-b9b0-3f1aa85df09f admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:13.554031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa08c7-2e9c-4d4b-b9b0-3f1aa85df09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:13.555690 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efa08c7-2e9c-4d4b-b9b0-3f1aa85df09f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:13.568199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1212/2431] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:02:13.572286 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364e519-7a59-44e2-ba88-d0ccb2cc5e57 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:13.584330 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364e519-7a59-44e2-ba88-d0ccb2cc5e57 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:13.589316 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aab5ba-af1e-49ec-85f8-bbd9db1ed9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:13.589996 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aab5ba-af1e-49ec-85f8-bbd9db1ed9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:13.590275 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aab5ba-af1e-49ec-85f8-bbd9db1ed9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:13.590557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aab5ba-af1e-49ec-85f8-bbd9db1ed9d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:13.591467 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aab5ba-af1e-49ec-85f8-bbd9db1ed9d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:13.593807 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aab5ba-af1e-49ec-85f8-bbd9db1ed9d3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:13.608930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1220/2432] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:02:13.610591 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa08c7-2e9c-4d4b-b9b0-3f1aa85df09f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:13.621333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efa08c7-2e9c-4d4b-b9b0-3f1aa85df09f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:13.626858 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96756a85-6645-4a26-8a97-3d4e8e1d11e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:13.627846 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96756a85-6645-4a26-8a97-3d4e8e1d11e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:13.629272 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96756a85-6645-4a26-8a97-3d4e8e1d11e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:13.629272 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96756a85-6645-4a26-8a97-3d4e8e1d11e4 admin admin] PATH_INFO: `/v3/projects/ffe47b0ecfce4d17abbae730a16f31f5/users/003dfed16b1142e0aba3f88918f47fe9/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:13.646383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96756a85-6645-4a26-8a97-3d4e8e1d11e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffe47b0ecfce4d17abbae730a16f31f5, user_id=003dfed16b1142e0aba3f88918f47fe9, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:13.649149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96756a85-6645-4a26-8a97-3d4e8e1d11e4 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:13.728925 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1213/2433] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:02:13 2022] PUT /identity/v3/projects/ffe47b0ecfce4d17abbae730a16f31f5/users/003dfed16b1142e0aba3f88918f47fe9/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:02:13.743490 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a95a6-3f0e-460b-ac18-084313acfc3c None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:13.744042 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a95a6-3f0e-460b-ac18-084313acfc3c None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:13.744418 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a95a6-3f0e-460b-ac18-084313acfc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:13.784005 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-211a95a6-3f0e-460b-ac18-084313acfc3c None None] MFA Rules not processed for user `003dfed16b1142e0aba3f88918f47fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:02:13.785299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-211a95a6-3f0e-460b-ac18-084313acfc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:13.858827 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1221/2434] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:02:13 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:02:13.871463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96756a85-6645-4a26-8a97-3d4e8e1d11e4 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:13.873200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-96756a85-6645-4a26-8a97-3d4e8e1d11e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:13.895975 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:13.937982 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96756a85-6645-4a26-8a97-3d4e8e1d11e4 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:13.943230 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75bb42-4155-487e-abbe-4e6fb6648318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:13.944021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75bb42-4155-487e-abbe-4e6fb6648318 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:13.944304 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75bb42-4155-487e-abbe-4e6fb6648318 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:13.944581 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75bb42-4155-487e-abbe-4e6fb6648318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:13.956698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75bb42-4155-487e-abbe-4e6fb6648318 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:13.958267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75bb42-4155-487e-abbe-4e6fb6648318 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:13.969268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1214/2435] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:02:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:02:16.805995 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01069599-3060-4410-95bf-285e5c99904d None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:16.806791 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01069599-3060-4410-95bf-285e5c99904d None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:16.806791 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01069599-3060-4410-95bf-285e5c99904d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:16.827596 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-01069599-3060-4410-95bf-285e5c99904d None None] MFA Rules not processed for user `ff65e481807b4344897b1499cd450f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:02:16.830389 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-01069599-3060-4410-95bf-285e5c99904d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:16.844232 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:16.893829 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1222/2436] 10.222.0.76 () {58 vars in 967 bytes} [Mon Jul 18 17:02:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:02:16.907006 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75bb42-4155-487e-abbe-4e6fb6648318 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:16.908447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9e75bb42-4155-487e-abbe-4e6fb6648318 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:16.983537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75bb42-4155-487e-abbe-4e6fb6648318 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:16.991168 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea88d3f-fd15-458d-b9ad-7b524ef2afcd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bc0fa34b414328a342d685bc1eaca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:16.991839 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea88d3f-fd15-458d-b9ad-7b524ef2afcd service swift] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:16.992129 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea88d3f-fd15-458d-b9ad-7b524ef2afcd service swift] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:16.992441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea88d3f-fd15-458d-b9ad-7b524ef2afcd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:17.001678 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea88d3f-fd15-458d-b9ad-7b524ef2afcd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:17.003359 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea88d3f-fd15-458d-b9ad-7b524ef2afcd service swift] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:17.011533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1215/2437] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 17:02:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 17:02:26.205352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01069599-3060-4410-95bf-285e5c99904d None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:26.268861 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01069599-3060-4410-95bf-285e5c99904d None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:26.274916 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c3ce3-c67a-45f0-812b-f614407ab0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:26.275796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c3ce3-c67a-45f0-812b-f614407ab0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:26.276086 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c3ce3-c67a-45f0-812b-f614407ab0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:26.276366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c3ce3-c67a-45f0-812b-f614407ab0e8 admin admin] PATH_INFO: `/v3/users/003dfed16b1142e0aba3f88918f47fe9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:26.277607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c3ce3-c67a-45f0-812b-f614407ab0e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=003dfed16b1142e0aba3f88918f47fe9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:26.279550 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9c3ce3-c67a-45f0-812b-f614407ab0e8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:26.468679 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1c9c3ce3-c67a-45f0-812b-f614407ab0e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '003dfed16b1142e0aba3f88918f47fe9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:26.540686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1c9c3ce3-c67a-45f0-812b-f614407ab0e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '003dfed16b1142e0aba3f88918f47fe9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:26.549194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1c9c3ce3-c67a-45f0-812b-f614407ab0e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '003dfed16b1142e0aba3f88918f47fe9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:26.549987 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1c9c3ce3-c67a-45f0-812b-f614407ab0e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '003dfed16b1142e0aba3f88918f47fe9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:26.562520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1c9c3ce3-c67a-45f0-812b-f614407ab0e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '003dfed16b1142e0aba3f88918f47fe9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:26.568964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1223/2438] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:02:26 2022] DELETE /identity/v3/users/003dfed16b1142e0aba3f88918f47fe9 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:02:26.573708 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587179e-fd71-4352-b214-eee1f18aa1e5 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:26.574172 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587179e-fd71-4352-b214-eee1f18aa1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:26.574293 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587179e-fd71-4352-b214-eee1f18aa1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:26.591735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d587179e-fd71-4352-b214-eee1f18aa1e5 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:02:26.593842 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d587179e-fd71-4352-b214-eee1f18aa1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:26.654391 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1216/2439] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:02:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:02:26.665160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c3ce3-c67a-45f0-812b-f614407ab0e8 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:26.666602 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1c9c3ce3-c67a-45f0-812b-f614407ab0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:26.714953 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:26.730236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c3ce3-c67a-45f0-812b-f614407ab0e8 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:26.733958 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429ae67-203e-499a-b8a4-f6e9a9f66fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:26.734618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429ae67-203e-499a-b8a4-f6e9a9f66fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:26.734908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429ae67-203e-499a-b8a4-f6e9a9f66fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:26.735433 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9429ae67-203e-499a-b8a4-f6e9a9f66fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:26.746117 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429ae67-203e-499a-b8a4-f6e9a9f66fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:26.747561 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9429ae67-203e-499a-b8a4-f6e9a9f66fa1 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:26.757130 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1224/2440] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:02:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:02:27.194247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587179e-fd71-4352-b214-eee1f18aa1e5 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:02:27.196673 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d587179e-fd71-4352-b214-eee1f18aa1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:02:27.209985 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587179e-fd71-4352-b214-eee1f18aa1e5 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:02:27.214662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf523e3-6b3b-4361-a14b-bda85901ccdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:02:27.215547 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf523e3-6b3b-4361-a14b-bda85901ccdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:02:27.215835 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf523e3-6b3b-4361-a14b-bda85901ccdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:02:27.216114 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf523e3-6b3b-4361-a14b-bda85901ccdc admin admin] PATH_INFO: `/v3/projects/ffe47b0ecfce4d17abbae730a16f31f5` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:02:27.217353 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf523e3-6b3b-4361-a14b-bda85901ccdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffe47b0ecfce4d17abbae730a16f31f5)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:02:27.219289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf523e3-6b3b-4361-a14b-bda85901ccdc admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:02:27.334471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:27.335751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-aaf523e3-6b3b-4361-a14b-bda85901ccdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffe47b0ecfce4d17abbae730a16f31f5', 'request_id': 'req-aaf523e3-6b3b-4361-a14b-bda85901ccdc'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:27.341538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-aaf523e3-6b3b-4361-a14b-bda85901ccdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffe47b0ecfce4d17abbae730a16f31f5', 'request_id': 'req-aaf523e3-6b3b-4361-a14b-bda85901ccdc'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:27.348398 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-aaf523e3-6b3b-4361-a14b-bda85901ccdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffe47b0ecfce4d17abbae730a16f31f5', 'request_id': 'req-aaf523e3-6b3b-4361-a14b-bda85901ccdc'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:27.414809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-aaf523e3-6b3b-4361-a14b-bda85901ccdc admin admin] The token cache is being invalidate because project ffe47b0ecfce4d17abbae730a16f31f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:02:27.415391 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-aaf523e3-6b3b-4361-a14b-bda85901ccdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:27.416366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-aaf523e3-6b3b-4361-a14b-bda85901ccdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:02:27.417974 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1217/2441] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:02:27 2022] DELETE /identity/v3/projects/ffe47b0ecfce4d17abbae730a16f31f5 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:02:36.808723 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=7 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:02:37.416475 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=7,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:05.480875 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429ae67-203e-499a-b8a4-f6e9a9f66fa1 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:05.482461 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9429ae67-203e-499a-b8a4-f6e9a9f66fa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:05.564086 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9429ae67-203e-499a-b8a4-f6e9a9f66fa1 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:05.639557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc27c8-9c21-441b-a141-b40e4242c433 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:05.640932 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc27c8-9c21-441b-a141-b40e4242c433 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:05.641257 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc27c8-9c21-441b-a141-b40e4242c433 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:05.641598 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc27c8-9c21-441b-a141-b40e4242c433 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:05.643434 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-76cc27c8-9c21-441b-a141-b40e4242c433 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:05.657924 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc27c8-9c21-441b-a141-b40e4242c433 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:05.659761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc27c8-9c21-441b-a141-b40e4242c433 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:05.672536 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1225/2442] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:03:08.419131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf523e3-6b3b-4361-a14b-bda85901ccdc admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:08.420628 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-aaf523e3-6b3b-4361-a14b-bda85901ccdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:08.483134 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf523e3-6b3b-4361-a14b-bda85901ccdc admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:08.486967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa5016-738a-4764-b7cc-939b308e0317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:08.487615 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa5016-738a-4764-b7cc-939b308e0317 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:08.487898 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa5016-738a-4764-b7cc-939b308e0317 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:08.488170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa5016-738a-4764-b7cc-939b308e0317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:08.489971 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-17fa5016-738a-4764-b7cc-939b308e0317 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:08.568642 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa5016-738a-4764-b7cc-939b308e0317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:08.570114 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa5016-738a-4764-b7cc-939b308e0317 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:08.589099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1218/2443] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:03:12.560087 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc27c8-9c21-441b-a141-b40e4242c433 service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:12.561595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-76cc27c8-9c21-441b-a141-b40e4242c433 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:12.620582 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc27c8-9c21-441b-a141-b40e4242c433 service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:12.624352 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd24b32-3186-4913-9bfc-1647b360c49b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:12.625103 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd24b32-3186-4913-9bfc-1647b360c49b service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:12.625592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd24b32-3186-4913-9bfc-1647b360c49b service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:12.626053 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd24b32-3186-4913-9bfc-1647b360c49b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:12.628160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7cd24b32-3186-4913-9bfc-1647b360c49b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:12.670947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:12.695575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd24b32-3186-4913-9bfc-1647b360c49b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:12.697186 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd24b32-3186-4913-9bfc-1647b360c49b service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:12.708427 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1226/2444] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:03:16.597329 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa5016-738a-4764-b7cc-939b308e0317 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:16.597329 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-17fa5016-738a-4764-b7cc-939b308e0317 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:16.611594 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa5016-738a-4764-b7cc-939b308e0317 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:16.619944 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca222df-ed12-47a2-a354-c6841e00bfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:16.619944 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca222df-ed12-47a2-a354-c6841e00bfa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:16.619944 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca222df-ed12-47a2-a354-c6841e00bfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:16.619944 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca222df-ed12-47a2-a354-c6841e00bfa4 admin admin] PATH_INFO: `/v3/users/7b98162f0ce8462fa1a20871ab1a6560` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:16.620614 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca222df-ed12-47a2-a354-c6841e00bfa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b98162f0ce8462fa1a20871ab1a6560)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:16.621740 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca222df-ed12-47a2-a354-c6841e00bfa4 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:16.821482 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8ca222df-ed12-47a2-a354-c6841e00bfa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b98162f0ce8462fa1a20871ab1a6560'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:16.904886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8ca222df-ed12-47a2-a354-c6841e00bfa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b98162f0ce8462fa1a20871ab1a6560'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:16.913641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8ca222df-ed12-47a2-a354-c6841e00bfa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b98162f0ce8462fa1a20871ab1a6560'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:16.914397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8ca222df-ed12-47a2-a354-c6841e00bfa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b98162f0ce8462fa1a20871ab1a6560'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:16.929197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8ca222df-ed12-47a2-a354-c6841e00bfa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b98162f0ce8462fa1a20871ab1a6560'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:16.930962 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:16.937034 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1219/2445] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:03:16 2022] DELETE /identity/v3/users/7b98162f0ce8462fa1a20871ab1a6560 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:17.232925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd24b32-3186-4913-9bfc-1647b360c49b service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:17.244522 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd24b32-3186-4913-9bfc-1647b360c49b service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:17.308532 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67a96e-8a71-4c88-8a3d-a701ae0c0d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:17.309441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67a96e-8a71-4c88-8a3d-a701ae0c0d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:17.309732 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67a96e-8a71-4c88-8a3d-a701ae0c0d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:17.310015 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67a96e-8a71-4c88-8a3d-a701ae0c0d4a admin admin] PATH_INFO: `/v3/projects/d713a57b50cf4fe3b0fc1bd63cb761fd` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:17.311224 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67a96e-8a71-4c88-8a3d-a701ae0c0d4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d713a57b50cf4fe3b0fc1bd63cb761fd)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:17.313794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67a96e-8a71-4c88-8a3d-a701ae0c0d4a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:17.444160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fb67a96e-8a71-4c88-8a3d-a701ae0c0d4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'request_id': 'req-fb67a96e-8a71-4c88-8a3d-a701ae0c0d4a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:17.451081 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fb67a96e-8a71-4c88-8a3d-a701ae0c0d4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'request_id': 'req-fb67a96e-8a71-4c88-8a3d-a701ae0c0d4a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:17.458070 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fb67a96e-8a71-4c88-8a3d-a701ae0c0d4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd713a57b50cf4fe3b0fc1bd63cb761fd', 'request_id': 'req-fb67a96e-8a71-4c88-8a3d-a701ae0c0d4a'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:17.510475 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fb67a96e-8a71-4c88-8a3d-a701ae0c0d4a admin admin] The token cache is being invalidate because project d713a57b50cf4fe3b0fc1bd63cb761fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:03:17.510753 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fb67a96e-8a71-4c88-8a3d-a701ae0c0d4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:17.511412 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fb67a96e-8a71-4c88-8a3d-a701ae0c0d4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:17.513045 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1227/2446] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:03:17 2022] DELETE /identity/v3/projects/d713a57b50cf4fe3b0fc1bd63cb761fd => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:17.518989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28171dc-6a88-4449-ad19-a620fa3a1ec8 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:17.519278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28171dc-6a88-4449-ad19-a620fa3a1ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:17.519559 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28171dc-6a88-4449-ad19-a620fa3a1ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:17.539536 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-f28171dc-6a88-4449-ad19-a620fa3a1ec8 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:17.540770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f28171dc-6a88-4449-ad19-a620fa3a1ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:17.617558 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1220/2447] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:17.626386 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba0fa9-0d20-41ab-9d99-e58d62c9dc5f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:17.626676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba0fa9-0d20-41ab-9d99-e58d62c9dc5f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:17.626956 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba0fa9-0d20-41ab-9d99-e58d62c9dc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:17.648660 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e1ba0fa9-0d20-41ab-9d99-e58d62c9dc5f None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:17.650832 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e1ba0fa9-0d20-41ab-9d99-e58d62c9dc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:17.662275 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1228/2448] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:17.671781 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28171dc-6a88-4449-ad19-a620fa3a1ec8 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:17.685898 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28171dc-6a88-4449-ad19-a620fa3a1ec8 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:17.692002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6d577-4274-4ac5-bd95-4abc7c62ecd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:17.692732 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6d577-4274-4ac5-bd95-4abc7c62ecd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:17.693033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6d577-4274-4ac5-bd95-4abc7c62ecd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:17.693304 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6d577-4274-4ac5-bd95-4abc7c62ecd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:17.694144 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6d577-4274-4ac5-bd95-4abc7c62ecd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:03:17.694402 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6d577-4274-4ac5-bd95-4abc7c62ecd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:17.695975 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6d577-4274-4ac5-bd95-4abc7c62ecd5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:17.710411 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1221/2449] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:03:17.714873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba0fa9-0d20-41ab-9d99-e58d62c9dc5f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:17.725367 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba0fa9-0d20-41ab-9d99-e58d62c9dc5f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:17.730850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566823e-6ce1-4521-b72a-1a6efdf90045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:17.731519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566823e-6ce1-4521-b72a-1a6efdf90045 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:17.731811 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566823e-6ce1-4521-b72a-1a6efdf90045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:17.732223 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566823e-6ce1-4521-b72a-1a6efdf90045 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:17.732788 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566823e-6ce1-4521-b72a-1a6efdf90045 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:17.736090 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566823e-6ce1-4521-b72a-1a6efdf90045 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:17.898013 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1229/2450] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:03:17 2022] POST /identity/v3/projects => generated 365 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:03:17.902307 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6d577-4274-4ac5-bd95-4abc7c62ecd5 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:17.914819 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6d577-4274-4ac5-bd95-4abc7c62ecd5 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:17.981561 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e4e39-8372-446c-a17d-637ecbd32d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:17.982162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e4e39-8372-446c-a17d-637ecbd32d0b admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:17.982447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e4e39-8372-446c-a17d-637ecbd32d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:17.982719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e4e39-8372-446c-a17d-637ecbd32d0b admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:17.983453 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e4e39-8372-446c-a17d-637ecbd32d0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:17.986208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4e4e39-8372-446c-a17d-637ecbd32d0b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:18.066665 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1222/2451] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:03:17 2022] POST /identity/v3/users => generated 283 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:03:18.070957 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566823e-6ce1-4521-b72a-1a6efdf90045 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:18.081951 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566823e-6ce1-4521-b72a-1a6efdf90045 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:18.087150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2a80c-4f23-4fda-b5b1-4adc86803dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:18.087940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2a80c-4f23-4fda-b5b1-4adc86803dcb admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:18.088262 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2a80c-4f23-4fda-b5b1-4adc86803dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:18.088649 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2a80c-4f23-4fda-b5b1-4adc86803dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:18.089698 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2a80c-4f23-4fda-b5b1-4adc86803dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:18.091907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2a80c-4f23-4fda-b5b1-4adc86803dcb admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:18.103912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1230/2452] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:03:18.109917 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e4e39-8372-446c-a17d-637ecbd32d0b admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:18.120697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e4e39-8372-446c-a17d-637ecbd32d0b admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:18.125960 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76acd9e7-9c34-45b1-b405-6a3595e167ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:18.126762 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acd9e7-9c34-45b1-b405-6a3595e167ec admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:18.127070 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acd9e7-9c34-45b1-b405-6a3595e167ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:18.127378 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76acd9e7-9c34-45b1-b405-6a3595e167ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:18.128124 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acd9e7-9c34-45b1-b405-6a3595e167ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:18.129812 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76acd9e7-9c34-45b1-b405-6a3595e167ec admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:18.140694 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1223/2453] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:03:18.145993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2a80c-4f23-4fda-b5b1-4adc86803dcb admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:18.156672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2a80c-4f23-4fda-b5b1-4adc86803dcb admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:18.161429 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6237b38-3719-46d1-acb6-c1e8f2586730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:18.162317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6237b38-3719-46d1-acb6-c1e8f2586730 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:18.162608 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6237b38-3719-46d1-acb6-c1e8f2586730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:18.162904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6237b38-3719-46d1-acb6-c1e8f2586730 admin admin] PATH_INFO: `/v3/projects/cbc701cd39f141c790daba73ae83d1fa/users/bb09a081a02149b0bd8244fa282f0839/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:18.180697 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6237b38-3719-46d1-acb6-c1e8f2586730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc701cd39f141c790daba73ae83d1fa, user_id=bb09a081a02149b0bd8244fa282f0839, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:18.183424 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6237b38-3719-46d1-acb6-c1e8f2586730 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:18.285482 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:18.290467 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1231/2454] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:03:18 2022] PUT /identity/v3/projects/cbc701cd39f141c790daba73ae83d1fa/users/bb09a081a02149b0bd8244fa282f0839/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:03:18.303011 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a12722-4f16-4ebc-8c9a-5582a720df76 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:18.303544 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a12722-4f16-4ebc-8c9a-5582a720df76 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:18.304009 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a12722-4f16-4ebc-8c9a-5582a720df76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:18.334543 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-24a12722-4f16-4ebc-8c9a-5582a720df76 None None] MFA Rules not processed for user `bb09a081a02149b0bd8244fa282f0839`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:18.338050 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-24a12722-4f16-4ebc-8c9a-5582a720df76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:18.396669 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:18.407805 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1224/2455] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:18.419386 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6237b38-3719-46d1-acb6-c1e8f2586730 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:18.421225 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b6237b38-3719-46d1-acb6-c1e8f2586730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:18.483506 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6237b38-3719-46d1-acb6-c1e8f2586730 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:18.488907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6fbe4e-675d-42a8-b099-6eab3226e80b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:18.489591 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fbe4e-675d-42a8-b099-6eab3226e80b service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:18.489880 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fbe4e-675d-42a8-b099-6eab3226e80b service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:18.490155 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6fbe4e-675d-42a8-b099-6eab3226e80b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:18.499844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6fbe4e-675d-42a8-b099-6eab3226e80b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:18.501775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6fbe4e-675d-42a8-b099-6eab3226e80b service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:18.511812 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1232/2456] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:18 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:03:28.487373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:28.507142 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=26 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:30.778059 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a12722-4f16-4ebc-8c9a-5582a720df76 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:30.856806 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a12722-4f16-4ebc-8c9a-5582a720df76 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:30.861886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf87cc-a6c7-4ed7-899f-39a9b38448dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:30.862901 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf87cc-a6c7-4ed7-899f-39a9b38448dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:30.863126 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf87cc-a6c7-4ed7-899f-39a9b38448dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:30.863337 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf87cc-a6c7-4ed7-899f-39a9b38448dc admin admin] PATH_INFO: `/v3/users/bb09a081a02149b0bd8244fa282f0839` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:30.864652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf87cc-a6c7-4ed7-899f-39a9b38448dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb09a081a02149b0bd8244fa282f0839)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:30.866623 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf87cc-a6c7-4ed7-899f-39a9b38448dc admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:31.187499 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9eaf87cc-a6c7-4ed7-899f-39a9b38448dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb09a081a02149b0bd8244fa282f0839'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:31.298609 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9eaf87cc-a6c7-4ed7-899f-39a9b38448dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb09a081a02149b0bd8244fa282f0839'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:31.307370 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9eaf87cc-a6c7-4ed7-899f-39a9b38448dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb09a081a02149b0bd8244fa282f0839'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:31.308043 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9eaf87cc-a6c7-4ed7-899f-39a9b38448dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb09a081a02149b0bd8244fa282f0839'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:31.321327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-9eaf87cc-a6c7-4ed7-899f-39a9b38448dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb09a081a02149b0bd8244fa282f0839'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:31.327686 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1225/2457] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:03:30 2022] DELETE /identity/v3/users/bb09a081a02149b0bd8244fa282f0839 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:31.332280 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecca0a8-bf92-485f-92b8-d9f5f56600fa None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:31.332990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecca0a8-bf92-485f-92b8-d9f5f56600fa None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:31.332990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecca0a8-bf92-485f-92b8-d9f5f56600fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:31.354361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-0ecca0a8-bf92-485f-92b8-d9f5f56600fa None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:31.355697 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0ecca0a8-bf92-485f-92b8-d9f5f56600fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:31.421924 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1233/2458] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:31.432018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf87cc-a6c7-4ed7-899f-39a9b38448dc admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:31.433551 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9eaf87cc-a6c7-4ed7-899f-39a9b38448dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:31.495449 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf87cc-a6c7-4ed7-899f-39a9b38448dc admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:31.498872 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131aa89-0f17-49b1-8abc-3a0f54cd2602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:31.499536 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131aa89-0f17-49b1-8abc-3a0f54cd2602 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:31.499822 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131aa89-0f17-49b1-8abc-3a0f54cd2602 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:31.500100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131aa89-0f17-49b1-8abc-3a0f54cd2602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:31.510064 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131aa89-0f17-49b1-8abc-3a0f54cd2602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:31.511507 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131aa89-0f17-49b1-8abc-3a0f54cd2602 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:31.521795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1226/2459] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:03:31.952954 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecca0a8-bf92-485f-92b8-d9f5f56600fa None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:31.954404 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0ecca0a8-bf92-485f-92b8-d9f5f56600fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:31.966441 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecca0a8-bf92-485f-92b8-d9f5f56600fa None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:31.971216 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a5cbd-eb25-468e-83c5-bf0fa6ad540d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:31.972100 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a5cbd-eb25-468e-83c5-bf0fa6ad540d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:31.972447 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a5cbd-eb25-468e-83c5-bf0fa6ad540d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:31.972661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a5cbd-eb25-468e-83c5-bf0fa6ad540d admin admin] PATH_INFO: `/v3/projects/cbc701cd39f141c790daba73ae83d1fa` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:31.973895 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a5cbd-eb25-468e-83c5-bf0fa6ad540d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc701cd39f141c790daba73ae83d1fa)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:31.975814 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a5cbd-eb25-468e-83c5-bf0fa6ad540d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:32.089831 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a57a5cbd-eb25-468e-83c5-bf0fa6ad540d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc701cd39f141c790daba73ae83d1fa', 'request_id': 'req-a57a5cbd-eb25-468e-83c5-bf0fa6ad540d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:32.096076 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a57a5cbd-eb25-468e-83c5-bf0fa6ad540d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc701cd39f141c790daba73ae83d1fa', 'request_id': 'req-a57a5cbd-eb25-468e-83c5-bf0fa6ad540d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:32.101736 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a57a5cbd-eb25-468e-83c5-bf0fa6ad540d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc701cd39f141c790daba73ae83d1fa', 'request_id': 'req-a57a5cbd-eb25-468e-83c5-bf0fa6ad540d'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:32.166460 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a57a5cbd-eb25-468e-83c5-bf0fa6ad540d admin admin] The token cache is being invalidate because project cbc701cd39f141c790daba73ae83d1fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:03:32.166757 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a57a5cbd-eb25-468e-83c5-bf0fa6ad540d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:32.167414 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-a57a5cbd-eb25-468e-83c5-bf0fa6ad540d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:32.169040 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1234/2460] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:03:31 2022] DELETE /identity/v3/projects/cbc701cd39f141c790daba73ae83d1fa => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:32.177218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f3706-2b7b-4829-be29-090ed443c421 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:32.177661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f3706-2b7b-4829-be29-090ed443c421 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:32.177858 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f3706-2b7b-4829-be29-090ed443c421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:32.197111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a40f3706-2b7b-4829-be29-090ed443c421 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:32.198303 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a40f3706-2b7b-4829-be29-090ed443c421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:32.216462 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:32.260476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1227/2461] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:03:32.268451 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79d8ec-0a20-4a78-a640-406f3e7df783 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:32.268743 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79d8ec-0a20-4a78-a640-406f3e7df783 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:32.269051 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d79d8ec-0a20-4a78-a640-406f3e7df783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:32.288741 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1d79d8ec-0a20-4a78-a640-406f3e7df783 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:32.290237 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1d79d8ec-0a20-4a78-a640-406f3e7df783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:32.298396 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1235/2462] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:32.302456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f3706-2b7b-4829-be29-090ed443c421 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:32.312972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f3706-2b7b-4829-be29-090ed443c421 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:32.317709 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a67e2-29c4-4d0e-8456-a3bd997600f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:32.318374 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a67e2-29c4-4d0e-8456-a3bd997600f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:32.318662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a67e2-29c4-4d0e-8456-a3bd997600f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:32.318944 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a67e2-29c4-4d0e-8456-a3bd997600f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:32.319708 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a67e2-29c4-4d0e-8456-a3bd997600f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:03:32.320018 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a67e2-29c4-4d0e-8456-a3bd997600f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:32.322181 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a67e2-29c4-4d0e-8456-a3bd997600f7 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:32.333853 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1228/2463] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:03:32.344048 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79d8ec-0a20-4a78-a640-406f3e7df783 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:32.354386 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d79d8ec-0a20-4a78-a640-406f3e7df783 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:32.359896 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c72c2-54a1-408b-adf0-29bde5e09fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:32.360684 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c72c2-54a1-408b-adf0-29bde5e09fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:32.361132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c72c2-54a1-408b-adf0-29bde5e09fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:32.361609 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c72c2-54a1-408b-adf0-29bde5e09fe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:32.362408 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c72c2-54a1-408b-adf0-29bde5e09fe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:32.364583 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721c72c2-54a1-408b-adf0-29bde5e09fe9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:32.461440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1236/2464] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:03:32 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:03:32.465546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a67e2-29c4-4d0e-8456-a3bd997600f7 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:32.475883 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a67e2-29c4-4d0e-8456-a3bd997600f7 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:32.536139 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a86ea-534d-4e7e-b8e5-8d3e7610e36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:32.537094 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a86ea-534d-4e7e-b8e5-8d3e7610e36e admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:32.537381 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a86ea-534d-4e7e-b8e5-8d3e7610e36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:32.537769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a86ea-534d-4e7e-b8e5-8d3e7610e36e admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:32.538356 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a86ea-534d-4e7e-b8e5-8d3e7610e36e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:32.540489 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a86ea-534d-4e7e-b8e5-8d3e7610e36e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:32.630736 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1229/2465] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:03:32 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:03:32.635428 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c72c2-54a1-408b-adf0-29bde5e09fe9 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:32.645949 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c72c2-54a1-408b-adf0-29bde5e09fe9 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:32.652155 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8aeba-7ce1-4630-8f47-c109af254a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:32.652837 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8aeba-7ce1-4630-8f47-c109af254a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:32.653159 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8aeba-7ce1-4630-8f47-c109af254a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:32.653468 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8aeba-7ce1-4630-8f47-c109af254a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:32.654184 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8aeba-7ce1-4630-8f47-c109af254a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:32.655808 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8aeba-7ce1-4630-8f47-c109af254a7c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:32.667287 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1237/2466] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:03:32.673772 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a86ea-534d-4e7e-b8e5-8d3e7610e36e admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:32.685372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a86ea-534d-4e7e-b8e5-8d3e7610e36e admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:32.690404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcff333-bf4d-49f5-949a-7015390bcf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:32.691151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcff333-bf4d-49f5-949a-7015390bcf04 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:32.691510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcff333-bf4d-49f5-949a-7015390bcf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:32.691916 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcff333-bf4d-49f5-949a-7015390bcf04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:32.692934 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcff333-bf4d-49f5-949a-7015390bcf04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:32.702809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcff333-bf4d-49f5-949a-7015390bcf04 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:32.705946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1230/2467] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:03:32.710104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8aeba-7ce1-4630-8f47-c109af254a7c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:32.720559 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8aeba-7ce1-4630-8f47-c109af254a7c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:32.725279 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd4439-af0a-4154-8a49-532460bf0035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:32.726158 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd4439-af0a-4154-8a49-532460bf0035 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:32.726606 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd4439-af0a-4154-8a49-532460bf0035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:32.726883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd4439-af0a-4154-8a49-532460bf0035 admin admin] PATH_INFO: `/v3/projects/fc5b480e201e4e56a4b1d0807ce84f6c/users/517e2b52ab3d47179c3b46c668fbe02d/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:32.741843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd4439-af0a-4154-8a49-532460bf0035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc5b480e201e4e56a4b1d0807ce84f6c, user_id=517e2b52ab3d47179c3b46c668fbe02d, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:32.745207 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd4439-af0a-4154-8a49-532460bf0035 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:32.813571 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1238/2468] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:03:32 2022] PUT /identity/v3/projects/fc5b480e201e4e56a4b1d0807ce84f6c/users/517e2b52ab3d47179c3b46c668fbe02d/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:32.826356 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c886726-decc-4b09-b73e-99d56db0def1 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:32.826649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c886726-decc-4b09-b73e-99d56db0def1 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:32.826926 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c886726-decc-4b09-b73e-99d56db0def1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:32.853950 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-8c886726-decc-4b09-b73e-99d56db0def1 None None] MFA Rules not processed for user `517e2b52ab3d47179c3b46c668fbe02d`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:32.855170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8c886726-decc-4b09-b73e-99d56db0def1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:32.921051 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1231/2469] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:32.925525 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd4439-af0a-4154-8a49-532460bf0035 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:32.947259 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:32.989407 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd4439-af0a-4154-8a49-532460bf0035 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:32.994535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98dbf5f-c58b-49a0-9ce3-d86c7c876cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:32.995195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dbf5f-c58b-49a0-9ce3-d86c7c876cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:32.995486 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dbf5f-c58b-49a0-9ce3-d86c7c876cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:32.995767 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98dbf5f-c58b-49a0-9ce3-d86c7c876cc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:32.996464 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98dbf5f-c58b-49a0-9ce3-d86c7c876cc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:32.998426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98dbf5f-c58b-49a0-9ce3-d86c7c876cc2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:33.128339 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1239/2470] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:03:32 2022] POST /identity/v3/projects => generated 365 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:03:33.133029 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c886726-decc-4b09-b73e-99d56db0def1 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:33.144088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c886726-decc-4b09-b73e-99d56db0def1 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:33.157978 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:33.203684 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1715d-7901-49b4-b830-0777e73c9d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:33.204358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1715d-7901-49b4-b830-0777e73c9d39 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:33.204644 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1715d-7901-49b4-b830-0777e73c9d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:33.204927 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1715d-7901-49b4-b830-0777e73c9d39 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:33.205715 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1715d-7901-49b4-b830-0777e73c9d39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:33.208048 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1715d-7901-49b4-b830-0777e73c9d39 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:33.282572 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1232/2471] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:03:33 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:03:33.286630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98dbf5f-c58b-49a0-9ce3-d86c7c876cc2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:33.298025 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98dbf5f-c58b-49a0-9ce3-d86c7c876cc2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:33.302915 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b730c-def2-4a0b-9a63-5f911dbb67d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:33.303666 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b730c-def2-4a0b-9a63-5f911dbb67d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:33.304003 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b730c-def2-4a0b-9a63-5f911dbb67d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:33.304282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b730c-def2-4a0b-9a63-5f911dbb67d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:33.305050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b730c-def2-4a0b-9a63-5f911dbb67d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:33.306713 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b730c-def2-4a0b-9a63-5f911dbb67d3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:33.319304 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1240/2472] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:03:33.324834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1715d-7901-49b4-b830-0777e73c9d39 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:33.335445 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1715d-7901-49b4-b830-0777e73c9d39 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:33.340815 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0d487-f4bc-4d8e-bb94-a1b3d4004d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:33.341749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0d487-f4bc-4d8e-bb94-a1b3d4004d2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:33.342039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0d487-f4bc-4d8e-bb94-a1b3d4004d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:33.342298 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a0d487-f4bc-4d8e-bb94-a1b3d4004d2c admin admin] PATH_INFO: `/v3/projects/d00f279bb7214db18bc83caf0083d3b8/users/8310c47546dd464e830e424d3df742ff/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:33.359405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a0d487-f4bc-4d8e-bb94-a1b3d4004d2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00f279bb7214db18bc83caf0083d3b8, user_id=8310c47546dd464e830e424d3df742ff, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:33.362371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a0d487-f4bc-4d8e-bb94-a1b3d4004d2c admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:33.449053 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1233/2473] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:03:33 2022] PUT /identity/v3/projects/d00f279bb7214db18bc83caf0083d3b8/users/8310c47546dd464e830e424d3df742ff/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:03:33.453413 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b730c-def2-4a0b-9a63-5f911dbb67d3 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:33.464455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b730c-def2-4a0b-9a63-5f911dbb67d3 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:33.526812 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d706a-ddab-4d3c-a3f5-d9cc6d4c4d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:33.532091 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d706a-ddab-4d3c-a3f5-d9cc6d4c4d53 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:33.532091 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d706a-ddab-4d3c-a3f5-d9cc6d4c4d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:33.532091 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d706a-ddab-4d3c-a3f5-d9cc6d4c4d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:33.532091 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d706a-ddab-4d3c-a3f5-d9cc6d4c4d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:33.532091 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276d706a-ddab-4d3c-a3f5-d9cc6d4c4d53 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:33.544750 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1241/2474] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:03:33.545967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0d487-f4bc-4d8e-bb94-a1b3d4004d2c admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:33.557501 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a0d487-f4bc-4d8e-bb94-a1b3d4004d2c admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:33.562586 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41229a4-5510-4ded-a7de-481ef4ed5583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:33.563520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41229a4-5510-4ded-a7de-481ef4ed5583 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:33.563805 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41229a4-5510-4ded-a7de-481ef4ed5583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:33.564083 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41229a4-5510-4ded-a7de-481ef4ed5583 admin admin] PATH_INFO: `/v3/projects/d00f279bb7214db18bc83caf0083d3b8/users/8310c47546dd464e830e424d3df742ff/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:33.566245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41229a4-5510-4ded-a7de-481ef4ed5583 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d00f279bb7214db18bc83caf0083d3b8, user_id=8310c47546dd464e830e424d3df742ff, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:33.568958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41229a4-5510-4ded-a7de-481ef4ed5583 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:33.580796 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1234/2475] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:03:33 2022] PUT /identity/v3/projects/d00f279bb7214db18bc83caf0083d3b8/users/8310c47546dd464e830e424d3df742ff/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:03:33.592847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344132e-e9b7-4096-ae1e-4f725c68889b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:33.593164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344132e-e9b7-4096-ae1e-4f725c68889b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:33.593448 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3344132e-e9b7-4096-ae1e-4f725c68889b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:33.622278 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3344132e-e9b7-4096-ae1e-4f725c68889b None None] MFA Rules not processed for user `8310c47546dd464e830e424d3df742ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:33.623588 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3344132e-e9b7-4096-ae1e-4f725c68889b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:33.693584 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1242/2476] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:33.706006 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41229a4-5510-4ded-a7de-481ef4ed5583 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:33.707827 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e41229a4-5510-4ded-a7de-481ef4ed5583 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:33.773814 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41229a4-5510-4ded-a7de-481ef4ed5583 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:33.777990 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf705c23-217e-445d-9ef0-46bcc98f30bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:33.778676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf705c23-217e-445d-9ef0-46bcc98f30bd service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:33.778957 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf705c23-217e-445d-9ef0-46bcc98f30bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:33.779264 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf705c23-217e-445d-9ef0-46bcc98f30bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:33.793177 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf705c23-217e-445d-9ef0-46bcc98f30bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:33.794598 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf705c23-217e-445d-9ef0-46bcc98f30bd service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:33.806581 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1235/2477] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:03:34.073243 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344132e-e9b7-4096-ae1e-4f725c68889b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:34.083607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3344132e-e9b7-4096-ae1e-4f725c68889b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:34.088065 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5a2950-7c77-4786-8525-4ecb222ab5cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:34.088730 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a2950-7c77-4786-8525-4ecb222ab5cf service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:34.089045 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a2950-7c77-4786-8525-4ecb222ab5cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:34.089924 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5a2950-7c77-4786-8525-4ecb222ab5cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:34.104366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:34.158259 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a2950-7c77-4786-8525-4ecb222ab5cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:34.159891 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5a2950-7c77-4786-8525-4ecb222ab5cf service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:34.170651 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1243/2478] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:34 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:03:37.970991 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf705c23-217e-445d-9ef0-46bcc98f30bd service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:38.034049 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf705c23-217e-445d-9ef0-46bcc98f30bd service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:38.038710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adbb6f-30e9-4a7e-b391-30a04393e557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:38.040363 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adbb6f-30e9-4a7e-b391-30a04393e557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:38.040648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adbb6f-30e9-4a7e-b391-30a04393e557 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:38.040921 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78adbb6f-30e9-4a7e-b391-30a04393e557 admin admin] PATH_INFO: `/v3/users/517e2b52ab3d47179c3b46c668fbe02d` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:38.042170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adbb6f-30e9-4a7e-b391-30a04393e557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=517e2b52ab3d47179c3b46c668fbe02d)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:38.044085 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78adbb6f-30e9-4a7e-b391-30a04393e557 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:38.057935 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:38.244171 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-78adbb6f-30e9-4a7e-b391-30a04393e557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '517e2b52ab3d47179c3b46c668fbe02d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:38.315292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-78adbb6f-30e9-4a7e-b391-30a04393e557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '517e2b52ab3d47179c3b46c668fbe02d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:38.323677 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-78adbb6f-30e9-4a7e-b391-30a04393e557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '517e2b52ab3d47179c3b46c668fbe02d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:38.324338 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-78adbb6f-30e9-4a7e-b391-30a04393e557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '517e2b52ab3d47179c3b46c668fbe02d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:38.338117 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-78adbb6f-30e9-4a7e-b391-30a04393e557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '517e2b52ab3d47179c3b46c668fbe02d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:38.344550 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1236/2479] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:03:37 2022] DELETE /identity/v3/users/517e2b52ab3d47179c3b46c668fbe02d => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:38.349367 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c678d53-3fc1-4469-85df-82bedc8db6a2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:38.349826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c678d53-3fc1-4469-85df-82bedc8db6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:38.350085 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c678d53-3fc1-4469-85df-82bedc8db6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:38.369802 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1c678d53-3fc1-4469-85df-82bedc8db6a2 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:38.371140 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1c678d53-3fc1-4469-85df-82bedc8db6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:38.446821 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1244/2480] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:38.456874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adbb6f-30e9-4a7e-b391-30a04393e557 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:38.458543 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-78adbb6f-30e9-4a7e-b391-30a04393e557 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:38.517988 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78adbb6f-30e9-4a7e-b391-30a04393e557 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:38.521720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa9840-bf24-4467-9f11-5f4399a59a8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:38.522382 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa9840-bf24-4467-9f11-5f4399a59a8f service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:38.522664 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa9840-bf24-4467-9f11-5f4399a59a8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:38.522945 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa9840-bf24-4467-9f11-5f4399a59a8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:38.534661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa9840-bf24-4467-9f11-5f4399a59a8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:38.537179 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaa9840-bf24-4467-9f11-5f4399a59a8f service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:38.548369 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1237/2481] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:03:38.991502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c678d53-3fc1-4469-85df-82bedc8db6a2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:38.993758 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1c678d53-3fc1-4469-85df-82bedc8db6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:39.005877 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c678d53-3fc1-4469-85df-82bedc8db6a2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:39.010826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384e9e2-dac3-4242-8029-eaf275c3af15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:39.011716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384e9e2-dac3-4242-8029-eaf275c3af15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:39.012039 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384e9e2-dac3-4242-8029-eaf275c3af15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:39.012294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384e9e2-dac3-4242-8029-eaf275c3af15 admin admin] PATH_INFO: `/v3/projects/fc5b480e201e4e56a4b1d0807ce84f6c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:39.013551 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384e9e2-dac3-4242-8029-eaf275c3af15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc5b480e201e4e56a4b1d0807ce84f6c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:39.015471 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384e9e2-dac3-4242-8029-eaf275c3af15 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:39.151799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b384e9e2-dac3-4242-8029-eaf275c3af15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc5b480e201e4e56a4b1d0807ce84f6c', 'request_id': 'req-b384e9e2-dac3-4242-8029-eaf275c3af15'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:39.159113 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b384e9e2-dac3-4242-8029-eaf275c3af15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc5b480e201e4e56a4b1d0807ce84f6c', 'request_id': 'req-b384e9e2-dac3-4242-8029-eaf275c3af15'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:39.165576 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b384e9e2-dac3-4242-8029-eaf275c3af15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc5b480e201e4e56a4b1d0807ce84f6c', 'request_id': 'req-b384e9e2-dac3-4242-8029-eaf275c3af15'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:39.257970 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b384e9e2-dac3-4242-8029-eaf275c3af15 admin admin] The token cache is being invalidate because project fc5b480e201e4e56a4b1d0807ce84f6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:03:39.258526 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b384e9e2-dac3-4242-8029-eaf275c3af15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:39.259345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b384e9e2-dac3-4242-8029-eaf275c3af15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:39.260951 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1245/2482] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:03:38 2022] DELETE /identity/v3/projects/fc5b480e201e4e56a4b1d0807ce84f6c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:39.268382 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa9840-bf24-4467-9f11-5f4399a59a8f service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:39.275240 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa9840-bf24-4467-9f11-5f4399a59a8f service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:39.340349 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321dc320-ae84-4318-93e6-a4a2a89d52a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:39.341274 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dc320-ae84-4318-93e6-a4a2a89d52a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:39.341557 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dc320-ae84-4318-93e6-a4a2a89d52a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:39.341832 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321dc320-ae84-4318-93e6-a4a2a89d52a1 admin admin] PATH_INFO: `/v3/users/8310c47546dd464e830e424d3df742ff` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:39.343096 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321dc320-ae84-4318-93e6-a4a2a89d52a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8310c47546dd464e830e424d3df742ff)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:39.345084 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321dc320-ae84-4318-93e6-a4a2a89d52a1 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:39.556484 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:39.564538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-321dc320-ae84-4318-93e6-a4a2a89d52a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8310c47546dd464e830e424d3df742ff'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:39.692853 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-321dc320-ae84-4318-93e6-a4a2a89d52a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8310c47546dd464e830e424d3df742ff'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:39.700864 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-321dc320-ae84-4318-93e6-a4a2a89d52a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8310c47546dd464e830e424d3df742ff'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:39.708583 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-321dc320-ae84-4318-93e6-a4a2a89d52a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8310c47546dd464e830e424d3df742ff'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:39.715541 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-321dc320-ae84-4318-93e6-a4a2a89d52a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8310c47546dd464e830e424d3df742ff'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:39.722497 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1238/2483] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:03:39 2022] DELETE /identity/v3/users/8310c47546dd464e830e424d3df742ff => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:39.764675 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384e9e2-dac3-4242-8029-eaf275c3af15 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:39.766672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b384e9e2-dac3-4242-8029-eaf275c3af15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:39.815442 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:39.831881 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384e9e2-dac3-4242-8029-eaf275c3af15 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:39.880452 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0975825-7554-417c-b223-d3681e1f1fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:39.881129 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0975825-7554-417c-b223-d3681e1f1fab service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:39.881412 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0975825-7554-417c-b223-d3681e1f1fab service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:39.881687 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0975825-7554-417c-b223-d3681e1f1fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:39.884551 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a0975825-7554-417c-b223-d3681e1f1fab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:39.956328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0975825-7554-417c-b223-d3681e1f1fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:39.958366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0975825-7554-417c-b223-d3681e1f1fab service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:39.971543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1246/2484] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:03:40.423747 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321dc320-ae84-4318-93e6-a4a2a89d52a1 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:40.425597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-321dc320-ae84-4318-93e6-a4a2a89d52a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:40.440176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321dc320-ae84-4318-93e6-a4a2a89d52a1 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:40.444423 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb1603-4ae4-4648-86d0-d152ec3f8c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:40.445382 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb1603-4ae4-4648-86d0-d152ec3f8c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:40.446772 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb1603-4ae4-4648-86d0-d152ec3f8c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:40.446772 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb1603-4ae4-4648-86d0-d152ec3f8c40 admin admin] PATH_INFO: `/v3/projects/d00f279bb7214db18bc83caf0083d3b8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:40.447422 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb1603-4ae4-4648-86d0-d152ec3f8c40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d00f279bb7214db18bc83caf0083d3b8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:40.449416 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb1603-4ae4-4648-86d0-d152ec3f8c40 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:40.564541 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-dddb1603-4ae4-4648-86d0-d152ec3f8c40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd00f279bb7214db18bc83caf0083d3b8', 'request_id': 'req-dddb1603-4ae4-4648-86d0-d152ec3f8c40'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:40.570999 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-dddb1603-4ae4-4648-86d0-d152ec3f8c40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd00f279bb7214db18bc83caf0083d3b8', 'request_id': 'req-dddb1603-4ae4-4648-86d0-d152ec3f8c40'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:40.577652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-dddb1603-4ae4-4648-86d0-d152ec3f8c40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd00f279bb7214db18bc83caf0083d3b8', 'request_id': 'req-dddb1603-4ae4-4648-86d0-d152ec3f8c40'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:40.670180 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-dddb1603-4ae4-4648-86d0-d152ec3f8c40 admin admin] The token cache is being invalidate because project d00f279bb7214db18bc83caf0083d3b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:03:40.670477 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-dddb1603-4ae4-4648-86d0-d152ec3f8c40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:40.671131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-dddb1603-4ae4-4648-86d0-d152ec3f8c40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:40.672708 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1239/2485] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:03:40 2022] DELETE /identity/v3/projects/d00f279bb7214db18bc83caf0083d3b8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:40.678749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15ebbf-111d-4a66-83d0-61cabe7b4c09 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:40.679048 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15ebbf-111d-4a66-83d0-61cabe7b4c09 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:40.679343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15ebbf-111d-4a66-83d0-61cabe7b4c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:40.699143 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ac15ebbf-111d-4a66-83d0-61cabe7b4c09 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:40.700361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ac15ebbf-111d-4a66-83d0-61cabe7b4c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:40.767548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1247/2486] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:40.776994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a42ef2-912f-4435-b592-e3f99cb088c7 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:40.777350 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a42ef2-912f-4435-b592-e3f99cb088c7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:40.782863 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a42ef2-912f-4435-b592-e3f99cb088c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:40.796972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a4a42ef2-912f-4435-b592-e3f99cb088c7 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:40.798213 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a4a42ef2-912f-4435-b592-e3f99cb088c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:40.806878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1240/2487] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:40.813542 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15ebbf-111d-4a66-83d0-61cabe7b4c09 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:40.828596 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15ebbf-111d-4a66-83d0-61cabe7b4c09 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:40.829911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a84fe8-ea61-44b0-b201-3b36896ecd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:40.830650 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a84fe8-ea61-44b0-b201-3b36896ecd13 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:40.831006 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a84fe8-ea61-44b0-b201-3b36896ecd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:40.831356 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a84fe8-ea61-44b0-b201-3b36896ecd13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:40.832173 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a84fe8-ea61-44b0-b201-3b36896ecd13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:03:40.832551 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a84fe8-ea61-44b0-b201-3b36896ecd13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:40.834360 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a84fe8-ea61-44b0-b201-3b36896ecd13 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:40.851061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1248/2488] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:03:40.855504 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a42ef2-912f-4435-b592-e3f99cb088c7 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:40.862895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a42ef2-912f-4435-b592-e3f99cb088c7 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:40.869529 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf2a3c-d033-42f0-b608-2140c268ee8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:40.870191 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf2a3c-d033-42f0-b608-2140c268ee8d admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:40.870475 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf2a3c-d033-42f0-b608-2140c268ee8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:40.870759 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf2a3c-d033-42f0-b608-2140c268ee8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:40.871454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf2a3c-d033-42f0-b608-2140c268ee8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:40.873388 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faf2a3c-d033-42f0-b608-2140c268ee8d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:41.048755 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1241/2489] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:03:40 2022] POST /identity/v3/projects => generated 369 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:03:41.052960 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a84fe8-ea61-44b0-b201-3b36896ecd13 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:41.063746 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a84fe8-ea61-44b0-b201-3b36896ecd13 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:41.095669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:41.130593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6265e-90ea-498b-b81d-03e93d5790b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:41.131656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6265e-90ea-498b-b81d-03e93d5790b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:41.131656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6265e-90ea-498b-b81d-03e93d5790b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:41.132057 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6265e-90ea-498b-b81d-03e93d5790b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:41.132568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6265e-90ea-498b-b81d-03e93d5790b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:41.135638 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6265e-90ea-498b-b81d-03e93d5790b3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:41.237084 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1249/2490] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:03:41 2022] POST /identity/v3/users => generated 285 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:03:41.241327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf2a3c-d033-42f0-b608-2140c268ee8d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:41.259067 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf2a3c-d033-42f0-b608-2140c268ee8d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:41.265722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9bf2e-2444-4463-9d65-7671fdb1d4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:41.266575 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9bf2e-2444-4463-9d65-7671fdb1d4fa admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:41.266973 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9bf2e-2444-4463-9d65-7671fdb1d4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:41.267360 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab9bf2e-2444-4463-9d65-7671fdb1d4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:41.268409 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9bf2e-2444-4463-9d65-7671fdb1d4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:41.270099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab9bf2e-2444-4463-9d65-7671fdb1d4fa admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:41.296560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1242/2491] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:03:41.297735 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6265e-90ea-498b-b81d-03e93d5790b3 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:41.310123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6265e-90ea-498b-b81d-03e93d5790b3 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:41.316589 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a536b-272c-42aa-8e66-3ad411afe641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:41.317313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a536b-272c-42aa-8e66-3ad411afe641 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:41.317605 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a536b-272c-42aa-8e66-3ad411afe641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:41.317887 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a536b-272c-42aa-8e66-3ad411afe641 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:41.318625 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a536b-272c-42aa-8e66-3ad411afe641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:41.320649 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a536b-272c-42aa-8e66-3ad411afe641 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:41.332076 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1250/2492] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:03:41.336001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9bf2e-2444-4463-9d65-7671fdb1d4fa admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:41.346867 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab9bf2e-2444-4463-9d65-7671fdb1d4fa admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:41.351475 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa4851-bf68-4e25-8cfd-d1fed76328e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:41.353565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa4851-bf68-4e25-8cfd-d1fed76328e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:41.353873 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa4851-bf68-4e25-8cfd-d1fed76328e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:41.354172 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa4851-bf68-4e25-8cfd-d1fed76328e7 admin admin] PATH_INFO: `/v3/projects/4e45051d4c0048bdb82c72c7784ae46a/users/b58c6baf34654900a45c863c3cf378e7/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:41.370797 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa4851-bf68-4e25-8cfd-d1fed76328e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e45051d4c0048bdb82c72c7784ae46a, user_id=b58c6baf34654900a45c863c3cf378e7, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:41.373509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa4851-bf68-4e25-8cfd-d1fed76328e7 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:41.470313 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1243/2493] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:03:41 2022] PUT /identity/v3/projects/4e45051d4c0048bdb82c72c7784ae46a/users/b58c6baf34654900a45c863c3cf378e7/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:41.482075 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02191c-b05f-4f0f-9707-77f1fe1bfb64 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:41.482370 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02191c-b05f-4f0f-9707-77f1fe1bfb64 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:41.482689 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f02191c-b05f-4f0f-9707-77f1fe1bfb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:41.512580 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-6f02191c-b05f-4f0f-9707-77f1fe1bfb64 None None] MFA Rules not processed for user `b58c6baf34654900a45c863c3cf378e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:41.513824 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6f02191c-b05f-4f0f-9707-77f1fe1bfb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:41.581584 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1251/2494] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:41.587510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa4851-bf68-4e25-8cfd-d1fed76328e7 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:41.636647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:41.706155 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa4851-bf68-4e25-8cfd-d1fed76328e7 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:41.720073 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69e3fb-cfb4-4903-979e-3e950cbe0fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:41.720805 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69e3fb-cfb4-4903-979e-3e950cbe0fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:41.721312 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69e3fb-cfb4-4903-979e-3e950cbe0fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:41.721688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d69e3fb-cfb4-4903-979e-3e950cbe0fc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:41.722423 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69e3fb-cfb4-4903-979e-3e950cbe0fc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:41.724718 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d69e3fb-cfb4-4903-979e-3e950cbe0fc6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:41.837607 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1244/2495] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:03:41 2022] POST /identity/v3/projects => generated 369 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:03:41.838888 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02191c-b05f-4f0f-9707-77f1fe1bfb64 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:41.853247 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f02191c-b05f-4f0f-9707-77f1fe1bfb64 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:41.914342 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995bbbf-5db6-4c4f-9870-45c538353a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:41.915597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995bbbf-5db6-4c4f-9870-45c538353a1b admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:41.915883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995bbbf-5db6-4c4f-9870-45c538353a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:41.916162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995bbbf-5db6-4c4f-9870-45c538353a1b admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:41.916868 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995bbbf-5db6-4c4f-9870-45c538353a1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:41.918878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995bbbf-5db6-4c4f-9870-45c538353a1b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:42.007697 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1252/2496] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:03:41 2022] POST /identity/v3/users => generated 291 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:03:42.012519 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69e3fb-cfb4-4903-979e-3e950cbe0fc6 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:42.026864 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d69e3fb-cfb4-4903-979e-3e950cbe0fc6 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:42.032662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a9ceb-9d37-49d6-882e-4cd08a5701fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:42.033142 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a9ceb-9d37-49d6-882e-4cd08a5701fe admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:42.033533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a9ceb-9d37-49d6-882e-4cd08a5701fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:42.034011 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a9ceb-9d37-49d6-882e-4cd08a5701fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:42.034842 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a9ceb-9d37-49d6-882e-4cd08a5701fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:42.036538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a9ceb-9d37-49d6-882e-4cd08a5701fe admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:42.050567 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1245/2497] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:03:42.054189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995bbbf-5db6-4c4f-9870-45c538353a1b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:42.065334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995bbbf-5db6-4c4f-9870-45c538353a1b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:42.071536 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868545c4-dc65-4889-accf-542fd4036dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:42.072732 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868545c4-dc65-4889-accf-542fd4036dbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:42.073317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868545c4-dc65-4889-accf-542fd4036dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:42.073673 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868545c4-dc65-4889-accf-542fd4036dbc admin admin] PATH_INFO: `/v3/projects/0bdd45ead87d45c384194d3e3f2099e4/users/d152f54ff89b40d1bcb4044c711e3429/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:42.092627 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868545c4-dc65-4889-accf-542fd4036dbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bdd45ead87d45c384194d3e3f2099e4, user_id=d152f54ff89b40d1bcb4044c711e3429, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:42.095566 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868545c4-dc65-4889-accf-542fd4036dbc admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:42.205268 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1253/2498] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:03:42 2022] PUT /identity/v3/projects/0bdd45ead87d45c384194d3e3f2099e4/users/d152f54ff89b40d1bcb4044c711e3429/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:42.209582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a9ceb-9d37-49d6-882e-4cd08a5701fe admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:42.220563 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a9ceb-9d37-49d6-882e-4cd08a5701fe admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:42.287478 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae14b74-e4e0-404a-a8e5-d5daf4ecd63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:42.288298 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae14b74-e4e0-404a-a8e5-d5daf4ecd63b admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:42.288633 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae14b74-e4e0-404a-a8e5-d5daf4ecd63b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:42.288924 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae14b74-e4e0-404a-a8e5-d5daf4ecd63b admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:42.289733 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae14b74-e4e0-404a-a8e5-d5daf4ecd63b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:42.291581 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae14b74-e4e0-404a-a8e5-d5daf4ecd63b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:42.301865 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1246/2499] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:03:42.306348 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868545c4-dc65-4889-accf-542fd4036dbc admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:42.313142 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:42.316973 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868545c4-dc65-4889-accf-542fd4036dbc admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:42.322952 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80da174-98a3-41d0-b7b4-bd73fab6d2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:42.323843 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80da174-98a3-41d0-b7b4-bd73fab6d2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:42.324131 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80da174-98a3-41d0-b7b4-bd73fab6d2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:42.324408 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80da174-98a3-41d0-b7b4-bd73fab6d2f7 admin admin] PATH_INFO: `/v3/projects/0bdd45ead87d45c384194d3e3f2099e4/users/d152f54ff89b40d1bcb4044c711e3429/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:42.326474 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80da174-98a3-41d0-b7b4-bd73fab6d2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bdd45ead87d45c384194d3e3f2099e4, user_id=d152f54ff89b40d1bcb4044c711e3429, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:42.329191 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80da174-98a3-41d0-b7b4-bd73fab6d2f7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:42.340669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1254/2500] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:03:42 2022] PUT /identity/v3/projects/0bdd45ead87d45c384194d3e3f2099e4/users/d152f54ff89b40d1bcb4044c711e3429/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:42.354560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a553f0-342a-4577-8588-bdcfc0457a5a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:42.355277 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a553f0-342a-4577-8588-bdcfc0457a5a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:42.355621 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a553f0-342a-4577-8588-bdcfc0457a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:42.385445 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-79a553f0-342a-4577-8588-bdcfc0457a5a None None] MFA Rules not processed for user `d152f54ff89b40d1bcb4044c711e3429`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:42.386808 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-79a553f0-342a-4577-8588-bdcfc0457a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:42.465160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1247/2501] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:42 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:03:42.475909 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80da174-98a3-41d0-b7b4-bd73fab6d2f7 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:42.478363 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c80da174-98a3-41d0-b7b4-bd73fab6d2f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:42.543782 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80da174-98a3-41d0-b7b4-bd73fab6d2f7 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:42.548336 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31f5f4-1e14-4c44-82e8-73acd6475de4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:42.549137 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31f5f4-1e14-4c44-82e8-73acd6475de4 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:42.549520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31f5f4-1e14-4c44-82e8-73acd6475de4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:42.549802 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31f5f4-1e14-4c44-82e8-73acd6475de4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:42.559999 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31f5f4-1e14-4c44-82e8-73acd6475de4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:42.561649 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31f5f4-1e14-4c44-82e8-73acd6475de4 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:42.573196 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1255/2502] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:42 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:03:43.796096 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a553f0-342a-4577-8588-bdcfc0457a5a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:43.797619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-79a553f0-342a-4577-8588-bdcfc0457a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:43.831228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:43.865439 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a553f0-342a-4577-8588-bdcfc0457a5a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:43.871304 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e7ed2-aad9-496c-9b8c-e5e0ddf9e488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:43.872180 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e7ed2-aad9-496c-9b8c-e5e0ddf9e488 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:43.872456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e7ed2-aad9-496c-9b8c-e5e0ddf9e488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:43.872731 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e7ed2-aad9-496c-9b8c-e5e0ddf9e488 admin admin] PATH_INFO: `/v3/users/9faf38f2ccec4b60a3612648073d06d3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:43.873954 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e7ed2-aad9-496c-9b8c-e5e0ddf9e488 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9faf38f2ccec4b60a3612648073d06d3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:43.875871 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e7ed2-aad9-496c-9b8c-e5e0ddf9e488 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:44.102822 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f91e7ed2-aad9-496c-9b8c-e5e0ddf9e488 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9faf38f2ccec4b60a3612648073d06d3'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:44.160993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f91e7ed2-aad9-496c-9b8c-e5e0ddf9e488 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9faf38f2ccec4b60a3612648073d06d3'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:44.170523 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f91e7ed2-aad9-496c-9b8c-e5e0ddf9e488 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9faf38f2ccec4b60a3612648073d06d3'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:44.171374 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f91e7ed2-aad9-496c-9b8c-e5e0ddf9e488 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9faf38f2ccec4b60a3612648073d06d3'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:44.184844 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f91e7ed2-aad9-496c-9b8c-e5e0ddf9e488 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9faf38f2ccec4b60a3612648073d06d3'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:44.191186 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1248/2503] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:03:43 2022] DELETE /identity/v3/users/9faf38f2ccec4b60a3612648073d06d3 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:44.344559 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31f5f4-1e14-4c44-82e8-73acd6475de4 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:44.346103 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ec31f5f4-1e14-4c44-82e8-73acd6475de4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:44.426262 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31f5f4-1e14-4c44-82e8-73acd6475de4 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:44.460640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e7ed2-aad9-496c-9b8c-e5e0ddf9e488 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:44.462820 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f91e7ed2-aad9-496c-9b8c-e5e0ddf9e488 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:44.502883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae19e8-c2ef-4461-a830-951cdbe3cc98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:44.503606 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae19e8-c2ef-4461-a830-951cdbe3cc98 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:44.503903 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae19e8-c2ef-4461-a830-951cdbe3cc98 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:44.504331 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae19e8-c2ef-4461-a830-951cdbe3cc98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:44.506230 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-35ae19e8-c2ef-4461-a830-951cdbe3cc98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:44.547544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:44.558711 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e7ed2-aad9-496c-9b8c-e5e0ddf9e488 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:44.564182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2344d4f-ffae-458e-bf38-6b6f337ee1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:44.564623 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2344d4f-ffae-458e-bf38-6b6f337ee1af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:44.564906 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2344d4f-ffae-458e-bf38-6b6f337ee1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:44.565219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2344d4f-ffae-458e-bf38-6b6f337ee1af admin admin] PATH_INFO: `/v3/projects/d75a7e8f1e294903ade7a227878079f8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:44.566613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2344d4f-ffae-458e-bf38-6b6f337ee1af admin admin] RBAC: Authorizing `identity:delete_project(project_id=d75a7e8f1e294903ade7a227878079f8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:44.568539 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2344d4f-ffae-458e-bf38-6b6f337ee1af admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:44.587968 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae19e8-c2ef-4461-a830-951cdbe3cc98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:44.589807 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae19e8-c2ef-4461-a830-951cdbe3cc98 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:44.610419 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1256/2504] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:03:44.728457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c2344d4f-ffae-458e-bf38-6b6f337ee1af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd75a7e8f1e294903ade7a227878079f8', 'request_id': 'req-c2344d4f-ffae-458e-bf38-6b6f337ee1af'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:44.729920 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:44.735273 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c2344d4f-ffae-458e-bf38-6b6f337ee1af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd75a7e8f1e294903ade7a227878079f8', 'request_id': 'req-c2344d4f-ffae-458e-bf38-6b6f337ee1af'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:44.742492 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c2344d4f-ffae-458e-bf38-6b6f337ee1af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd75a7e8f1e294903ade7a227878079f8', 'request_id': 'req-c2344d4f-ffae-458e-bf38-6b6f337ee1af'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:44.933632 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c2344d4f-ffae-458e-bf38-6b6f337ee1af admin admin] The token cache is being invalidate because project d75a7e8f1e294903ade7a227878079f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:03:44.934269 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c2344d4f-ffae-458e-bf38-6b6f337ee1af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:44.934587 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c2344d4f-ffae-458e-bf38-6b6f337ee1af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:44.936719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1249/2505] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:03:44 2022] DELETE /identity/v3/projects/d75a7e8f1e294903ade7a227878079f8 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:03:44.944508 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4216fa-fb96-4232-8f9c-575023a3706b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:44.944809 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4216fa-fb96-4232-8f9c-575023a3706b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:44.945190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4216fa-fb96-4232-8f9c-575023a3706b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:44.965789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ab4216fa-fb96-4232-8f9c-575023a3706b None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:44.967205 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ab4216fa-fb96-4232-8f9c-575023a3706b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:45.044664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1257/2506] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:45.056658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ced44-cb00-4671-9350-28e9e513615d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:45.056658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ced44-cb00-4671-9350-28e9e513615d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:45.056658 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ced44-cb00-4671-9350-28e9e513615d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:45.075493 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-652ced44-cb00-4671-9350-28e9e513615d None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:45.076737 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-652ced44-cb00-4671-9350-28e9e513615d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:45.087012 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1250/2507] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:45.090286 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4216fa-fb96-4232-8f9c-575023a3706b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:45.100806 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4216fa-fb96-4232-8f9c-575023a3706b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:45.106145 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69517308-b832-4116-8bbe-e1fa66dcc262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:45.106846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69517308-b832-4116-8bbe-e1fa66dcc262 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:45.107276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69517308-b832-4116-8bbe-e1fa66dcc262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:45.107695 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69517308-b832-4116-8bbe-e1fa66dcc262 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:45.108320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69517308-b832-4116-8bbe-e1fa66dcc262 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:03:45.108643 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69517308-b832-4116-8bbe-e1fa66dcc262 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:45.110553 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69517308-b832-4116-8bbe-e1fa66dcc262 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:45.127000 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1258/2508] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 17:03:45.130243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ced44-cb00-4671-9350-28e9e513615d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:45.140358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ced44-cb00-4671-9350-28e9e513615d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:45.145413 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847be1f0-9eb7-4e76-bd39-86ef94a9bf12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:45.146086 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847be1f0-9eb7-4e76-bd39-86ef94a9bf12 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:45.146371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847be1f0-9eb7-4e76-bd39-86ef94a9bf12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:45.146649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847be1f0-9eb7-4e76-bd39-86ef94a9bf12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:45.147348 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847be1f0-9eb7-4e76-bd39-86ef94a9bf12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:45.150393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847be1f0-9eb7-4e76-bd39-86ef94a9bf12 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:45.265649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1251/2509] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:03:45 2022] POST /identity/v3/projects => generated 405 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:03:45.270143 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69517308-b832-4116-8bbe-e1fa66dcc262 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:45.284262 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69517308-b832-4116-8bbe-e1fa66dcc262 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:45.367832 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c641f2-dc86-4bca-93e8-a9716a202185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:45.368617 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c641f2-dc86-4bca-93e8-a9716a202185 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:45.368721 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c641f2-dc86-4bca-93e8-a9716a202185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:45.368941 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c641f2-dc86-4bca-93e8-a9716a202185 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:45.369689 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c641f2-dc86-4bca-93e8-a9716a202185 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:45.371682 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c641f2-dc86-4bca-93e8-a9716a202185 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:45.493962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1259/2510] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:03:45 2022] POST /identity/v3/users => generated 303 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:03:45.501125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847be1f0-9eb7-4e76-bd39-86ef94a9bf12 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:45.512099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847be1f0-9eb7-4e76-bd39-86ef94a9bf12 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:45.517594 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544db0c-c45a-41e9-99ce-9e624e318013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:45.518244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544db0c-c45a-41e9-99ce-9e624e318013 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:45.518529 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544db0c-c45a-41e9-99ce-9e624e318013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:45.518807 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544db0c-c45a-41e9-99ce-9e624e318013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:45.519543 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544db0c-c45a-41e9-99ce-9e624e318013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:45.521179 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544db0c-c45a-41e9-99ce-9e624e318013 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:45.532586 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1252/2511] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:03:45.536629 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c641f2-dc86-4bca-93e8-a9716a202185 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:45.546836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c641f2-dc86-4bca-93e8-a9716a202185 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:45.551517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc729c8-8477-40ee-94a5-610caf00b9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:45.552175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc729c8-8477-40ee-94a5-610caf00b9db admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:45.552460 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc729c8-8477-40ee-94a5-610caf00b9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:45.552740 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc729c8-8477-40ee-94a5-610caf00b9db admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:45.553515 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc729c8-8477-40ee-94a5-610caf00b9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:45.555664 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc729c8-8477-40ee-94a5-610caf00b9db admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:45.566997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1260/2512] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:03:45.570475 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544db0c-c45a-41e9-99ce-9e624e318013 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:45.581458 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544db0c-c45a-41e9-99ce-9e624e318013 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:45.586123 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce51eb5-b5c7-45d1-91ea-1031b04901ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:45.587258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce51eb5-b5c7-45d1-91ea-1031b04901ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:45.587547 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce51eb5-b5c7-45d1-91ea-1031b04901ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:45.587831 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce51eb5-b5c7-45d1-91ea-1031b04901ab admin admin] PATH_INFO: `/v3/projects/a85696792e0e4fd4b1fa314444cdacfe/users/47478df928fc4bbe90776a50a50fd659/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:45.603823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce51eb5-b5c7-45d1-91ea-1031b04901ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85696792e0e4fd4b1fa314444cdacfe, user_id=47478df928fc4bbe90776a50a50fd659, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:45.606565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce51eb5-b5c7-45d1-91ea-1031b04901ab admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:45.745424 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1253/2513] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:03:45 2022] PUT /identity/v3/projects/a85696792e0e4fd4b1fa314444cdacfe/users/47478df928fc4bbe90776a50a50fd659/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:03:45.756208 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b92c4b-d8cc-4891-83c3-d4851573455b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:45.756509 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b92c4b-d8cc-4891-83c3-d4851573455b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:45.756797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b92c4b-d8cc-4891-83c3-d4851573455b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:45.788398 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-44b92c4b-d8cc-4891-83c3-d4851573455b None None] MFA Rules not processed for user `47478df928fc4bbe90776a50a50fd659`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:45.788398 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-44b92c4b-d8cc-4891-83c3-d4851573455b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:45.810555 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:45.825819 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce51eb5-b5c7-45d1-91ea-1031b04901ab admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:45.827676 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fce51eb5-b5c7-45d1-91ea-1031b04901ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:45.866478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1261/2514] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:45.872092 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b92c4b-d8cc-4891-83c3-d4851573455b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:45.895562 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce51eb5-b5c7-45d1-91ea-1031b04901ab admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:45.900455 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25813e42-c368-48c0-ba7b-0c53e115af8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:45.901491 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25813e42-c368-48c0-ba7b-0c53e115af8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:45.901731 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25813e42-c368-48c0-ba7b-0c53e115af8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:45.902013 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25813e42-c368-48c0-ba7b-0c53e115af8a admin admin] PATH_INFO: `/v3/users/b58c6baf34654900a45c863c3cf378e7` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:45.903240 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25813e42-c368-48c0-ba7b-0c53e115af8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b58c6baf34654900a45c863c3cf378e7)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:45.905205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25813e42-c368-48c0-ba7b-0c53e115af8a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:45.935969 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b92c4b-d8cc-4891-83c3-d4851573455b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:45.940622 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f941e8a-3ec9-4ed2-a284-f42962907c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:45.941375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f941e8a-3ec9-4ed2-a284-f42962907c4d admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:45.946247 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f941e8a-3ec9-4ed2-a284-f42962907c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:45.946247 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f941e8a-3ec9-4ed2-a284-f42962907c4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:45.946247 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f941e8a-3ec9-4ed2-a284-f42962907c4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:45.946247 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f941e8a-3ec9-4ed2-a284-f42962907c4d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:46.036631 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1262/2515] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:03:45 2022] POST /identity/v3/projects => generated 405 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:03:46.040819 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f941e8a-3ec9-4ed2-a284-f42962907c4d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:46.105788 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f941e8a-3ec9-4ed2-a284-f42962907c4d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:46.112473 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a9241-bba5-4e65-b605-dbb1b1af571d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:46.113374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a9241-bba5-4e65-b605-dbb1b1af571d admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:46.113728 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a9241-bba5-4e65-b605-dbb1b1af571d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:46.114195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a9241-bba5-4e65-b605-dbb1b1af571d admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:46.115312 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a9241-bba5-4e65-b605-dbb1b1af571d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:46.118321 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a9241-bba5-4e65-b605-dbb1b1af571d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:46.120365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-25813e42-c368-48c0-ba7b-0c53e115af8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b58c6baf34654900a45c863c3cf378e7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:46.212552 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-25813e42-c368-48c0-ba7b-0c53e115af8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b58c6baf34654900a45c863c3cf378e7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:46.220882 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1263/2516] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:03:46 2022] POST /identity/v3/users => generated 309 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:03:46.223960 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-25813e42-c368-48c0-ba7b-0c53e115af8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b58c6baf34654900a45c863c3cf378e7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:46.223960 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-25813e42-c368-48c0-ba7b-0c53e115af8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b58c6baf34654900a45c863c3cf378e7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:46.224966 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a9241-bba5-4e65-b605-dbb1b1af571d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:46.226724 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a39a9241-bba5-4e65-b605-dbb1b1af571d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:46.233196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:DELETE=12,keystone:SELECT=84,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:46.236132 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-25813e42-c368-48c0-ba7b-0c53e115af8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b58c6baf34654900a45c863c3cf378e7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:46.240299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a9241-bba5-4e65-b605-dbb1b1af571d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:46.244453 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1254/2517] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:03:45 2022] DELETE /identity/v3/users/b58c6baf34654900a45c863c3cf378e7 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:03:46.245974 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a583e1-e37d-4c2d-8c39-74b5ad627eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:46.246731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a583e1-e37d-4c2d-8c39-74b5ad627eec admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:46.247023 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a583e1-e37d-4c2d-8c39-74b5ad627eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:46.247319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a583e1-e37d-4c2d-8c39-74b5ad627eec admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:46.248039 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a583e1-e37d-4c2d-8c39-74b5ad627eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:46.248373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284d6f8-b808-4214-8b64-6661f7c6696e None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:46.248673 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284d6f8-b808-4214-8b64-6661f7c6696e None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:46.248957 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284d6f8-b808-4214-8b64-6661f7c6696e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:46.249671 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a583e1-e37d-4c2d-8c39-74b5ad627eec admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:46.261264 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1264/2518] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:03:46.265174 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a583e1-e37d-4c2d-8c39-74b5ad627eec admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:46.266791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a284d6f8-b808-4214-8b64-6661f7c6696e None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:46.268011 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a284d6f8-b808-4214-8b64-6661f7c6696e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:46.275245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a583e1-e37d-4c2d-8c39-74b5ad627eec admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:46.293188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:46.332368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1255/2519] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:46.337447 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46feb290-5455-4277-8f3b-723713ffc8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:46.337924 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46feb290-5455-4277-8f3b-723713ffc8bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:46.338211 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46feb290-5455-4277-8f3b-723713ffc8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:46.338491 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46feb290-5455-4277-8f3b-723713ffc8bc admin admin] PATH_INFO: `/v3/projects/90ac0cfd130645ce8987911a3621ed0a/users/733a365a77a240e5bc4db8d6922867ee/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:46.342393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284d6f8-b808-4214-8b64-6661f7c6696e None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:46.343776 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a284d6f8-b808-4214-8b64-6661f7c6696e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:46.353975 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46feb290-5455-4277-8f3b-723713ffc8bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ac0cfd130645ce8987911a3621ed0a, user_id=733a365a77a240e5bc4db8d6922867ee, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:46.356655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46feb290-5455-4277-8f3b-723713ffc8bc admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:46.410409 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284d6f8-b808-4214-8b64-6661f7c6696e None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:46.414842 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d84fb-2eac-43d4-992b-688fceddb482 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:46.415501 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d84fb-2eac-43d4-992b-688fceddb482 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:46.415840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d84fb-2eac-43d4-992b-688fceddb482 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:46.416118 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d84fb-2eac-43d4-992b-688fceddb482 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:46.425545 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d84fb-2eac-43d4-992b-688fceddb482 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:46.426973 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d84fb-2eac-43d4-992b-688fceddb482 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:46.437863 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1256/2520] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:03:46.464325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1265/2521] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:03:46 2022] PUT /identity/v3/projects/90ac0cfd130645ce8987911a3621ed0a/users/733a365a77a240e5bc4db8d6922867ee/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:03:46.468529 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d84fb-2eac-43d4-992b-688fceddb482 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:46.479936 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d84fb-2eac-43d4-992b-688fceddb482 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:46.541459 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea3da08-0e29-4d92-bbf0-5beb80fc9728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:46.542206 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3da08-0e29-4d92-bbf0-5beb80fc9728 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:46.542490 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3da08-0e29-4d92-bbf0-5beb80fc9728 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:46.542764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea3da08-0e29-4d92-bbf0-5beb80fc9728 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:46.543541 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3da08-0e29-4d92-bbf0-5beb80fc9728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:46.545128 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea3da08-0e29-4d92-bbf0-5beb80fc9728 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:46.556052 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1257/2522] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:03:46.560613 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46feb290-5455-4277-8f3b-723713ffc8bc admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:46.571844 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46feb290-5455-4277-8f3b-723713ffc8bc admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:46.576520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c03705-1ea8-4c47-9b04-118331727369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:46.577449 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c03705-1ea8-4c47-9b04-118331727369 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:46.577734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c03705-1ea8-4c47-9b04-118331727369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:46.578049 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c03705-1ea8-4c47-9b04-118331727369 admin admin] PATH_INFO: `/v3/projects/90ac0cfd130645ce8987911a3621ed0a/users/733a365a77a240e5bc4db8d6922867ee/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:46.580039 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c03705-1ea8-4c47-9b04-118331727369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90ac0cfd130645ce8987911a3621ed0a, user_id=733a365a77a240e5bc4db8d6922867ee, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:46.582726 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c03705-1ea8-4c47-9b04-118331727369 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:46.593831 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1266/2523] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:03:46 2022] PUT /identity/v3/projects/90ac0cfd130645ce8987911a3621ed0a/users/733a365a77a240e5bc4db8d6922867ee/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:46.604066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4c35c-6e3b-4a5e-80ac-0963c129f5f7 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:46.604357 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4c35c-6e3b-4a5e-80ac-0963c129f5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:46.604635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff4c35c-6e3b-4a5e-80ac-0963c129f5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:46.633799 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-8ff4c35c-6e3b-4a5e-80ac-0963c129f5f7 None None] MFA Rules not processed for user `733a365a77a240e5bc4db8d6922867ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:46.635006 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8ff4c35c-6e3b-4a5e-80ac-0963c129f5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:46.657755 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:46.712980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1258/2524] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:46 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:46.724001 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c03705-1ea8-4c47-9b04-118331727369 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:46.725921 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-98c03705-1ea8-4c47-9b04-118331727369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:46.787024 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c03705-1ea8-4c47-9b04-118331727369 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:46.790921 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e799c7-3565-4763-9174-75b6ed2d33c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:46.791570 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e799c7-3565-4763-9174-75b6ed2d33c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:46.791858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e799c7-3565-4763-9174-75b6ed2d33c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:46.792140 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e799c7-3565-4763-9174-75b6ed2d33c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:46.801476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e799c7-3565-4763-9174-75b6ed2d33c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:46.802888 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e799c7-3565-4763-9174-75b6ed2d33c5 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:46.812834 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1267/2525] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:46 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:03:46.837766 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4c35c-6e3b-4a5e-80ac-0963c129f5f7 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:46.839390 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8ff4c35c-6e3b-4a5e-80ac-0963c129f5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:46.917264 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff4c35c-6e3b-4a5e-80ac-0963c129f5f7 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:46.921845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0fd36-9bb0-42e4-985a-ef545798f2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:46.922719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0fd36-9bb0-42e4-985a-ef545798f2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:46.923003 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0fd36-9bb0-42e4-985a-ef545798f2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:46.923279 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a0fd36-9bb0-42e4-985a-ef545798f2fb admin admin] PATH_INFO: `/v3/projects/4e45051d4c0048bdb82c72c7784ae46a` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:46.924480 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a0fd36-9bb0-42e4-985a-ef545798f2fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e45051d4c0048bdb82c72c7784ae46a)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:46.926421 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a0fd36-9bb0-42e4-985a-ef545798f2fb admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:46.993972 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e799c7-3565-4763-9174-75b6ed2d33c5 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:47.004482 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e799c7-3565-4763-9174-75b6ed2d33c5 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:47.009183 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa754066-f2b3-4a59-bd82-7ce6a7fde471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:47.010051 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa754066-f2b3-4a59-bd82-7ce6a7fde471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:47.010337 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa754066-f2b3-4a59-bd82-7ce6a7fde471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:47.010621 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa754066-f2b3-4a59-bd82-7ce6a7fde471 admin admin] PATH_INFO: `/v3/users/47478df928fc4bbe90776a50a50fd659` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:47.011825 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa754066-f2b3-4a59-bd82-7ce6a7fde471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47478df928fc4bbe90776a50a50fd659)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:47.013785 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa754066-f2b3-4a59-bd82-7ce6a7fde471 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:47.076008 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-47a0fd36-9bb0-42e4-985a-ef545798f2fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e45051d4c0048bdb82c72c7784ae46a', 'request_id': 'req-47a0fd36-9bb0-42e4-985a-ef545798f2fb'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:47.081502 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-47a0fd36-9bb0-42e4-985a-ef545798f2fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e45051d4c0048bdb82c72c7784ae46a', 'request_id': 'req-47a0fd36-9bb0-42e4-985a-ef545798f2fb'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:47.088342 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-47a0fd36-9bb0-42e4-985a-ef545798f2fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e45051d4c0048bdb82c72c7784ae46a', 'request_id': 'req-47a0fd36-9bb0-42e4-985a-ef545798f2fb'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:47.183963 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-47a0fd36-9bb0-42e4-985a-ef545798f2fb admin admin] The token cache is being invalidate because project 4e45051d4c0048bdb82c72c7784ae46a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:03:47.188536 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-47a0fd36-9bb0-42e4-985a-ef545798f2fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:47.188536 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-47a0fd36-9bb0-42e4-985a-ef545798f2fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:47.188536 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1259/2526] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:03:46 2022] DELETE /identity/v3/projects/4e45051d4c0048bdb82c72c7784ae46a => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:47.190504 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0fd36-9bb0-42e4-985a-ef545798f2fb admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:47.191794 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-47a0fd36-9bb0-42e4-985a-ef545798f2fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:47.243037 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:47.249720 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-aa754066-f2b3-4a59-bd82-7ce6a7fde471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47478df928fc4bbe90776a50a50fd659'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:47.258577 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a0fd36-9bb0-42e4-985a-ef545798f2fb admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:47.263369 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0798eb-715e-47ad-be06-6af7a522e8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:47.264251 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0798eb-715e-47ad-be06-6af7a522e8e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:47.264540 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0798eb-715e-47ad-be06-6af7a522e8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:47.264817 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0798eb-715e-47ad-be06-6af7a522e8e0 admin admin] PATH_INFO: `/v3/users/d152f54ff89b40d1bcb4044c711e3429` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:47.266190 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0798eb-715e-47ad-be06-6af7a522e8e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d152f54ff89b40d1bcb4044c711e3429)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:47.268119 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0798eb-715e-47ad-be06-6af7a522e8e0 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:47.321260 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-aa754066-f2b3-4a59-bd82-7ce6a7fde471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47478df928fc4bbe90776a50a50fd659'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:47.328871 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-aa754066-f2b3-4a59-bd82-7ce6a7fde471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47478df928fc4bbe90776a50a50fd659'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:47.329529 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-aa754066-f2b3-4a59-bd82-7ce6a7fde471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47478df928fc4bbe90776a50a50fd659'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:47.342847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-aa754066-f2b3-4a59-bd82-7ce6a7fde471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47478df928fc4bbe90776a50a50fd659'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:47.349090 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1268/2527] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:03:46 2022] DELETE /identity/v3/users/47478df928fc4bbe90776a50a50fd659 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:47.353465 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e1040-8115-4aea-b6bd-7466cf349b30 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:47.353760 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e1040-8115-4aea-b6bd-7466cf349b30 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:47.354049 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e1040-8115-4aea-b6bd-7466cf349b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:47.361150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:47.371512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-995e1040-8115-4aea-b6bd-7466cf349b30 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:47.372720 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-995e1040-8115-4aea-b6bd-7466cf349b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:47.422883 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5b0798eb-715e-47ad-be06-6af7a522e8e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd152f54ff89b40d1bcb4044c711e3429'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:47.435662 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1269/2528] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:03:47.446773 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e1040-8115-4aea-b6bd-7466cf349b30 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:47.448246 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-995e1040-8115-4aea-b6bd-7466cf349b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:47.475392 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5b0798eb-715e-47ad-be06-6af7a522e8e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd152f54ff89b40d1bcb4044c711e3429'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:47.484969 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5b0798eb-715e-47ad-be06-6af7a522e8e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd152f54ff89b40d1bcb4044c711e3429'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:47.486036 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5b0798eb-715e-47ad-be06-6af7a522e8e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd152f54ff89b40d1bcb4044c711e3429'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:47.502177 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5b0798eb-715e-47ad-be06-6af7a522e8e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd152f54ff89b40d1bcb4044c711e3429'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:47.508843 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1260/2529] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:03:47 2022] DELETE /identity/v3/users/d152f54ff89b40d1bcb4044c711e3429 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:03:47.516164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e1040-8115-4aea-b6bd-7466cf349b30 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:47.576404 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdaf1a6-5f6c-4688-ad53-bfecb414ad14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:47.577207 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaf1a6-5f6c-4688-ad53-bfecb414ad14 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:47.577577 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaf1a6-5f6c-4688-ad53-bfecb414ad14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:47.577928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaf1a6-5f6c-4688-ad53-bfecb414ad14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:47.580005 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4bdaf1a6-5f6c-4688-ad53-bfecb414ad14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:47.647508 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdaf1a6-5f6c-4688-ad53-bfecb414ad14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:47.649463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdaf1a6-5f6c-4688-ad53-bfecb414ad14 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:47.659514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1270/2530] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:03:48.012010 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0798eb-715e-47ad-be06-6af7a522e8e0 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:48.013037 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5b0798eb-715e-47ad-be06-6af7a522e8e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:48.029784 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0798eb-715e-47ad-be06-6af7a522e8e0 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:48.037519 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c199bac-0939-4e9f-89a3-1facc90b7117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:48.038823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c199bac-0939-4e9f-89a3-1facc90b7117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:48.039572 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c199bac-0939-4e9f-89a3-1facc90b7117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:48.040010 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c199bac-0939-4e9f-89a3-1facc90b7117 admin admin] PATH_INFO: `/v3/projects/0bdd45ead87d45c384194d3e3f2099e4` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:48.042664 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c199bac-0939-4e9f-89a3-1facc90b7117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bdd45ead87d45c384194d3e3f2099e4)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:48.045228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c199bac-0939-4e9f-89a3-1facc90b7117 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:48.145424 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1c199bac-0939-4e9f-89a3-1facc90b7117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bdd45ead87d45c384194d3e3f2099e4', 'request_id': 'req-1c199bac-0939-4e9f-89a3-1facc90b7117'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:48.155635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1c199bac-0939-4e9f-89a3-1facc90b7117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bdd45ead87d45c384194d3e3f2099e4', 'request_id': 'req-1c199bac-0939-4e9f-89a3-1facc90b7117'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:48.163162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1c199bac-0939-4e9f-89a3-1facc90b7117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bdd45ead87d45c384194d3e3f2099e4', 'request_id': 'req-1c199bac-0939-4e9f-89a3-1facc90b7117'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:48.259468 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1c199bac-0939-4e9f-89a3-1facc90b7117 admin admin] The token cache is being invalidate because project 0bdd45ead87d45c384194d3e3f2099e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:03:48.260246 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1c199bac-0939-4e9f-89a3-1facc90b7117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:48.260975 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1c199bac-0939-4e9f-89a3-1facc90b7117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:48.261449 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdaf1a6-5f6c-4688-ad53-bfecb414ad14 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:48.262919 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1261/2531] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:03:48 2022] DELETE /identity/v3/projects/0bdd45ead87d45c384194d3e3f2099e4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:48.263041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4bdaf1a6-5f6c-4688-ad53-bfecb414ad14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:48.267449 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dcfea-0c37-4e89-9cbc-ed0952ff5350 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:48.267746 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dcfea-0c37-4e89-9cbc-ed0952ff5350 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:48.268094 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dcfea-0c37-4e89-9cbc-ed0952ff5350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:48.278939 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdaf1a6-5f6c-4688-ad53-bfecb414ad14 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:48.288294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-947dcfea-0c37-4e89-9cbc-ed0952ff5350 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:48.289611 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-947dcfea-0c37-4e89-9cbc-ed0952ff5350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:48.290380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:48.339262 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:48.341565 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248af2ed-eb06-40c2-9710-8fe0782bdb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:48.342509 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248af2ed-eb06-40c2-9710-8fe0782bdb02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:48.342796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248af2ed-eb06-40c2-9710-8fe0782bdb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:48.343069 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248af2ed-eb06-40c2-9710-8fe0782bdb02 admin admin] PATH_INFO: `/v3/projects/a85696792e0e4fd4b1fa314444cdacfe` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:48.344324 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248af2ed-eb06-40c2-9710-8fe0782bdb02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a85696792e0e4fd4b1fa314444cdacfe)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:48.346325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248af2ed-eb06-40c2-9710-8fe0782bdb02 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:48.354505 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1262/2532] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:03:48.362866 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db38e86-3c40-4cdb-8ceb-ca6b90b77be2 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:48.363447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db38e86-3c40-4cdb-8ceb-ca6b90b77be2 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:48.363748 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db38e86-3c40-4cdb-8ceb-ca6b90b77be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:48.388083 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-3db38e86-3c40-4cdb-8ceb-ca6b90b77be2 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:48.389523 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3db38e86-3c40-4cdb-8ceb-ca6b90b77be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:48.399608 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1263/2533] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:03:48.404004 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db38e86-3c40-4cdb-8ceb-ca6b90b77be2 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:48.413437 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db38e86-3c40-4cdb-8ceb-ca6b90b77be2 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:48.418703 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6b92f-c7b0-4cb9-a905-b2300b543cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:48.419383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6b92f-c7b0-4cb9-a905-b2300b543cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:48.419669 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6b92f-c7b0-4cb9-a905-b2300b543cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:48.419948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6b92f-c7b0-4cb9-a905-b2300b543cf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:48.420683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6b92f-c7b0-4cb9-a905-b2300b543cf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:03:48.420993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6b92f-c7b0-4cb9-a905-b2300b543cf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:48.422679 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6b92f-c7b0-4cb9-a905-b2300b543cf7 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:48.435420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1264/2534] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 17:03:48.439933 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6b92f-c7b0-4cb9-a905-b2300b543cf7 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:48.450101 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6b92f-c7b0-4cb9-a905-b2300b543cf7 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:48.455568 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f8860-66ec-479a-bbd4-92e35dec828c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:48.456225 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f8860-66ec-479a-bbd4-92e35dec828c admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:48.462255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f8860-66ec-479a-bbd4-92e35dec828c admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:48.462255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f8860-66ec-479a-bbd4-92e35dec828c admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:48.462255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f8860-66ec-479a-bbd4-92e35dec828c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:48.462255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f8860-66ec-479a-bbd4-92e35dec828c admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:48.512316 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-248af2ed-eb06-40c2-9710-8fe0782bdb02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a85696792e0e4fd4b1fa314444cdacfe', 'request_id': 'req-248af2ed-eb06-40c2-9710-8fe0782bdb02'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:48.518850 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-248af2ed-eb06-40c2-9710-8fe0782bdb02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a85696792e0e4fd4b1fa314444cdacfe', 'request_id': 'req-248af2ed-eb06-40c2-9710-8fe0782bdb02'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:48.525282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-248af2ed-eb06-40c2-9710-8fe0782bdb02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a85696792e0e4fd4b1fa314444cdacfe', 'request_id': 'req-248af2ed-eb06-40c2-9710-8fe0782bdb02'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:48.557034 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1265/2535] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:03:48 2022] POST /identity/v3/projects => generated 377 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:03:48.561437 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f8860-66ec-479a-bbd4-92e35dec828c admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:48.617911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-248af2ed-eb06-40c2-9710-8fe0782bdb02 admin admin] The token cache is being invalidate because project a85696792e0e4fd4b1fa314444cdacfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:03:48.618187 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-248af2ed-eb06-40c2-9710-8fe0782bdb02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:48.620226 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-248af2ed-eb06-40c2-9710-8fe0782bdb02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:48.624934 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1271/2536] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:03:48 2022] DELETE /identity/v3/projects/a85696792e0e4fd4b1fa314444cdacfe => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:03:48.625826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248af2ed-eb06-40c2-9710-8fe0782bdb02 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:48.627194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-248af2ed-eb06-40c2-9710-8fe0782bdb02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:48.632551 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f8860-66ec-479a-bbd4-92e35dec828c admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:48.638398 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a12a6-a95c-4b15-a3d0-f5ef90a538be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:48.639145 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a12a6-a95c-4b15-a3d0-f5ef90a538be admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:48.639429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a12a6-a95c-4b15-a3d0-f5ef90a538be admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:48.640147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a12a6-a95c-4b15-a3d0-f5ef90a538be admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:48.640492 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a12a6-a95c-4b15-a3d0-f5ef90a538be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:48.642607 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6a12a6-a95c-4b15-a3d0-f5ef90a538be admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:48.694661 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248af2ed-eb06-40c2-9710-8fe0782bdb02 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:48.700229 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335707d-6df2-4687-b0f8-edeebe032720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:48.701176 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335707d-6df2-4687-b0f8-edeebe032720 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:48.701465 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335707d-6df2-4687-b0f8-edeebe032720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:48.701745 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9335707d-6df2-4687-b0f8-edeebe032720 admin admin] PATH_INFO: `/v3/users/733a365a77a240e5bc4db8d6922867ee` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:48.703045 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335707d-6df2-4687-b0f8-edeebe032720 admin admin] RBAC: Authorizing `identity:delete_user(user_id=733a365a77a240e5bc4db8d6922867ee)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:48.705024 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9335707d-6df2-4687-b0f8-edeebe032720 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:48.733510 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1266/2537] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:03:48 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:03:48.737694 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a12a6-a95c-4b15-a3d0-f5ef90a538be admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:48.739335 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-cf6a12a6-a95c-4b15-a3d0-f5ef90a538be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:48.753143 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a12a6-a95c-4b15-a3d0-f5ef90a538be admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:48.757920 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2428807-c94b-4bc5-bafa-c8e47c918988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:48.758593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2428807-c94b-4bc5-bafa-c8e47c918988 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:48.758885 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2428807-c94b-4bc5-bafa-c8e47c918988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:48.759247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2428807-c94b-4bc5-bafa-c8e47c918988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:48.759969 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2428807-c94b-4bc5-bafa-c8e47c918988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:48.762141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2428807-c94b-4bc5-bafa-c8e47c918988 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:48.773267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1267/2538] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:03:48.778077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2428807-c94b-4bc5-bafa-c8e47c918988 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:48.788295 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2428807-c94b-4bc5-bafa-c8e47c918988 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:48.793225 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a42f7a-9032-4548-aac6-c74a120eb347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:48.793887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a42f7a-9032-4548-aac6-c74a120eb347 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:48.794178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a42f7a-9032-4548-aac6-c74a120eb347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:48.794462 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a42f7a-9032-4548-aac6-c74a120eb347 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:48.795187 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a42f7a-9032-4548-aac6-c74a120eb347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:48.796796 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a42f7a-9032-4548-aac6-c74a120eb347 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:48.807184 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1268/2539] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:03:48.811743 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a42f7a-9032-4548-aac6-c74a120eb347 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:48.821433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a42f7a-9032-4548-aac6-c74a120eb347 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:48.826887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc17af-034f-4cb4-8c22-1cc22ccc78d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:48.827800 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc17af-034f-4cb4-8c22-1cc22ccc78d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:48.828085 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc17af-034f-4cb4-8c22-1cc22ccc78d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:48.828366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc17af-034f-4cb4-8c22-1cc22ccc78d4 admin admin] PATH_INFO: `/v3/projects/8b16481909894fc88d9be118c8f4d4cf/users/ffb43314dab24176a9610bd197f711dc/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:48.845096 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc17af-034f-4cb4-8c22-1cc22ccc78d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b16481909894fc88d9be118c8f4d4cf, user_id=ffb43314dab24176a9610bd197f711dc, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:48.847831 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cc17af-034f-4cb4-8c22-1cc22ccc78d4 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:48.848070 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:48.850375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9335707d-6df2-4687-b0f8-edeebe032720 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '733a365a77a240e5bc4db8d6922867ee'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:48.938252 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9335707d-6df2-4687-b0f8-edeebe032720 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '733a365a77a240e5bc4db8d6922867ee'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:48.944253 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1269/2540] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:03:48 2022] PUT /identity/v3/projects/8b16481909894fc88d9be118c8f4d4cf/users/ffb43314dab24176a9610bd197f711dc/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:03:48.946292 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9335707d-6df2-4687-b0f8-edeebe032720 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '733a365a77a240e5bc4db8d6922867ee'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:48.946991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9335707d-6df2-4687-b0f8-edeebe032720 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '733a365a77a240e5bc4db8d6922867ee'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:48.955987 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c038bb-fd12-458d-bff1-8fec6f4770f2 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:48.956262 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c038bb-fd12-458d-bff1-8fec6f4770f2 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:48.960356 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c038bb-fd12-458d-bff1-8fec6f4770f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:48.961336 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-9335707d-6df2-4687-b0f8-edeebe032720 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '733a365a77a240e5bc4db8d6922867ee'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:48.969794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1272/2541] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:03:48 2022] DELETE /identity/v3/users/733a365a77a240e5bc4db8d6922867ee => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:48.989132 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-50c038bb-fd12-458d-bff1-8fec6f4770f2 None None] MFA Rules not processed for user `ffb43314dab24176a9610bd197f711dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:48.990226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-50c038bb-fd12-458d-bff1-8fec6f4770f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:49.033457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:49.058834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1270/2542] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:03:49.063144 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335707d-6df2-4687-b0f8-edeebe032720 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:49.064587 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9335707d-6df2-4687-b0f8-edeebe032720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:49.132428 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9335707d-6df2-4687-b0f8-edeebe032720 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:49.138132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8146ef-8aeb-41d8-bac4-37d417ba7f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:49.138912 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8146ef-8aeb-41d8-bac4-37d417ba7f4f admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:49.139122 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8146ef-8aeb-41d8-bac4-37d417ba7f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:49.139676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8146ef-8aeb-41d8-bac4-37d417ba7f4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:49.140094 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8146ef-8aeb-41d8-bac4-37d417ba7f4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:49.142097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8146ef-8aeb-41d8-bac4-37d417ba7f4f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:49.225859 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1273/2543] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:03:49 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:03:49.230129 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c038bb-fd12-458d-bff1-8fec6f4770f2 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:49.241654 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c038bb-fd12-458d-bff1-8fec6f4770f2 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:49.303367 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de33fe-a9db-4777-8d75-c1fc6b6a4707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:49.304099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de33fe-a9db-4777-8d75-c1fc6b6a4707 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:49.304329 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de33fe-a9db-4777-8d75-c1fc6b6a4707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:49.304616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8de33fe-a9db-4777-8d75-c1fc6b6a4707 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:49.305355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de33fe-a9db-4777-8d75-c1fc6b6a4707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:49.307937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8de33fe-a9db-4777-8d75-c1fc6b6a4707 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:49.380705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8146ef-8aeb-41d8-bac4-37d417ba7f4f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:49.384154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-6e8146ef-8aeb-41d8-bac4-37d417ba7f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:49.404067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8146ef-8aeb-41d8-bac4-37d417ba7f4f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:49.404238 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1271/2544] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:03:49 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:03:49.407125 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd5a39-44a3-4a39-a21d-95f9ebf38ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:49.407495 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de33fe-a9db-4777-8d75-c1fc6b6a4707 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:49.408051 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd5a39-44a3-4a39-a21d-95f9ebf38ca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:49.408339 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd5a39-44a3-4a39-a21d-95f9ebf38ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:49.408630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd5a39-44a3-4a39-a21d-95f9ebf38ca3 admin admin] PATH_INFO: `/v3/projects/90ac0cfd130645ce8987911a3621ed0a` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:49.409998 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd5a39-44a3-4a39-a21d-95f9ebf38ca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90ac0cfd130645ce8987911a3621ed0a)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:49.411985 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd5a39-44a3-4a39-a21d-95f9ebf38ca3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:49.420199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8de33fe-a9db-4777-8d75-c1fc6b6a4707 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:49.435467 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3926e5-7ccf-4bcf-8c1b-b633d4aa0b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:49.436155 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3926e5-7ccf-4bcf-8c1b-b633d4aa0b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:49.436433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3926e5-7ccf-4bcf-8c1b-b633d4aa0b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:49.436709 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3926e5-7ccf-4bcf-8c1b-b633d4aa0b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:49.437476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3926e5-7ccf-4bcf-8c1b-b633d4aa0b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:49.439091 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3926e5-7ccf-4bcf-8c1b-b633d4aa0b02 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:49.450055 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1272/2545] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:03:49.460291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3926e5-7ccf-4bcf-8c1b-b633d4aa0b02 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:49.480816 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3926e5-7ccf-4bcf-8c1b-b633d4aa0b02 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:49.485933 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35cf28-4ef2-41fe-969c-0c71a40002e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:49.486821 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35cf28-4ef2-41fe-969c-0c71a40002e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:49.487105 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35cf28-4ef2-41fe-969c-0c71a40002e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:49.487408 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35cf28-4ef2-41fe-969c-0c71a40002e5 admin admin] PATH_INFO: `/v3/projects/4a35abaaac714727be6055b9231b6839/users/2319dbf6c3e24b12a598911dfd2747b7/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:49.503471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35cf28-4ef2-41fe-969c-0c71a40002e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a35abaaac714727be6055b9231b6839, user_id=2319dbf6c3e24b12a598911dfd2747b7, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:49.507221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a35cf28-4ef2-41fe-969c-0c71a40002e5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:49.522255 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-51fd5a39-44a3-4a39-a21d-95f9ebf38ca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90ac0cfd130645ce8987911a3621ed0a', 'request_id': 'req-51fd5a39-44a3-4a39-a21d-95f9ebf38ca3'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:49.529364 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-51fd5a39-44a3-4a39-a21d-95f9ebf38ca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90ac0cfd130645ce8987911a3621ed0a', 'request_id': 'req-51fd5a39-44a3-4a39-a21d-95f9ebf38ca3'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:49.535007 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-51fd5a39-44a3-4a39-a21d-95f9ebf38ca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90ac0cfd130645ce8987911a3621ed0a', 'request_id': 'req-51fd5a39-44a3-4a39-a21d-95f9ebf38ca3'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:49.583981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1273/2546] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:03:49 2022] PUT /identity/v3/projects/4a35abaaac714727be6055b9231b6839/users/2319dbf6c3e24b12a598911dfd2747b7/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:03:49.588008 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35cf28-4ef2-41fe-969c-0c71a40002e5 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:49.612168 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-51fd5a39-44a3-4a39-a21d-95f9ebf38ca3 admin admin] The token cache is being invalidate because project 90ac0cfd130645ce8987911a3621ed0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:03:49.612508 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-51fd5a39-44a3-4a39-a21d-95f9ebf38ca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:49.613825 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-51fd5a39-44a3-4a39-a21d-95f9ebf38ca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:49.615223 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1274/2547] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:03:49 2022] DELETE /identity/v3/projects/90ac0cfd130645ce8987911a3621ed0a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:03:49.620792 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac49f8-edea-4e7f-8cf3-094b7bb1453b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:49.621275 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac49f8-edea-4e7f-8cf3-094b7bb1453b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:49.621595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beac49f8-edea-4e7f-8cf3-094b7bb1453b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:49.640503 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-beac49f8-edea-4e7f-8cf3-094b7bb1453b None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:49.641799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-beac49f8-edea-4e7f-8cf3-094b7bb1453b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:49.654889 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35cf28-4ef2-41fe-969c-0c71a40002e5 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:49.659771 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7e9a2-747b-4da1-b9f1-8f2919655508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:49.660613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7e9a2-747b-4da1-b9f1-8f2919655508 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:49.660996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7e9a2-747b-4da1-b9f1-8f2919655508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:49.661353 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab7e9a2-747b-4da1-b9f1-8f2919655508 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:49.662130 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7e9a2-747b-4da1-b9f1-8f2919655508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:49.663759 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab7e9a2-747b-4da1-b9f1-8f2919655508 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:49.666134 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:49.680455 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1274/2548] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:03:49.681609 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7e9a2-747b-4da1-b9f1-8f2919655508 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:49.684182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-eab7e9a2-747b-4da1-b9f1-8f2919655508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:49.697455 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab7e9a2-747b-4da1-b9f1-8f2919655508 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:49.702469 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188b8fc-fee8-4d16-b416-f5977773a50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:49.703423 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188b8fc-fee8-4d16-b416-f5977773a50c admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:49.704478 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188b8fc-fee8-4d16-b416-f5977773a50c admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:49.704478 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188b8fc-fee8-4d16-b416-f5977773a50c admin admin] PATH_INFO: `/v3/projects/4a35abaaac714727be6055b9231b6839/users/2319dbf6c3e24b12a598911dfd2747b7/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:49.706128 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188b8fc-fee8-4d16-b416-f5977773a50c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a35abaaac714727be6055b9231b6839, user_id=2319dbf6c3e24b12a598911dfd2747b7, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:49.714561 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1275/2549] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:03:49.714748 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188b8fc-fee8-4d16-b416-f5977773a50c admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:49.716331 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047ee90-fe08-4fcc-a558-fbffebfa32a9 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:49.716630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047ee90-fe08-4fcc-a558-fbffebfa32a9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:49.716914 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047ee90-fe08-4fcc-a558-fbffebfa32a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:49.719908 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1275/2550] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:03:49 2022] PUT /identity/v3/projects/4a35abaaac714727be6055b9231b6839/users/2319dbf6c3e24b12a598911dfd2747b7/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:49.730610 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d6edb-4536-458c-b007-57ca4bf1ecb1 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:49.730950 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d6edb-4536-458c-b007-57ca4bf1ecb1 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:49.731184 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d6edb-4536-458c-b007-57ca4bf1ecb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:49.738334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2047ee90-fe08-4fcc-a558-fbffebfa32a9 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:49.739698 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2047ee90-fe08-4fcc-a558-fbffebfa32a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:49.759469 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a91d6edb-4536-458c-b007-57ca4bf1ecb1 None None] MFA Rules not processed for user `2319dbf6c3e24b12a598911dfd2747b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:49.762823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a91d6edb-4536-458c-b007-57ca4bf1ecb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:49.772256 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:49.808845 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1276/2551] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:49.813216 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047ee90-fe08-4fcc-a558-fbffebfa32a9 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:49.823067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047ee90-fe08-4fcc-a558-fbffebfa32a9 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:49.827883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318b088-95ec-4e0d-a0ab-541df38ed4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:49.828578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318b088-95ec-4e0d-a0ab-541df38ed4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:49.828869 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318b088-95ec-4e0d-a0ab-541df38ed4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:49.829183 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318b088-95ec-4e0d-a0ab-541df38ed4e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:49.829950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318b088-95ec-4e0d-a0ab-541df38ed4e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:03:49.830259 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318b088-95ec-4e0d-a0ab-541df38ed4e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:49.831934 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3318b088-95ec-4e0d-a0ab-541df38ed4e2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:49.848480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1277/2552] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 17:03:49.848787 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1276/2553] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:03:49.851993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318b088-95ec-4e0d-a0ab-541df38ed4e2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:49.856960 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d6edb-4536-458c-b007-57ca4bf1ecb1 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:49.858369 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a91d6edb-4536-458c-b007-57ca4bf1ecb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:49.863412 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318b088-95ec-4e0d-a0ab-541df38ed4e2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:49.868115 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddfe39-11e6-416f-8874-9e34d7653218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:49.868772 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddfe39-11e6-416f-8874-9e34d7653218 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:49.869096 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddfe39-11e6-416f-8874-9e34d7653218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:49.869415 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddfe39-11e6-416f-8874-9e34d7653218 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:49.870450 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddfe39-11e6-416f-8874-9e34d7653218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:49.872477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddfe39-11e6-416f-8874-9e34d7653218 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:49.919787 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d6edb-4536-458c-b007-57ca4bf1ecb1 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:49.923541 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316040a-311b-4250-9a07-f78c074debb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:49.924202 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316040a-311b-4250-9a07-f78c074debb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:49.924486 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316040a-311b-4250-9a07-f78c074debb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:49.924762 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316040a-311b-4250-9a07-f78c074debb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:49.926696 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5316040a-311b-4250-9a07-f78c074debb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:49.974650 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1278/2554] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:03:49 2022] POST /identity/v3/projects => generated 387 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:03:49.980302 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddfe39-11e6-416f-8874-9e34d7653218 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:49.991954 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316040a-311b-4250-9a07-f78c074debb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:49.993383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316040a-311b-4250-9a07-f78c074debb1 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:50.002614 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1277/2555] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:03:50.047245 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddfe39-11e6-416f-8874-9e34d7653218 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:50.053366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038194e-3962-44dd-947a-32702c5f932e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:50.054098 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038194e-3962-44dd-947a-32702c5f932e admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:50.054393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038194e-3962-44dd-947a-32702c5f932e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:50.054748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0038194e-3962-44dd-947a-32702c5f932e admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:50.063163 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038194e-3962-44dd-947a-32702c5f932e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:50.063163 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0038194e-3962-44dd-947a-32702c5f932e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:50.142553 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1279/2556] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:03:49 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:03:50.143759 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316040a-311b-4250-9a07-f78c074debb1 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:50.156304 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316040a-311b-4250-9a07-f78c074debb1 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:50.160984 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e69cf-c3f1-4571-bafb-e29b5d75fe95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:50.161712 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e69cf-c3f1-4571-bafb-e29b5d75fe95 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:50.162079 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e69cf-c3f1-4571-bafb-e29b5d75fe95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:50.162278 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e69cf-c3f1-4571-bafb-e29b5d75fe95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:50.163009 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e69cf-c3f1-4571-bafb-e29b5d75fe95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:50.164615 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e69cf-c3f1-4571-bafb-e29b5d75fe95 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:50.181324 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1278/2557] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:03:50.185387 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038194e-3962-44dd-947a-32702c5f932e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:50.196592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0038194e-3962-44dd-947a-32702c5f932e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:50.202650 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aaf7d0-3fe9-4c7d-aa9a-751583adae13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:50.203705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aaf7d0-3fe9-4c7d-aa9a-751583adae13 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:50.204192 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aaf7d0-3fe9-4c7d-aa9a-751583adae13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:50.204670 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aaf7d0-3fe9-4c7d-aa9a-751583adae13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:50.205725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aaf7d0-3fe9-4c7d-aa9a-751583adae13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:50.207939 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aaf7d0-3fe9-4c7d-aa9a-751583adae13 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:50.220117 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1280/2558] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:03:50.224937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e69cf-c3f1-4571-bafb-e29b5d75fe95 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:50.235932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e69cf-c3f1-4571-bafb-e29b5d75fe95 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:50.246415 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d60355-1032-40d0-821d-b69989529aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:50.246415 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d60355-1032-40d0-821d-b69989529aee admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:50.246415 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d60355-1032-40d0-821d-b69989529aee admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:50.246415 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d60355-1032-40d0-821d-b69989529aee admin admin] PATH_INFO: `/v3/projects/2ab677afda2c43d499b76ac68408e853/users/d275981541f74b2f827254fd90b7a07b/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:50.257733 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d60355-1032-40d0-821d-b69989529aee admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab677afda2c43d499b76ac68408e853, user_id=d275981541f74b2f827254fd90b7a07b, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:50.261612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d60355-1032-40d0-821d-b69989529aee admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:50.321078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1279/2559] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:03:50 2022] PUT /identity/v3/projects/2ab677afda2c43d499b76ac68408e853/users/d275981541f74b2f827254fd90b7a07b/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:50.332476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7694ec-8014-4b68-b0fb-e324eaf5f3d5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:50.332764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7694ec-8014-4b68-b0fb-e324eaf5f3d5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:50.333073 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7694ec-8014-4b68-b0fb-e324eaf5f3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:50.358762 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:50.366153 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9f7694ec-8014-4b68-b0fb-e324eaf5f3d5 None None] MFA Rules not processed for user `d275981541f74b2f827254fd90b7a07b`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:50.366153 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9f7694ec-8014-4b68-b0fb-e324eaf5f3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:50.433846 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1281/2560] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:50.438486 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d60355-1032-40d0-821d-b69989529aee admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:50.467982 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:50.505554 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d60355-1032-40d0-821d-b69989529aee admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:50.510577 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385adbf-4b49-4bf6-81c3-09b1438893ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:50.511420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385adbf-4b49-4bf6-81c3-09b1438893ee admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:50.511714 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385adbf-4b49-4bf6-81c3-09b1438893ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:50.512004 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385adbf-4b49-4bf6-81c3-09b1438893ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:50.512708 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385adbf-4b49-4bf6-81c3-09b1438893ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:50.514664 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385adbf-4b49-4bf6-81c3-09b1438893ee admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:50.594065 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1280/2561] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:03:50 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:03:50.597911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7694ec-8014-4b68-b0fb-e324eaf5f3d5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:50.607200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7694ec-8014-4b68-b0fb-e324eaf5f3d5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:50.673496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784121d-aaeb-44c7-95f5-463ee12d012b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:50.673496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784121d-aaeb-44c7-95f5-463ee12d012b admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:50.673496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784121d-aaeb-44c7-95f5-463ee12d012b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:50.673496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784121d-aaeb-44c7-95f5-463ee12d012b admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:50.674227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784121d-aaeb-44c7-95f5-463ee12d012b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:50.674227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9784121d-aaeb-44c7-95f5-463ee12d012b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:50.761573 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1282/2562] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:03:50 2022] POST /identity/v3/users => generated 300 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:03:50.766231 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385adbf-4b49-4bf6-81c3-09b1438893ee admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:50.779183 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385adbf-4b49-4bf6-81c3-09b1438893ee admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:50.783967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a82093-1018-45b4-bcf1-dc58c37333ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:50.784649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a82093-1018-45b4-bcf1-dc58c37333ff admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:50.785180 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a82093-1018-45b4-bcf1-dc58c37333ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:50.785463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a82093-1018-45b4-bcf1-dc58c37333ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:50.786195 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a82093-1018-45b4-bcf1-dc58c37333ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:50.787888 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a82093-1018-45b4-bcf1-dc58c37333ff admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:50.801307 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1281/2563] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:03:50.806041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784121d-aaeb-44c7-95f5-463ee12d012b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:50.816424 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784121d-aaeb-44c7-95f5-463ee12d012b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:50.820991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0ef7c-91aa-43fc-9d12-0148de384aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:50.822043 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0ef7c-91aa-43fc-9d12-0148de384aeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:50.822343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0ef7c-91aa-43fc-9d12-0148de384aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:50.822730 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe0ef7c-91aa-43fc-9d12-0148de384aeb admin admin] PATH_INFO: `/v3/projects/c730280936274681bd64de046ecb0685/users/2bc197ac44934a16a2606ab8f60cb4b4/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:50.837672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0ef7c-91aa-43fc-9d12-0148de384aeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c730280936274681bd64de046ecb0685, user_id=2bc197ac44934a16a2606ab8f60cb4b4, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:50.840918 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe0ef7c-91aa-43fc-9d12-0148de384aeb admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:50.922391 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1283/2564] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:03:50 2022] PUT /identity/v3/projects/c730280936274681bd64de046ecb0685/users/2bc197ac44934a16a2606ab8f60cb4b4/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:50.926471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a82093-1018-45b4-bcf1-dc58c37333ff admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:50.938118 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a82093-1018-45b4-bcf1-dc58c37333ff admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:51.002831 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2810016-7ff2-441e-b35a-ba07aa3e1445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:51.003522 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2810016-7ff2-441e-b35a-ba07aa3e1445 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:51.003812 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2810016-7ff2-441e-b35a-ba07aa3e1445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:51.004075 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2810016-7ff2-441e-b35a-ba07aa3e1445 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:51.004804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2810016-7ff2-441e-b35a-ba07aa3e1445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:51.006507 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2810016-7ff2-441e-b35a-ba07aa3e1445 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:51.019173 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1282/2565] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:03:51.023435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0ef7c-91aa-43fc-9d12-0148de384aeb admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:51.035364 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe0ef7c-91aa-43fc-9d12-0148de384aeb admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:51.040150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614719c-c97a-4798-a4f0-b3b04db62fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:51.041114 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614719c-c97a-4798-a4f0-b3b04db62fea admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:51.041568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614719c-c97a-4798-a4f0-b3b04db62fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:51.042082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2614719c-c97a-4798-a4f0-b3b04db62fea admin admin] PATH_INFO: `/v3/projects/c730280936274681bd64de046ecb0685/users/2bc197ac44934a16a2606ab8f60cb4b4/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:51.044406 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614719c-c97a-4798-a4f0-b3b04db62fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=c730280936274681bd64de046ecb0685, user_id=2bc197ac44934a16a2606ab8f60cb4b4, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:51.047146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2614719c-c97a-4798-a4f0-b3b04db62fea admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:51.059357 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1284/2566] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:03:51 2022] PUT /identity/v3/projects/c730280936274681bd64de046ecb0685/users/2bc197ac44934a16a2606ab8f60cb4b4/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:51.069852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102b1d2-bae0-492d-8e31-c09e654599a9 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:51.070148 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102b1d2-bae0-492d-8e31-c09e654599a9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:51.070429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0102b1d2-bae0-492d-8e31-c09e654599a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:51.101114 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-0102b1d2-bae0-492d-8e31-c09e654599a9 None None] MFA Rules not processed for user `2bc197ac44934a16a2606ab8f60cb4b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:51.102357 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0102b1d2-bae0-492d-8e31-c09e654599a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:51.179001 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1283/2567] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:51.190925 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614719c-c97a-4798-a4f0-b3b04db62fea admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:51.249361 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2614719c-c97a-4798-a4f0-b3b04db62fea admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:51.253109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26e937-7fcb-4e29-aeba-3d5c0438a595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:51.253757 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26e937-7fcb-4e29-aeba-3d5c0438a595 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:51.254050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26e937-7fcb-4e29-aeba-3d5c0438a595 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:51.254341 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26e937-7fcb-4e29-aeba-3d5c0438a595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:51.263840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26e937-7fcb-4e29-aeba-3d5c0438a595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:51.265424 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26e937-7fcb-4e29-aeba-3d5c0438a595 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:51.269385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:51.276659 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1285/2568] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:03:51.305308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102b1d2-bae0-492d-8e31-c09e654599a9 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:51.326646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:51.372473 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0102b1d2-bae0-492d-8e31-c09e654599a9 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:51.376944 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc2f11-5ef5-4f94-a9b0-03b3e7cbaa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:51.377860 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc2f11-5ef5-4f94-a9b0-03b3e7cbaa43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:51.378145 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc2f11-5ef5-4f94-a9b0-03b3e7cbaa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:51.378420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcc2f11-5ef5-4f94-a9b0-03b3e7cbaa43 admin admin] PATH_INFO: `/v3/users/d275981541f74b2f827254fd90b7a07b` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:51.379619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc2f11-5ef5-4f94-a9b0-03b3e7cbaa43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d275981541f74b2f827254fd90b7a07b)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:51.381566 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcc2f11-5ef5-4f94-a9b0-03b3e7cbaa43 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:51.552800 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fdcc2f11-5ef5-4f94-a9b0-03b3e7cbaa43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd275981541f74b2f827254fd90b7a07b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:51.631277 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fdcc2f11-5ef5-4f94-a9b0-03b3e7cbaa43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd275981541f74b2f827254fd90b7a07b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:51.641163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fdcc2f11-5ef5-4f94-a9b0-03b3e7cbaa43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd275981541f74b2f827254fd90b7a07b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:51.642024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fdcc2f11-5ef5-4f94-a9b0-03b3e7cbaa43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd275981541f74b2f827254fd90b7a07b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:51.659979 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fdcc2f11-5ef5-4f94-a9b0-03b3e7cbaa43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd275981541f74b2f827254fd90b7a07b'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:51.667824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1284/2569] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:03:51 2022] DELETE /identity/v3/users/d275981541f74b2f827254fd90b7a07b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:51.672372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f3ddd-c12d-453a-9eda-5264a5e5e218 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:51.673170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f3ddd-c12d-453a-9eda-5264a5e5e218 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:51.673170 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f3ddd-c12d-453a-9eda-5264a5e5e218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:51.692927 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-309f3ddd-c12d-453a-9eda-5264a5e5e218 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:51.694281 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-309f3ddd-c12d-453a-9eda-5264a5e5e218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:51.758744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1286/2570] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:03:51.772697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc2f11-5ef5-4f94-a9b0-03b3e7cbaa43 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:51.774358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-fdcc2f11-5ef5-4f94-a9b0-03b3e7cbaa43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:51.839541 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcc2f11-5ef5-4f94-a9b0-03b3e7cbaa43 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:51.843175 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dff85f-68c0-4102-9777-8609e7e32522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:51.843841 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dff85f-68c0-4102-9777-8609e7e32522 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:51.844134 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dff85f-68c0-4102-9777-8609e7e32522 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:51.844412 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dff85f-68c0-4102-9777-8609e7e32522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:51.854757 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dff85f-68c0-4102-9777-8609e7e32522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:51.856320 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dff85f-68c0-4102-9777-8609e7e32522 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:51.868246 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1285/2571] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:03:52.096595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f3ddd-c12d-453a-9eda-5264a5e5e218 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:52.098082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-309f3ddd-c12d-453a-9eda-5264a5e5e218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:52.204805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f3ddd-c12d-453a-9eda-5264a5e5e218 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:52.210674 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4641e0-9294-4dbc-95cf-55abc0df3c65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:52.211330 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4641e0-9294-4dbc-95cf-55abc0df3c65 service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:52.211742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4641e0-9294-4dbc-95cf-55abc0df3c65 service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:52.212922 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4641e0-9294-4dbc-95cf-55abc0df3c65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:52.214141 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8e4641e0-9294-4dbc-95cf-55abc0df3c65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:52.227397 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4641e0-9294-4dbc-95cf-55abc0df3c65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:52.229210 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4641e0-9294-4dbc-95cf-55abc0df3c65 service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:52.241384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1287/2572] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:03:52.358239 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dff85f-68c0-4102-9777-8609e7e32522 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:52.360664 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-43dff85f-68c0-4102-9777-8609e7e32522 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:52.381794 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dff85f-68c0-4102-9777-8609e7e32522 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:52.392176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0425ac-edf6-447f-97ed-cd54bb645638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:52.393193 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0425ac-edf6-447f-97ed-cd54bb645638 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:52.393675 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0425ac-edf6-447f-97ed-cd54bb645638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:52.394357 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0425ac-edf6-447f-97ed-cd54bb645638 admin admin] PATH_INFO: `/v3/projects/2ab677afda2c43d499b76ac68408e853` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:52.395368 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0425ac-edf6-447f-97ed-cd54bb645638 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab677afda2c43d499b76ac68408e853)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:52.397521 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0425ac-edf6-447f-97ed-cd54bb645638 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:52.502975 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:52.512457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4b0425ac-edf6-447f-97ed-cd54bb645638 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab677afda2c43d499b76ac68408e853', 'request_id': 'req-4b0425ac-edf6-447f-97ed-cd54bb645638'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:52.518922 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4b0425ac-edf6-447f-97ed-cd54bb645638 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab677afda2c43d499b76ac68408e853', 'request_id': 'req-4b0425ac-edf6-447f-97ed-cd54bb645638'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:52.525437 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4b0425ac-edf6-447f-97ed-cd54bb645638 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab677afda2c43d499b76ac68408e853', 'request_id': 'req-4b0425ac-edf6-447f-97ed-cd54bb645638'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:52.629425 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4b0425ac-edf6-447f-97ed-cd54bb645638 admin admin] The token cache is being invalidate because project 2ab677afda2c43d499b76ac68408e853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:03:52.629629 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4b0425ac-edf6-447f-97ed-cd54bb645638 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:52.630302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4b0425ac-edf6-447f-97ed-cd54bb645638 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:52.635629 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1286/2573] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:03:52 2022] DELETE /identity/v3/projects/2ab677afda2c43d499b76ac68408e853 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:52.637045 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4641e0-9294-4dbc-95cf-55abc0df3c65 service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:52.654273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4641e0-9294-4dbc-95cf-55abc0df3c65 service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:52.764102 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d238f0-1d1b-4557-b61a-9582ccd096bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:52.766108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d238f0-1d1b-4557-b61a-9582ccd096bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:52.766399 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d238f0-1d1b-4557-b61a-9582ccd096bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:52.766689 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d238f0-1d1b-4557-b61a-9582ccd096bd admin admin] PATH_INFO: `/v3/users/2bc197ac44934a16a2606ab8f60cb4b4` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:52.768911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d238f0-1d1b-4557-b61a-9582ccd096bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bc197ac44934a16a2606ab8f60cb4b4)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:52.771297 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d238f0-1d1b-4557-b61a-9582ccd096bd admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:52.887963 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:52.959211 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c6d238f0-1d1b-4557-b61a-9582ccd096bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bc197ac44934a16a2606ab8f60cb4b4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:53.046676 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c6d238f0-1d1b-4557-b61a-9582ccd096bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bc197ac44934a16a2606ab8f60cb4b4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:53.055502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c6d238f0-1d1b-4557-b61a-9582ccd096bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bc197ac44934a16a2606ab8f60cb4b4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:53.055696 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c6d238f0-1d1b-4557-b61a-9582ccd096bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bc197ac44934a16a2606ab8f60cb4b4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:53.069633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-c6d238f0-1d1b-4557-b61a-9582ccd096bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bc197ac44934a16a2606ab8f60cb4b4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:53.077290 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1288/2574] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:03:52 2022] DELETE /identity/v3/users/2bc197ac44934a16a2606ab8f60cb4b4 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:53.548378 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0425ac-edf6-447f-97ed-cd54bb645638 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:53.550340 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4b0425ac-edf6-447f-97ed-cd54bb645638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:53.565444 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0425ac-edf6-447f-97ed-cd54bb645638 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:53.627967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76070a47-de45-4df2-8187-93996bc73072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:53.628850 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76070a47-de45-4df2-8187-93996bc73072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:53.629178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76070a47-de45-4df2-8187-93996bc73072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:53.629464 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76070a47-de45-4df2-8187-93996bc73072 admin admin] PATH_INFO: `/v3/projects/c730280936274681bd64de046ecb0685` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:53.630863 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76070a47-de45-4df2-8187-93996bc73072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c730280936274681bd64de046ecb0685)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:53.633219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76070a47-de45-4df2-8187-93996bc73072 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:53.803208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-76070a47-de45-4df2-8187-93996bc73072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c730280936274681bd64de046ecb0685', 'request_id': 'req-76070a47-de45-4df2-8187-93996bc73072'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:53.809700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-76070a47-de45-4df2-8187-93996bc73072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c730280936274681bd64de046ecb0685', 'request_id': 'req-76070a47-de45-4df2-8187-93996bc73072'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:53.816260 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-76070a47-de45-4df2-8187-93996bc73072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c730280936274681bd64de046ecb0685', 'request_id': 'req-76070a47-de45-4df2-8187-93996bc73072'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:53.914629 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-76070a47-de45-4df2-8187-93996bc73072 admin admin] The token cache is being invalidate because project c730280936274681bd64de046ecb0685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:03:53.914888 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-76070a47-de45-4df2-8187-93996bc73072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:53.916071 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-76070a47-de45-4df2-8187-93996bc73072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:53.917775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1287/2575] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:03:53 2022] DELETE /identity/v3/projects/c730280936274681bd64de046ecb0685 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:53.923130 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6693d-9664-47b4-99ea-bd38198b9bd3 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:53.923834 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6693d-9664-47b4-99ea-bd38198b9bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:53.924097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a6693d-9664-47b4-99ea-bd38198b9bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:53.947090 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-72a6693d-9664-47b4-99ea-bd38198b9bd3 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:53.947090 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-72a6693d-9664-47b4-99ea-bd38198b9bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:54.009603 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1289/2576] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:54.018705 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89863fa-f1ab-41ac-a038-bd9e170408a6 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:54.019078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89863fa-f1ab-41ac-a038-bd9e170408a6 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:54.019360 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89863fa-f1ab-41ac-a038-bd9e170408a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:54.039431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c89863fa-f1ab-41ac-a038-bd9e170408a6 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:54.040769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c89863fa-f1ab-41ac-a038-bd9e170408a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:54.048951 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1288/2577] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:54.053525 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6693d-9664-47b4-99ea-bd38198b9bd3 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:54.063837 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a6693d-9664-47b4-99ea-bd38198b9bd3 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:54.068496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32e47b-1682-4ccd-b7b1-a3e18e8718db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:54.069266 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32e47b-1682-4ccd-b7b1-a3e18e8718db admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:54.069500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32e47b-1682-4ccd-b7b1-a3e18e8718db admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:54.069786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32e47b-1682-4ccd-b7b1-a3e18e8718db admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:54.070523 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32e47b-1682-4ccd-b7b1-a3e18e8718db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:03:54.070839 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32e47b-1682-4ccd-b7b1-a3e18e8718db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:54.072986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32e47b-1682-4ccd-b7b1-a3e18e8718db admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:54.088727 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1290/2578] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:03:54.094308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89863fa-f1ab-41ac-a038-bd9e170408a6 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:54.101872 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89863fa-f1ab-41ac-a038-bd9e170408a6 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:54.106647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a157fd-a609-48d3-a60a-87f3a8eb7a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:54.107310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a157fd-a609-48d3-a60a-87f3a8eb7a8f admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:54.107593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a157fd-a609-48d3-a60a-87f3a8eb7a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:54.107880 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a157fd-a609-48d3-a60a-87f3a8eb7a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:54.108556 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a157fd-a609-48d3-a60a-87f3a8eb7a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:54.110761 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a157fd-a609-48d3-a60a-87f3a8eb7a8f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:54.208389 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1289/2579] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:03:54 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:03:54.212767 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32e47b-1682-4ccd-b7b1-a3e18e8718db admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:54.224154 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32e47b-1682-4ccd-b7b1-a3e18e8718db admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:54.280617 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85893685-7c54-4f13-b257-0175de9bf730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:54.281327 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85893685-7c54-4f13-b257-0175de9bf730 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:54.281618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85893685-7c54-4f13-b257-0175de9bf730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:54.281901 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85893685-7c54-4f13-b257-0175de9bf730 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:54.282598 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85893685-7c54-4f13-b257-0175de9bf730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:54.284529 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85893685-7c54-4f13-b257-0175de9bf730 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:54.367374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1291/2580] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:03:54 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:03:54.372277 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a157fd-a609-48d3-a60a-87f3a8eb7a8f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:54.383429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a157fd-a609-48d3-a60a-87f3a8eb7a8f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:54.388776 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27875bfe-e6a7-4d6f-b671-3d82f7d8b7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:54.389479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27875bfe-e6a7-4d6f-b671-3d82f7d8b7be admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:54.389766 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27875bfe-e6a7-4d6f-b671-3d82f7d8b7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:54.390045 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27875bfe-e6a7-4d6f-b671-3d82f7d8b7be admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:54.390777 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27875bfe-e6a7-4d6f-b671-3d82f7d8b7be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:54.392373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27875bfe-e6a7-4d6f-b671-3d82f7d8b7be admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:54.403483 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1290/2581] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:03:54.407652 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85893685-7c54-4f13-b257-0175de9bf730 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:54.417911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85893685-7c54-4f13-b257-0175de9bf730 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:54.422663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0ad1d-c16f-4731-91c6-3261378ce32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:54.423331 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0ad1d-c16f-4731-91c6-3261378ce32f admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:54.423619 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0ad1d-c16f-4731-91c6-3261378ce32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:54.423899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0ad1d-c16f-4731-91c6-3261378ce32f admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:54.424629 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0ad1d-c16f-4731-91c6-3261378ce32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:54.426279 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c0ad1d-c16f-4731-91c6-3261378ce32f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:54.437167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1292/2582] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:03:54.441267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27875bfe-e6a7-4d6f-b671-3d82f7d8b7be admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:54.451954 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27875bfe-e6a7-4d6f-b671-3d82f7d8b7be admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:54.457412 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db2ad6-0630-4d3b-8d47-7d59a5bf5722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:54.458301 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db2ad6-0630-4d3b-8d47-7d59a5bf5722 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:54.458584 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db2ad6-0630-4d3b-8d47-7d59a5bf5722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:54.458861 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db2ad6-0630-4d3b-8d47-7d59a5bf5722 admin admin] PATH_INFO: `/v3/projects/9e5fc6eadc79446b90ba7eca84e8574e/users/f2242308fa3a43ea8c0b8fdf3f40d9c1/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:54.471271 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:54.474353 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db2ad6-0630-4d3b-8d47-7d59a5bf5722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e5fc6eadc79446b90ba7eca84e8574e, user_id=f2242308fa3a43ea8c0b8fdf3f40d9c1, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:54.477021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db2ad6-0630-4d3b-8d47-7d59a5bf5722 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:54.537531 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1291/2583] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:03:54 2022] PUT /identity/v3/projects/9e5fc6eadc79446b90ba7eca84e8574e/users/f2242308fa3a43ea8c0b8fdf3f40d9c1/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:54.547698 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6c2eb-435b-4395-9e6b-1ac1bb6668a0 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:54.547991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6c2eb-435b-4395-9e6b-1ac1bb6668a0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:54.548276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6c2eb-435b-4395-9e6b-1ac1bb6668a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:54.567810 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:54.577807 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-25b6c2eb-435b-4395-9e6b-1ac1bb6668a0 None None] MFA Rules not processed for user `f2242308fa3a43ea8c0b8fdf3f40d9c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:54.579045 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-25b6c2eb-435b-4395-9e6b-1ac1bb6668a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:54.646716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1293/2584] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:03:54.651231 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db2ad6-0630-4d3b-8d47-7d59a5bf5722 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:54.714623 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db2ad6-0630-4d3b-8d47-7d59a5bf5722 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:54.719256 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf21e0d-a5d8-41c8-81e8-a41b7d4cc42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:54.719928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf21e0d-a5d8-41c8-81e8-a41b7d4cc42e admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:54.720211 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf21e0d-a5d8-41c8-81e8-a41b7d4cc42e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:54.720490 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf21e0d-a5d8-41c8-81e8-a41b7d4cc42e admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:54.721210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf21e0d-a5d8-41c8-81e8-a41b7d4cc42e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:54.723117 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf21e0d-a5d8-41c8-81e8-a41b7d4cc42e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:54.815293 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1292/2585] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:03:54 2022] POST /identity/v3/projects => generated 387 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:03:54.819449 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6c2eb-435b-4395-9e6b-1ac1bb6668a0 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:54.830643 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b6c2eb-435b-4395-9e6b-1ac1bb6668a0 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:54.893573 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64b79f-c9a6-486a-afdb-cca087f1c164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:54.894253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64b79f-c9a6-486a-afdb-cca087f1c164 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:54.894541 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64b79f-c9a6-486a-afdb-cca087f1c164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:54.894825 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64b79f-c9a6-486a-afdb-cca087f1c164 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:54.895518 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64b79f-c9a6-486a-afdb-cca087f1c164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:54.897466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64b79f-c9a6-486a-afdb-cca087f1c164 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:55.006775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1294/2586] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:03:54 2022] POST /identity/v3/users => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:03:55.010771 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf21e0d-a5d8-41c8-81e8-a41b7d4cc42e admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:55.021347 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf21e0d-a5d8-41c8-81e8-a41b7d4cc42e admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:55.026677 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856a7ca-6c5b-4207-8349-63ccbdbb0fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:55.028104 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856a7ca-6c5b-4207-8349-63ccbdbb0fab admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:55.028104 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856a7ca-6c5b-4207-8349-63ccbdbb0fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:55.028104 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856a7ca-6c5b-4207-8349-63ccbdbb0fab admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:55.028690 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856a7ca-6c5b-4207-8349-63ccbdbb0fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:55.030344 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856a7ca-6c5b-4207-8349-63ccbdbb0fab admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:55.043096 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1293/2587] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:03:55.047020 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64b79f-c9a6-486a-afdb-cca087f1c164 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:55.057174 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64b79f-c9a6-486a-afdb-cca087f1c164 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:55.062349 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994aca4-914b-4893-857f-84928be3e325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:55.063240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994aca4-914b-4893-857f-84928be3e325 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:55.063527 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994aca4-914b-4893-857f-84928be3e325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:55.063805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994aca4-914b-4893-857f-84928be3e325 admin admin] PATH_INFO: `/v3/projects/1c939dbe5b544a4f9e762b98769a21da/users/ced718dc76164a1f8e9ba463f8aeed8e/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:55.079476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994aca4-914b-4893-857f-84928be3e325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c939dbe5b544a4f9e762b98769a21da, user_id=ced718dc76164a1f8e9ba463f8aeed8e, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:55.082158 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994aca4-914b-4893-857f-84928be3e325 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:55.139195 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1295/2588] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:03:55 2022] PUT /identity/v3/projects/1c939dbe5b544a4f9e762b98769a21da/users/ced718dc76164a1f8e9ba463f8aeed8e/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:55.143366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856a7ca-6c5b-4207-8349-63ccbdbb0fab admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:55.154655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856a7ca-6c5b-4207-8349-63ccbdbb0fab admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:55.219533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cff40c-14f4-4491-a339-39d4365536a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:55.220221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cff40c-14f4-4491-a339-39d4365536a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:55.220506 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cff40c-14f4-4491-a339-39d4365536a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:55.220784 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cff40c-14f4-4491-a339-39d4365536a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:55.221578 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cff40c-14f4-4491-a339-39d4365536a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:55.223184 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cff40c-14f4-4491-a339-39d4365536a9 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:55.237731 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1294/2589] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:03:55.241915 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994aca4-914b-4893-857f-84928be3e325 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:55.254211 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994aca4-914b-4893-857f-84928be3e325 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:55.260243 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73239fbc-04fd-4b91-8396-95c88a620d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:55.260243 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73239fbc-04fd-4b91-8396-95c88a620d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:55.260243 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73239fbc-04fd-4b91-8396-95c88a620d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:55.260243 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73239fbc-04fd-4b91-8396-95c88a620d81 admin admin] PATH_INFO: `/v3/projects/1c939dbe5b544a4f9e762b98769a21da/users/ced718dc76164a1f8e9ba463f8aeed8e/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:55.262519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73239fbc-04fd-4b91-8396-95c88a620d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c939dbe5b544a4f9e762b98769a21da, user_id=ced718dc76164a1f8e9ba463f8aeed8e, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:55.265282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73239fbc-04fd-4b91-8396-95c88a620d81 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:55.276928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1296/2590] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:03:55 2022] PUT /identity/v3/projects/1c939dbe5b544a4f9e762b98769a21da/users/ced718dc76164a1f8e9ba463f8aeed8e/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:03:55.287284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec720e-3899-43af-b6e3-e46536c8c501 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:55.287541 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec720e-3899-43af-b6e3-e46536c8c501 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:55.287822 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec720e-3899-43af-b6e3-e46536c8c501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:55.314351 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-adec720e-3899-43af-b6e3-e46536c8c501 None None] MFA Rules not processed for user `ced718dc76164a1f8e9ba463f8aeed8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:55.315541 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-adec720e-3899-43af-b6e3-e46536c8c501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:55.363609 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:55.384405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1295/2591] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:55 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:55.395472 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73239fbc-04fd-4b91-8396-95c88a620d81 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:55.397188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-73239fbc-04fd-4b91-8396-95c88a620d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:55.455528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73239fbc-04fd-4b91-8396-95c88a620d81 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:55.459439 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14677d-c0f4-4cc5-b36e-9c16f5790e47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:55.460093 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14677d-c0f4-4cc5-b36e-9c16f5790e47 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:55.460412 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14677d-c0f4-4cc5-b36e-9c16f5790e47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:55.460693 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14677d-c0f4-4cc5-b36e-9c16f5790e47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:55.467713 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:55.471563 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14677d-c0f4-4cc5-b36e-9c16f5790e47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:55.473023 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14677d-c0f4-4cc5-b36e-9c16f5790e47 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:55.483330 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1297/2592] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:55 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:03:55.617420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec720e-3899-43af-b6e3-e46536c8c501 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:55.681454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec720e-3899-43af-b6e3-e46536c8c501 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:55.686241 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967164d9-8a0b-4d67-af16-26e171f65d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:55.687130 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967164d9-8a0b-4d67-af16-26e171f65d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:55.687412 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967164d9-8a0b-4d67-af16-26e171f65d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:55.687692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967164d9-8a0b-4d67-af16-26e171f65d43 admin admin] PATH_INFO: `/v3/users/f2242308fa3a43ea8c0b8fdf3f40d9c1` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:55.688894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967164d9-8a0b-4d67-af16-26e171f65d43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2242308fa3a43ea8c0b8fdf3f40d9c1)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:55.690855 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967164d9-8a0b-4d67-af16-26e171f65d43 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:55.837901 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-967164d9-8a0b-4d67-af16-26e171f65d43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2242308fa3a43ea8c0b8fdf3f40d9c1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:55.897923 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-967164d9-8a0b-4d67-af16-26e171f65d43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2242308fa3a43ea8c0b8fdf3f40d9c1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:55.905529 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-967164d9-8a0b-4d67-af16-26e171f65d43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2242308fa3a43ea8c0b8fdf3f40d9c1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:55.906179 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-967164d9-8a0b-4d67-af16-26e171f65d43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2242308fa3a43ea8c0b8fdf3f40d9c1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:55.918680 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-967164d9-8a0b-4d67-af16-26e171f65d43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2242308fa3a43ea8c0b8fdf3f40d9c1'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:55.924682 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1296/2593] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:03:55 2022] DELETE /identity/v3/users/f2242308fa3a43ea8c0b8fdf3f40d9c1 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:55.929261 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e24326-1e66-40bc-bdb3-42d1c4b41c52 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:55.929559 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e24326-1e66-40bc-bdb3-42d1c4b41c52 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:55.929840 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e24326-1e66-40bc-bdb3-42d1c4b41c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:55.950329 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e5e24326-1e66-40bc-bdb3-42d1c4b41c52 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:55.951544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e5e24326-1e66-40bc-bdb3-42d1c4b41c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:56.012725 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1298/2594] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:56.022462 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967164d9-8a0b-4d67-af16-26e171f65d43 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:56.023894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-967164d9-8a0b-4d67-af16-26e171f65d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:56.087642 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967164d9-8a0b-4d67-af16-26e171f65d43 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:56.091704 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109851-21b0-4395-b0aa-6989f4c9bddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:56.092325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109851-21b0-4395-b0aa-6989f4c9bddd service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:56.092610 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109851-21b0-4395-b0aa-6989f4c9bddd service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:56.103989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109851-21b0-4395-b0aa-6989f4c9bddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:56.103989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c109851-21b0-4395-b0aa-6989f4c9bddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:56.105165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c109851-21b0-4395-b0aa-6989f4c9bddd service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:56.117363 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1297/2595] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:03:56.510954 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e24326-1e66-40bc-bdb3-42d1c4b41c52 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:56.516204 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e5e24326-1e66-40bc-bdb3-42d1c4b41c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:56.525132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e24326-1e66-40bc-bdb3-42d1c4b41c52 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:56.530670 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a98e0d-6789-4024-b0e2-dbf5e5f11038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:56.531577 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a98e0d-6789-4024-b0e2-dbf5e5f11038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:56.531862 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a98e0d-6789-4024-b0e2-dbf5e5f11038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:56.532148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a98e0d-6789-4024-b0e2-dbf5e5f11038 admin admin] PATH_INFO: `/v3/projects/9e5fc6eadc79446b90ba7eca84e8574e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:56.533432 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a98e0d-6789-4024-b0e2-dbf5e5f11038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e5fc6eadc79446b90ba7eca84e8574e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:56.535373 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a98e0d-6789-4024-b0e2-dbf5e5f11038 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:56.635149 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-01a98e0d-6789-4024-b0e2-dbf5e5f11038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e5fc6eadc79446b90ba7eca84e8574e', 'request_id': 'req-01a98e0d-6789-4024-b0e2-dbf5e5f11038'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:56.641421 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-01a98e0d-6789-4024-b0e2-dbf5e5f11038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e5fc6eadc79446b90ba7eca84e8574e', 'request_id': 'req-01a98e0d-6789-4024-b0e2-dbf5e5f11038'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:56.646871 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-01a98e0d-6789-4024-b0e2-dbf5e5f11038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e5fc6eadc79446b90ba7eca84e8574e', 'request_id': 'req-01a98e0d-6789-4024-b0e2-dbf5e5f11038'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:56.715414 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-01a98e0d-6789-4024-b0e2-dbf5e5f11038 admin admin] The token cache is being invalidate because project 9e5fc6eadc79446b90ba7eca84e8574e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:03:56.715704 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-01a98e0d-6789-4024-b0e2-dbf5e5f11038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:56.716325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-01a98e0d-6789-4024-b0e2-dbf5e5f11038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:56.717929 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1299/2596] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:03:56 2022] DELETE /identity/v3/projects/9e5fc6eadc79446b90ba7eca84e8574e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:56.722029 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109851-21b0-4395-b0aa-6989f4c9bddd service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:56.732526 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109851-21b0-4395-b0aa-6989f4c9bddd service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:56.737514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:56.794991 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e56f659-0e5f-43ed-aa7e-9f56ac386d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:56.795883 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56f659-0e5f-43ed-aa7e-9f56ac386d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:56.796172 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56f659-0e5f-43ed-aa7e-9f56ac386d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:56.796450 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e56f659-0e5f-43ed-aa7e-9f56ac386d18 admin admin] PATH_INFO: `/v3/users/ced718dc76164a1f8e9ba463f8aeed8e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:56.797661 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56f659-0e5f-43ed-aa7e-9f56ac386d18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ced718dc76164a1f8e9ba463f8aeed8e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:56.799601 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e56f659-0e5f-43ed-aa7e-9f56ac386d18 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:57.003591 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1e56f659-0e5f-43ed-aa7e-9f56ac386d18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ced718dc76164a1f8e9ba463f8aeed8e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:57.045944 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1e56f659-0e5f-43ed-aa7e-9f56ac386d18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ced718dc76164a1f8e9ba463f8aeed8e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:57.053347 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1e56f659-0e5f-43ed-aa7e-9f56ac386d18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ced718dc76164a1f8e9ba463f8aeed8e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:57.053996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1e56f659-0e5f-43ed-aa7e-9f56ac386d18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ced718dc76164a1f8e9ba463f8aeed8e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:57.066504 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1e56f659-0e5f-43ed-aa7e-9f56ac386d18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ced718dc76164a1f8e9ba463f8aeed8e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:57.073156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1298/2597] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:03:56 2022] DELETE /identity/v3/users/ced718dc76164a1f8e9ba463f8aeed8e => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:57.477275 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a98e0d-6789-4024-b0e2-dbf5e5f11038 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:57.478977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-01a98e0d-6789-4024-b0e2-dbf5e5f11038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:57.495695 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a98e0d-6789-4024-b0e2-dbf5e5f11038 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:57.559832 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b98875-0fcd-43a6-8084-a7cc116f4e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:57.560830 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b98875-0fcd-43a6-8084-a7cc116f4e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:57.561211 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b98875-0fcd-43a6-8084-a7cc116f4e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:57.561519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b98875-0fcd-43a6-8084-a7cc116f4e4f admin admin] PATH_INFO: `/v3/projects/1c939dbe5b544a4f9e762b98769a21da` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:57.562742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b98875-0fcd-43a6-8084-a7cc116f4e4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c939dbe5b544a4f9e762b98769a21da)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:57.564734 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b98875-0fcd-43a6-8084-a7cc116f4e4f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:57.590820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:57.687320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-07b98875-0fcd-43a6-8084-a7cc116f4e4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c939dbe5b544a4f9e762b98769a21da', 'request_id': 'req-07b98875-0fcd-43a6-8084-a7cc116f4e4f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:57.693665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-07b98875-0fcd-43a6-8084-a7cc116f4e4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c939dbe5b544a4f9e762b98769a21da', 'request_id': 'req-07b98875-0fcd-43a6-8084-a7cc116f4e4f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:57.699608 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-07b98875-0fcd-43a6-8084-a7cc116f4e4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c939dbe5b544a4f9e762b98769a21da', 'request_id': 'req-07b98875-0fcd-43a6-8084-a7cc116f4e4f'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:57.783320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-07b98875-0fcd-43a6-8084-a7cc116f4e4f admin admin] The token cache is being invalidate because project 1c939dbe5b544a4f9e762b98769a21da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:03:57.783586 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-07b98875-0fcd-43a6-8084-a7cc116f4e4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:57.784305 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-07b98875-0fcd-43a6-8084-a7cc116f4e4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:03:57.786289 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1300/2598] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:03:57 2022] DELETE /identity/v3/projects/1c939dbe5b544a4f9e762b98769a21da => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:57.792387 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041bd95-3b7f-437c-8aa1-0e17a47f5168 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:57.792845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041bd95-3b7f-437c-8aa1-0e17a47f5168 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:57.792979 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041bd95-3b7f-437c-8aa1-0e17a47f5168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:57.820405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-9041bd95-3b7f-437c-8aa1-0e17a47f5168 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:57.821710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9041bd95-3b7f-437c-8aa1-0e17a47f5168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:57.888021 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1299/2599] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:57.897045 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00015cb-a1c5-4ffd-86c5-d7bf33f02e2f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:57.897351 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00015cb-a1c5-4ffd-86c5-d7bf33f02e2f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:57.897631 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00015cb-a1c5-4ffd-86c5-d7bf33f02e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:57.917443 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-e00015cb-a1c5-4ffd-86c5-d7bf33f02e2f None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:57.918673 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e00015cb-a1c5-4ffd-86c5-d7bf33f02e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:57.926982 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1301/2600] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:57.934144 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041bd95-3b7f-437c-8aa1-0e17a47f5168 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:57.944236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9041bd95-3b7f-437c-8aa1-0e17a47f5168 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:57.949531 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132092c-950c-4d0c-b423-ddcc2665687b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:57.950205 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132092c-950c-4d0c-b423-ddcc2665687b admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:57.950492 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132092c-950c-4d0c-b423-ddcc2665687b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:57.950777 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132092c-950c-4d0c-b423-ddcc2665687b admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:57.951561 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132092c-950c-4d0c-b423-ddcc2665687b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:03:57.951816 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132092c-950c-4d0c-b423-ddcc2665687b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:57.953601 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4132092c-950c-4d0c-b423-ddcc2665687b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:57.966241 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1300/2601] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:03:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:03:57.970630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00015cb-a1c5-4ffd-86c5-d7bf33f02e2f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:57.980502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00015cb-a1c5-4ffd-86c5-d7bf33f02e2f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:57.985529 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15aa8a4-eba3-4ea9-b470-891156fab6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:57.986190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aa8a4-eba3-4ea9-b470-891156fab6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:57.986476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aa8a4-eba3-4ea9-b470-891156fab6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:57.986755 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aa8a4-eba3-4ea9-b470-891156fab6d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:57.987459 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15aa8a4-eba3-4ea9-b470-891156fab6d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:57.989736 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15aa8a4-eba3-4ea9-b470-891156fab6d1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:58.053479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1302/2602] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:03:57 2022] POST /identity/v3/projects => generated 381 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:03:58.057844 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132092c-950c-4d0c-b423-ddcc2665687b admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:58.067734 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132092c-950c-4d0c-b423-ddcc2665687b admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:58.079200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:58.128120 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa74fa-7876-43e6-8f3b-17267e248d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:58.128812 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa74fa-7876-43e6-8f3b-17267e248d38 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:58.129133 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa74fa-7876-43e6-8f3b-17267e248d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:58.129418 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa74fa-7876-43e6-8f3b-17267e248d38 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:58.130123 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa74fa-7876-43e6-8f3b-17267e248d38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:58.132110 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa74fa-7876-43e6-8f3b-17267e248d38 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:58.253349 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1301/2603] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:03:58 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:03:58.257362 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15aa8a4-eba3-4ea9-b470-891156fab6d1 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:58.268029 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15aa8a4-eba3-4ea9-b470-891156fab6d1 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:58.272698 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9915f4-f8ce-49b0-9f16-db2836930826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:58.273393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9915f4-f8ce-49b0-9f16-db2836930826 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:58.273685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9915f4-f8ce-49b0-9f16-db2836930826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:58.273965 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9915f4-f8ce-49b0-9f16-db2836930826 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:58.274751 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9915f4-f8ce-49b0-9f16-db2836930826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:58.276903 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9915f4-f8ce-49b0-9f16-db2836930826 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:58.287597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1303/2604] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:03:58.292479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa74fa-7876-43e6-8f3b-17267e248d38 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:58.303466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa74fa-7876-43e6-8f3b-17267e248d38 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:58.307284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a730f1d-6e1f-4522-a6aa-87e42f61e711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:58.308043 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a730f1d-6e1f-4522-a6aa-87e42f61e711 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:58.308327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a730f1d-6e1f-4522-a6aa-87e42f61e711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:58.308606 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a730f1d-6e1f-4522-a6aa-87e42f61e711 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:58.309402 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a730f1d-6e1f-4522-a6aa-87e42f61e711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:58.311005 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a730f1d-6e1f-4522-a6aa-87e42f61e711 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:58.323004 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1302/2605] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:03:58.327191 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9915f4-f8ce-49b0-9f16-db2836930826 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:58.338796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9915f4-f8ce-49b0-9f16-db2836930826 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:58.343533 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfd38a-01a3-49c5-a1b0-0410cde4ac32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:58.344421 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfd38a-01a3-49c5-a1b0-0410cde4ac32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:58.344704 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfd38a-01a3-49c5-a1b0-0410cde4ac32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:58.344981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adfd38a-01a3-49c5-a1b0-0410cde4ac32 admin admin] PATH_INFO: `/v3/projects/8c0b78e9dc244f26b80d09d8940d2cbf/users/6e459e4eea994793986a6cd667a0b0e6/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:58.360909 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfd38a-01a3-49c5-a1b0-0410cde4ac32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c0b78e9dc244f26b80d09d8940d2cbf, user_id=6e459e4eea994793986a6cd667a0b0e6, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:58.363622 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adfd38a-01a3-49c5-a1b0-0410cde4ac32 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:58.492795 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1304/2606] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:03:58 2022] PUT /identity/v3/projects/8c0b78e9dc244f26b80d09d8940d2cbf/users/6e459e4eea994793986a6cd667a0b0e6/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:58.503754 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67655e-88f7-4512-b4ff-f394ad3c701b None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:58.503978 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67655e-88f7-4512-b4ff-f394ad3c701b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:58.504259 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc67655e-88f7-4512-b4ff-f394ad3c701b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:58.533791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-bc67655e-88f7-4512-b4ff-f394ad3c701b None None] MFA Rules not processed for user `6e459e4eea994793986a6cd667a0b0e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:58.535057 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-bc67655e-88f7-4512-b4ff-f394ad3c701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:58.601900 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1303/2607] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:03:58.606991 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfd38a-01a3-49c5-a1b0-0410cde4ac32 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:58.672600 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adfd38a-01a3-49c5-a1b0-0410cde4ac32 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:58.677395 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e74ecf-d862-439c-b20d-e6a54741b8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:58.678064 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e74ecf-d862-439c-b20d-e6a54741b8cd admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:58.678353 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e74ecf-d862-439c-b20d-e6a54741b8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:58.678641 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e74ecf-d862-439c-b20d-e6a54741b8cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:58.679373 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e74ecf-d862-439c-b20d-e6a54741b8cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:58.681313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e74ecf-d862-439c-b20d-e6a54741b8cd admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:58.805618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1305/2608] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:03:58 2022] POST /identity/v3/projects => generated 381 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:03:58.807373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67655e-88f7-4512-b4ff-f394ad3c701b None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:58.818724 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc67655e-88f7-4512-b4ff-f394ad3c701b None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:58.879866 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44c1b8-3a65-4529-810c-3759f32ac9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:58.880538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44c1b8-3a65-4529-810c-3759f32ac9b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:58.880820 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44c1b8-3a65-4529-810c-3759f32ac9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:58.881135 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44c1b8-3a65-4529-810c-3759f32ac9b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:58.881830 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44c1b8-3a65-4529-810c-3759f32ac9b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:58.883772 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44c1b8-3a65-4529-810c-3759f32ac9b8 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:59.001283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1304/2609] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:03:58 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:03:59.005397 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e74ecf-d862-439c-b20d-e6a54741b8cd admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:59.018232 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e74ecf-d862-439c-b20d-e6a54741b8cd admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:59.023337 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f27452-3632-42ae-9df2-9b59358f6ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:59.024014 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f27452-3632-42ae-9df2-9b59358f6ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:59.024307 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f27452-3632-42ae-9df2-9b59358f6ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:59.024587 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f27452-3632-42ae-9df2-9b59358f6ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:59.025994 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f27452-3632-42ae-9df2-9b59358f6ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:59.027586 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f27452-3632-42ae-9df2-9b59358f6ff8 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:59.043628 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1306/2610] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:03:59.045077 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44c1b8-3a65-4529-810c-3759f32ac9b8 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:59.055997 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44c1b8-3a65-4529-810c-3759f32ac9b8 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:59.061100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00c913-9dab-4698-8d23-1febf382264e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:59.062016 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00c913-9dab-4698-8d23-1febf382264e admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:59.062304 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00c913-9dab-4698-8d23-1febf382264e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:59.062607 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a00c913-9dab-4698-8d23-1febf382264e admin admin] PATH_INFO: `/v3/projects/402343a4ece64240988db922aab65ae7/users/79139cdc78db468a8d8bbf60e0f3c4c2/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:59.075849 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:59.080025 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00c913-9dab-4698-8d23-1febf382264e admin admin] RBAC: Authorizing `identity:create_grant(project_id=402343a4ece64240988db922aab65ae7, user_id=79139cdc78db468a8d8bbf60e0f3c4c2, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:59.082781 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a00c913-9dab-4698-8d23-1febf382264e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:59.327745 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1305/2611] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:03:59 2022] PUT /identity/v3/projects/402343a4ece64240988db922aab65ae7/users/79139cdc78db468a8d8bbf60e0f3c4c2/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:03:59.331853 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f27452-3632-42ae-9df2-9b59358f6ff8 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:59.342802 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f27452-3632-42ae-9df2-9b59358f6ff8 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:59.356119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:03:59.385713 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00c913-9dab-4698-8d23-1febf382264e admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:59.387652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1a00c913-9dab-4698-8d23-1febf382264e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:59.407260 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3fd17-b824-4e6b-9a8f-f1a5d4ef7684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:59.408096 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3fd17-b824-4e6b-9a8f-f1a5d4ef7684 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:59.408388 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3fd17-b824-4e6b-9a8f-f1a5d4ef7684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:59.408670 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3fd17-b824-4e6b-9a8f-f1a5d4ef7684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:59.409443 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3fd17-b824-4e6b-9a8f-f1a5d4ef7684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:59.412848 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3fd17-b824-4e6b-9a8f-f1a5d4ef7684 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:59.423587 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1307/2612] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:03:59.428262 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3fd17-b824-4e6b-9a8f-f1a5d4ef7684 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:59.440526 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3fd17-b824-4e6b-9a8f-f1a5d4ef7684 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:59.443946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e9abf-de7b-461b-8a36-090c27000733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:59.445159 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e9abf-de7b-461b-8a36-090c27000733 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:59.445386 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e9abf-de7b-461b-8a36-090c27000733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:59.445914 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e9abf-de7b-461b-8a36-090c27000733 admin admin] PATH_INFO: `/v3/projects/402343a4ece64240988db922aab65ae7/users/79139cdc78db468a8d8bbf60e0f3c4c2/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:59.448712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e9abf-de7b-461b-8a36-090c27000733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=402343a4ece64240988db922aab65ae7, user_id=79139cdc78db468a8d8bbf60e0f3c4c2, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:59.451518 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e9abf-de7b-461b-8a36-090c27000733 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:59.469091 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1308/2613] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:03:59 2022] PUT /identity/v3/projects/402343a4ece64240988db922aab65ae7/users/79139cdc78db468a8d8bbf60e0f3c4c2/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:03:59.475440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e01044-1cf9-4a15-8fa5-779e5408711f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:59.475736 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e01044-1cf9-4a15-8fa5-779e5408711f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:59.476025 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e01044-1cf9-4a15-8fa5-779e5408711f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:59.477702 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a00c913-9dab-4698-8d23-1febf382264e admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:59.511411 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-d8e01044-1cf9-4a15-8fa5-779e5408711f None None] MFA Rules not processed for user `79139cdc78db468a8d8bbf60e0f3c4c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:03:59.512617 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d8e01044-1cf9-4a15-8fa5-779e5408711f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:59.544462 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b666b35-5a46-42ec-9f81-993996a96e0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:59.545235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b666b35-5a46-42ec-9f81-993996a96e0b service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:59.545523 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b666b35-5a46-42ec-9f81-993996a96e0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:59.545853 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b666b35-5a46-42ec-9f81-993996a96e0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:59.547987 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7b666b35-5a46-42ec-9f81-993996a96e0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:59.599174 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1309/2614] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:03:59 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:03:59.624777 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b666b35-5a46-42ec-9f81-993996a96e0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:59.626266 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b666b35-5a46-42ec-9f81-993996a96e0b service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:59.639375 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1306/2615] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:59 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:03:59.764507 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e01044-1cf9-4a15-8fa5-779e5408711f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:03:59.766043 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-d8e01044-1cf9-4a15-8fa5-779e5408711f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:03:59.783736 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e01044-1cf9-4a15-8fa5-779e5408711f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:03:59.788314 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90ca15-fbef-4c73-8cea-b2d481b0c79c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:03:59.788865 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90ca15-fbef-4c73-8cea-b2d481b0c79c service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:03:59.789197 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90ca15-fbef-4c73-8cea-b2d481b0c79c service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:03:59.789477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90ca15-fbef-4c73-8cea-b2d481b0c79c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:03:59.800849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90ca15-fbef-4c73-8cea-b2d481b0c79c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:03:59.816485 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d90ca15-fbef-4c73-8cea-b2d481b0c79c service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:03:59.816485 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1310/2616] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:03:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:04:00.097875 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b666b35-5a46-42ec-9f81-993996a96e0b service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:00.108203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b666b35-5a46-42ec-9f81-993996a96e0b service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:00.112234 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbd1713-a316-450f-953f-a0a080b636f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:00.113053 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd1713-a316-450f-953f-a0a080b636f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:00.114597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd1713-a316-450f-953f-a0a080b636f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:00.114597 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbd1713-a316-450f-953f-a0a080b636f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:00.178126 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:00.182049 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd1713-a316-450f-953f-a0a080b636f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:00.190156 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbd1713-a316-450f-953f-a0a080b636f2 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:00.196678 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1307/2617] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:04:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:04:00.846652 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90ca15-fbef-4c73-8cea-b2d481b0c79c service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:00.914203 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90ca15-fbef-4c73-8cea-b2d481b0c79c service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:00.919358 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9a1ea-7208-4d1b-bc3d-bd354bfa53e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:00.920336 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9a1ea-7208-4d1b-bc3d-bd354bfa53e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:00.920517 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9a1ea-7208-4d1b-bc3d-bd354bfa53e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:00.920782 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9a1ea-7208-4d1b-bc3d-bd354bfa53e6 admin admin] PATH_INFO: `/v3/users/6e459e4eea994793986a6cd667a0b0e6` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:00.922034 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9a1ea-7208-4d1b-bc3d-bd354bfa53e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e459e4eea994793986a6cd667a0b0e6)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:00.924256 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec9a1ea-7208-4d1b-bc3d-bd354bfa53e6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:00.943962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:01.197821 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5ec9a1ea-7208-4d1b-bc3d-bd354bfa53e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e459e4eea994793986a6cd667a0b0e6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:01.257698 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5ec9a1ea-7208-4d1b-bc3d-bd354bfa53e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e459e4eea994793986a6cd667a0b0e6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:01.265156 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5ec9a1ea-7208-4d1b-bc3d-bd354bfa53e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e459e4eea994793986a6cd667a0b0e6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:01.265805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5ec9a1ea-7208-4d1b-bc3d-bd354bfa53e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e459e4eea994793986a6cd667a0b0e6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:01.278063 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5ec9a1ea-7208-4d1b-bc3d-bd354bfa53e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e459e4eea994793986a6cd667a0b0e6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:01.284309 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1311/2618] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:04:00 2022] DELETE /identity/v3/users/6e459e4eea994793986a6cd667a0b0e6 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:01.288831 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff55ea-0bbe-44cb-903f-0d4d5d0d37d3 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:01.289342 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff55ea-0bbe-44cb-903f-0d4d5d0d37d3 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:01.289455 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff55ea-0bbe-44cb-903f-0d4d5d0d37d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:01.307193 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-7bff55ea-0bbe-44cb-903f-0d4d5d0d37d3 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:01.308426 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7bff55ea-0bbe-44cb-903f-0d4d5d0d37d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:01.370056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1308/2619] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:01.379929 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9a1ea-7208-4d1b-bc3d-bd354bfa53e6 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:01.381407 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5ec9a1ea-7208-4d1b-bc3d-bd354bfa53e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:01.440678 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9a1ea-7208-4d1b-bc3d-bd354bfa53e6 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:01.444183 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d25acd-7320-48f2-9ed5-bf381352fc2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:01.444831 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d25acd-7320-48f2-9ed5-bf381352fc2d service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:01.445152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d25acd-7320-48f2-9ed5-bf381352fc2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:01.445432 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d25acd-7320-48f2-9ed5-bf381352fc2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:01.455130 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d25acd-7320-48f2-9ed5-bf381352fc2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:01.456568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d25acd-7320-48f2-9ed5-bf381352fc2d service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:01.466595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1312/2620] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:04:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:04:01.916612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff55ea-0bbe-44cb-903f-0d4d5d0d37d3 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:01.918101 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7bff55ea-0bbe-44cb-903f-0d4d5d0d37d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:01.932643 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff55ea-0bbe-44cb-903f-0d4d5d0d37d3 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:01.938122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24885a68-bb93-4581-9302-69e5aeae20fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:01.939107 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24885a68-bb93-4581-9302-69e5aeae20fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:01.941407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24885a68-bb93-4581-9302-69e5aeae20fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:01.941407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24885a68-bb93-4581-9302-69e5aeae20fd admin admin] PATH_INFO: `/v3/projects/8c0b78e9dc244f26b80d09d8940d2cbf` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:01.941407 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24885a68-bb93-4581-9302-69e5aeae20fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c0b78e9dc244f26b80d09d8940d2cbf)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:01.942967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24885a68-bb93-4581-9302-69e5aeae20fd admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:02.105609 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-24885a68-bb93-4581-9302-69e5aeae20fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c0b78e9dc244f26b80d09d8940d2cbf', 'request_id': 'req-24885a68-bb93-4581-9302-69e5aeae20fd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:02.112527 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-24885a68-bb93-4581-9302-69e5aeae20fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c0b78e9dc244f26b80d09d8940d2cbf', 'request_id': 'req-24885a68-bb93-4581-9302-69e5aeae20fd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:02.119576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-24885a68-bb93-4581-9302-69e5aeae20fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c0b78e9dc244f26b80d09d8940d2cbf', 'request_id': 'req-24885a68-bb93-4581-9302-69e5aeae20fd'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:02.217653 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-24885a68-bb93-4581-9302-69e5aeae20fd admin admin] The token cache is being invalidate because project 8c0b78e9dc244f26b80d09d8940d2cbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:04:02.217979 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-24885a68-bb93-4581-9302-69e5aeae20fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:02.218599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-24885a68-bb93-4581-9302-69e5aeae20fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:02.220192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1309/2621] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:04:01 2022] DELETE /identity/v3/projects/8c0b78e9dc244f26b80d09d8940d2cbf => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:02.224147 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d25acd-7320-48f2-9ed5-bf381352fc2d service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:02.234964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d25acd-7320-48f2-9ed5-bf381352fc2d service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:02.293869 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d3df1-6b98-4e47-945f-bfc775176804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:02.294769 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d3df1-6b98-4e47-945f-bfc775176804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:02.295049 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d3df1-6b98-4e47-945f-bfc775176804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:02.295326 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d3df1-6b98-4e47-945f-bfc775176804 admin admin] PATH_INFO: `/v3/users/79139cdc78db468a8d8bbf60e0f3c4c2` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:02.296556 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d3df1-6b98-4e47-945f-bfc775176804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79139cdc78db468a8d8bbf60e0f3c4c2)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:02.298515 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d3df1-6b98-4e47-945f-bfc775176804 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:02.492231 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:02.502500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fe3d3df1-6b98-4e47-945f-bfc775176804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79139cdc78db468a8d8bbf60e0f3c4c2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:02.594677 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fe3d3df1-6b98-4e47-945f-bfc775176804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79139cdc78db468a8d8bbf60e0f3c4c2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:02.602178 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fe3d3df1-6b98-4e47-945f-bfc775176804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79139cdc78db468a8d8bbf60e0f3c4c2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:02.602905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fe3d3df1-6b98-4e47-945f-bfc775176804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79139cdc78db468a8d8bbf60e0f3c4c2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:02.616171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fe3d3df1-6b98-4e47-945f-bfc775176804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79139cdc78db468a8d8bbf60e0f3c4c2'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:02.625998 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1313/2622] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:04:02 2022] DELETE /identity/v3/users/79139cdc78db468a8d8bbf60e0f3c4c2 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:03.042746 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24885a68-bb93-4581-9302-69e5aeae20fd admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:03.045505 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-24885a68-bb93-4581-9302-69e5aeae20fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:03.058464 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24885a68-bb93-4581-9302-69e5aeae20fd admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:03.123523 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda88bb-6d7c-43d8-a772-fbab43a18e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:03.124398 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda88bb-6d7c-43d8-a772-fbab43a18e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:03.124688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda88bb-6d7c-43d8-a772-fbab43a18e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:03.124968 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda88bb-6d7c-43d8-a772-fbab43a18e99 admin admin] PATH_INFO: `/v3/projects/402343a4ece64240988db922aab65ae7` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:03.126345 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda88bb-6d7c-43d8-a772-fbab43a18e99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=402343a4ece64240988db922aab65ae7)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:03.128258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda88bb-6d7c-43d8-a772-fbab43a18e99 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:03.150827 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:03.258915 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fcda88bb-6d7c-43d8-a772-fbab43a18e99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '402343a4ece64240988db922aab65ae7', 'request_id': 'req-fcda88bb-6d7c-43d8-a772-fbab43a18e99'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:03.265427 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fcda88bb-6d7c-43d8-a772-fbab43a18e99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '402343a4ece64240988db922aab65ae7', 'request_id': 'req-fcda88bb-6d7c-43d8-a772-fbab43a18e99'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:03.271750 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fcda88bb-6d7c-43d8-a772-fbab43a18e99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '402343a4ece64240988db922aab65ae7', 'request_id': 'req-fcda88bb-6d7c-43d8-a772-fbab43a18e99'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:03.360192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fcda88bb-6d7c-43d8-a772-fbab43a18e99 admin admin] The token cache is being invalidate because project 402343a4ece64240988db922aab65ae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:04:03.360416 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fcda88bb-6d7c-43d8-a772-fbab43a18e99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:03.361066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-fcda88bb-6d7c-43d8-a772-fbab43a18e99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:03.362632 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1310/2623] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:04:03 2022] DELETE /identity/v3/projects/402343a4ece64240988db922aab65ae7 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:04:03.367631 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b800980-51b3-48bb-b184-9672a1ad2b12 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:03.369596 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b800980-51b3-48bb-b184-9672a1ad2b12 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:03.369596 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b800980-51b3-48bb-b184-9672a1ad2b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:03.387356 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-7b800980-51b3-48bb-b184-9672a1ad2b12 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:03.388566 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-7b800980-51b3-48bb-b184-9672a1ad2b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:03.449810 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1314/2624] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:03.457741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa0539-e952-4d99-9f64-c21489eb19c2 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:03.458088 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa0539-e952-4d99-9f64-c21489eb19c2 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:03.458430 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa0539-e952-4d99-9f64-c21489eb19c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:03.477851 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e9fa0539-e952-4d99-9f64-c21489eb19c2 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:03.479770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e9fa0539-e952-4d99-9f64-c21489eb19c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:03.488055 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1311/2625] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:04:03.492253 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b800980-51b3-48bb-b184-9672a1ad2b12 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:03.502475 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b800980-51b3-48bb-b184-9672a1ad2b12 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:03.507116 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924f1f3-5e83-4c4c-8298-71bc20ca1b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:03.507786 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924f1f3-5e83-4c4c-8298-71bc20ca1b1c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:03.508077 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924f1f3-5e83-4c4c-8298-71bc20ca1b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:03.508359 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e924f1f3-5e83-4c4c-8298-71bc20ca1b1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:03.509147 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924f1f3-5e83-4c4c-8298-71bc20ca1b1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:04:03.510141 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924f1f3-5e83-4c4c-8298-71bc20ca1b1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:03.511723 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e924f1f3-5e83-4c4c-8298-71bc20ca1b1c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:03.524171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1315/2626] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:04:03.528850 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa0539-e952-4d99-9f64-c21489eb19c2 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:03.538397 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa0539-e952-4d99-9f64-c21489eb19c2 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:03.544322 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff308ba7-5334-43a9-bde1-ba3c2bf9d78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:03.544998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff308ba7-5334-43a9-bde1-ba3c2bf9d78b admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:03.545307 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff308ba7-5334-43a9-bde1-ba3c2bf9d78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:03.545581 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff308ba7-5334-43a9-bde1-ba3c2bf9d78b admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:03.546268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff308ba7-5334-43a9-bde1-ba3c2bf9d78b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:03.548203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff308ba7-5334-43a9-bde1-ba3c2bf9d78b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:03.659041 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1312/2627] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:04:03 2022] POST /identity/v3/projects => generated 359 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:04:03.663362 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924f1f3-5e83-4c4c-8298-71bc20ca1b1c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:03.674617 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e924f1f3-5e83-4c4c-8298-71bc20ca1b1c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:03.731947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9a260-5d69-4271-8fbc-de1cd399ef77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:03.732791 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9a260-5d69-4271-8fbc-de1cd399ef77 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:03.732898 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9a260-5d69-4271-8fbc-de1cd399ef77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:03.733190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9a260-5d69-4271-8fbc-de1cd399ef77 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:03.733888 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9a260-5d69-4271-8fbc-de1cd399ef77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:03.736102 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9a260-5d69-4271-8fbc-de1cd399ef77 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:03.858335 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1316/2628] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:04:03 2022] POST /identity/v3/users => generated 280 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:04:03.862692 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff308ba7-5334-43a9-bde1-ba3c2bf9d78b admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:03.873601 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff308ba7-5334-43a9-bde1-ba3c2bf9d78b admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:03.878242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302e45f-a3cb-4941-b018-25a003812bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:03.879080 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302e45f-a3cb-4941-b018-25a003812bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:03.879366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302e45f-a3cb-4941-b018-25a003812bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:03.879648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3302e45f-a3cb-4941-b018-25a003812bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:03.880519 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302e45f-a3cb-4941-b018-25a003812bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:03.882180 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3302e45f-a3cb-4941-b018-25a003812bb3 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:03.893646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1313/2629] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:04:03.897779 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9a260-5d69-4271-8fbc-de1cd399ef77 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:03.908581 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9a260-5d69-4271-8fbc-de1cd399ef77 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:03.913243 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fe6ff3-26dd-4624-b7bd-c46adcafc919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:03.913905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe6ff3-26dd-4624-b7bd-c46adcafc919 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:03.914196 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe6ff3-26dd-4624-b7bd-c46adcafc919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:03.914481 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fe6ff3-26dd-4624-b7bd-c46adcafc919 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:03.915210 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe6ff3-26dd-4624-b7bd-c46adcafc919 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:03.917055 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fe6ff3-26dd-4624-b7bd-c46adcafc919 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:03.927210 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1317/2630] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:04:03.931490 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302e45f-a3cb-4941-b018-25a003812bb3 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:03.941747 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3302e45f-a3cb-4941-b018-25a003812bb3 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:03.946631 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb603cdc-2a6a-41b7-a882-cddaba554899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:03.948159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb603cdc-2a6a-41b7-a882-cddaba554899 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:03.948447 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb603cdc-2a6a-41b7-a882-cddaba554899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:03.948727 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb603cdc-2a6a-41b7-a882-cddaba554899 admin admin] PATH_INFO: `/v3/projects/99ecb3df3a274066b60513618e65b5e8/users/7316bea3e1d944f3b817b5ae9b224a5c/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:03.964586 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb603cdc-2a6a-41b7-a882-cddaba554899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99ecb3df3a274066b60513618e65b5e8, user_id=7316bea3e1d944f3b817b5ae9b224a5c, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:03.967742 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb603cdc-2a6a-41b7-a882-cddaba554899 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:04.059258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1314/2631] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:04:03 2022] PUT /identity/v3/projects/99ecb3df3a274066b60513618e65b5e8/users/7316bea3e1d944f3b817b5ae9b224a5c/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:04:04.069887 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b846810-da76-4af9-b0ae-3e7cb01961a5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:04.070185 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b846810-da76-4af9-b0ae-3e7cb01961a5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:04.070476 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b846810-da76-4af9-b0ae-3e7cb01961a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:04.099529 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-9b846810-da76-4af9-b0ae-3e7cb01961a5 None None] MFA Rules not processed for user `7316bea3e1d944f3b817b5ae9b224a5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:04.100731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-9b846810-da76-4af9-b0ae-3e7cb01961a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:04.109560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:04.177663 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1318/2632] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:04 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:04.222989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb603cdc-2a6a-41b7-a882-cddaba554899 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:04.224856 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-eb603cdc-2a6a-41b7-a882-cddaba554899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:04.285638 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb603cdc-2a6a-41b7-a882-cddaba554899 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:04.289445 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1d575-daf7-4c14-8b58-20291215ad03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:04.290002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1d575-daf7-4c14-8b58-20291215ad03 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:04.290285 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1d575-daf7-4c14-8b58-20291215ad03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:04.290559 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1d575-daf7-4c14-8b58-20291215ad03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:04.300726 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1d575-daf7-4c14-8b58-20291215ad03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:04.302247 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1d575-daf7-4c14-8b58-20291215ad03 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:04.313094 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1315/2633] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:04:04 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:04:04.327393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b846810-da76-4af9-b0ae-3e7cb01961a5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:04.406581 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b846810-da76-4af9-b0ae-3e7cb01961a5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:04.414401 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fdb2b-7913-4b4f-831b-c23354f18dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:04.417789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fdb2b-7913-4b4f-831b-c23354f18dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:04.417789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fdb2b-7913-4b4f-831b-c23354f18dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:04.418712 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999fdb2b-7913-4b4f-831b-c23354f18dbf admin admin] PATH_INFO: `/v3/users/7316bea3e1d944f3b817b5ae9b224a5c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:04.420151 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fdb2b-7913-4b4f-831b-c23354f18dbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7316bea3e1d944f3b817b5ae9b224a5c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:04.424037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999fdb2b-7913-4b4f-831b-c23354f18dbf admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:04.657147 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-999fdb2b-7913-4b4f-831b-c23354f18dbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7316bea3e1d944f3b817b5ae9b224a5c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:04.748748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-999fdb2b-7913-4b4f-831b-c23354f18dbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7316bea3e1d944f3b817b5ae9b224a5c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:04.756788 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-999fdb2b-7913-4b4f-831b-c23354f18dbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7316bea3e1d944f3b817b5ae9b224a5c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:04.765799 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-999fdb2b-7913-4b4f-831b-c23354f18dbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7316bea3e1d944f3b817b5ae9b224a5c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:04.772375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-999fdb2b-7913-4b4f-831b-c23354f18dbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7316bea3e1d944f3b817b5ae9b224a5c'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:04.783048 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1319/2634] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:04:04 2022] DELETE /identity/v3/users/7316bea3e1d944f3b817b5ae9b224a5c => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:04.784899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dfc20-d5d9-4d19-a9d2-183ca5057071 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:04.785223 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dfc20-d5d9-4d19-a9d2-183ca5057071 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:04.792401 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dfc20-d5d9-4d19-a9d2-183ca5057071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:04.802724 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-cd9dfc20-d5d9-4d19-a9d2-183ca5057071 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:04.803927 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-cd9dfc20-d5d9-4d19-a9d2-183ca5057071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:04.847270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:04.864879 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1316/2635] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:04.875768 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fdb2b-7913-4b4f-831b-c23354f18dbf admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:04.877370 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-999fdb2b-7913-4b4f-831b-c23354f18dbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:04.910976 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:04.936477 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999fdb2b-7913-4b4f-831b-c23354f18dbf admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:04.940378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcbc9ba-b90f-43ba-8f61-c59243881b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:04.941055 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbc9ba-b90f-43ba-8f61-c59243881b31 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:04.941348 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbc9ba-b90f-43ba-8f61-c59243881b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:04.941721 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcbc9ba-b90f-43ba-8f61-c59243881b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:04.951993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbc9ba-b90f-43ba-8f61-c59243881b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:04.953478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcbc9ba-b90f-43ba-8f61-c59243881b31 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:04.963240 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1320/2636] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:04:05.413299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dfc20-d5d9-4d19-a9d2-183ca5057071 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:05.415989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-cd9dfc20-d5d9-4d19-a9d2-183ca5057071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:05.427932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dfc20-d5d9-4d19-a9d2-183ca5057071 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:05.432773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c12f6-55c8-48f0-80ef-a4e6a7b5048c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:05.433773 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c12f6-55c8-48f0-80ef-a4e6a7b5048c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:05.434062 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c12f6-55c8-48f0-80ef-a4e6a7b5048c admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:05.434344 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c12f6-55c8-48f0-80ef-a4e6a7b5048c admin admin] PATH_INFO: `/v3/projects/99ecb3df3a274066b60513618e65b5e8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:05.435719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c12f6-55c8-48f0-80ef-a4e6a7b5048c admin admin] RBAC: Authorizing `identity:delete_project(project_id=99ecb3df3a274066b60513618e65b5e8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:05.437594 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c12f6-55c8-48f0-80ef-a4e6a7b5048c admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:05.580059 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-cd4c12f6-55c8-48f0-80ef-a4e6a7b5048c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99ecb3df3a274066b60513618e65b5e8', 'request_id': 'req-cd4c12f6-55c8-48f0-80ef-a4e6a7b5048c'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:05.595048 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-cd4c12f6-55c8-48f0-80ef-a4e6a7b5048c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99ecb3df3a274066b60513618e65b5e8', 'request_id': 'req-cd4c12f6-55c8-48f0-80ef-a4e6a7b5048c'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:05.601858 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-cd4c12f6-55c8-48f0-80ef-a4e6a7b5048c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99ecb3df3a274066b60513618e65b5e8', 'request_id': 'req-cd4c12f6-55c8-48f0-80ef-a4e6a7b5048c'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:05.731081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-cd4c12f6-55c8-48f0-80ef-a4e6a7b5048c admin admin] The token cache is being invalidate because project 99ecb3df3a274066b60513618e65b5e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:04:05.731365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-cd4c12f6-55c8-48f0-80ef-a4e6a7b5048c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:05.731996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-cd4c12f6-55c8-48f0-80ef-a4e6a7b5048c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:05.733602 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1317/2637] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:04:05 2022] DELETE /identity/v3/projects/99ecb3df3a274066b60513618e65b5e8 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:05.739051 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd9109-bef7-494b-8f38-5bad6471b868 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:05.739581 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd9109-bef7-494b-8f38-5bad6471b868 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:05.739696 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd9109-bef7-494b-8f38-5bad6471b868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:05.758337 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-1bdd9109-bef7-494b-8f38-5bad6471b868 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:05.760254 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1bdd9109-bef7-494b-8f38-5bad6471b868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:05.822924 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1321/2638] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:05.831663 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1626843-652d-4a8d-b95c-61513b281b5d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:05.831978 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1626843-652d-4a8d-b95c-61513b281b5d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:05.832261 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1626843-652d-4a8d-b95c-61513b281b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:05.850839 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-b1626843-652d-4a8d-b95c-61513b281b5d None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:05.852053 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b1626843-652d-4a8d-b95c-61513b281b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:05.861028 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1318/2639] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:05.865343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd9109-bef7-494b-8f38-5bad6471b868 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:05.876435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd9109-bef7-494b-8f38-5bad6471b868 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:05.881317 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece3b92-0121-4575-a469-867bb95c0f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:05.882021 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3b92-0121-4575-a469-867bb95c0f66 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:05.882313 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3b92-0121-4575-a469-867bb95c0f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:05.882598 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece3b92-0121-4575-a469-867bb95c0f66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:05.883343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece3b92-0121-4575-a469-867bb95c0f66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:04:05.883657 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece3b92-0121-4575-a469-867bb95c0f66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:05.886022 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece3b92-0121-4575-a469-867bb95c0f66 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:05.897898 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1322/2640] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:04:05.957552 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1626843-652d-4a8d-b95c-61513b281b5d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:05.967032 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1626843-652d-4a8d-b95c-61513b281b5d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:05.971700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4c348-6ca9-4e04-b18f-6cf8206513ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:05.972357 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4c348-6ca9-4e04-b18f-6cf8206513ee admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:05.972707 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4c348-6ca9-4e04-b18f-6cf8206513ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:05.972912 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4c348-6ca9-4e04-b18f-6cf8206513ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:05.973642 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4c348-6ca9-4e04-b18f-6cf8206513ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:05.975539 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc4c348-6ca9-4e04-b18f-6cf8206513ee admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:06.070573 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1319/2641] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:04:05 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:04:06.075035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece3b92-0121-4575-a469-867bb95c0f66 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:06.086710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece3b92-0121-4575-a469-867bb95c0f66 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:06.143980 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe383f3-32aa-4a26-a19b-bfc156c25a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:06.144648 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe383f3-32aa-4a26-a19b-bfc156c25a49 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:06.144933 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe383f3-32aa-4a26-a19b-bfc156c25a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:06.145237 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe383f3-32aa-4a26-a19b-bfc156c25a49 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:06.145953 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe383f3-32aa-4a26-a19b-bfc156c25a49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:06.147930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe383f3-32aa-4a26-a19b-bfc156c25a49 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:06.255006 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1323/2642] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:04:06 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:04:06.256286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4c348-6ca9-4e04-b18f-6cf8206513ee admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:06.267473 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4c348-6ca9-4e04-b18f-6cf8206513ee admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:06.272008 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dc513-5379-4141-8304-1920971ab1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:06.272686 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dc513-5379-4141-8304-1920971ab1a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:06.272976 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dc513-5379-4141-8304-1920971ab1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:06.273360 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0dc513-5379-4141-8304-1920971ab1a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:06.274103 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0dc513-5379-4141-8304-1920971ab1a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:06.276276 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0dc513-5379-4141-8304-1920971ab1a4 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:06.288219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1320/2643] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:04:06.293043 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe383f3-32aa-4a26-a19b-bfc156c25a49 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:06.303093 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe383f3-32aa-4a26-a19b-bfc156c25a49 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:06.307888 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d093a-3a57-425a-a537-418956f2b9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:06.308549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d093a-3a57-425a-a537-418956f2b9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:06.308836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d093a-3a57-425a-a537-418956f2b9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:06.309146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d093a-3a57-425a-a537-418956f2b9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:06.309878 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d093a-3a57-425a-a537-418956f2b9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:06.311513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d093a-3a57-425a-a537-418956f2b9f6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:06.321610 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1324/2644] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:04:06.325905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dc513-5379-4141-8304-1920971ab1a4 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:06.335878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0dc513-5379-4141-8304-1920971ab1a4 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:06.341335 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970f479-bcaa-434b-be37-b49d0dd126f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:06.342309 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970f479-bcaa-434b-be37-b49d0dd126f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:06.342590 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970f479-bcaa-434b-be37-b49d0dd126f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:06.342862 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970f479-bcaa-434b-be37-b49d0dd126f1 admin admin] PATH_INFO: `/v3/projects/fbe63efddfe04a6ca789314491f9cf5e/users/54f42da9dce84649999538220bb7250a/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:06.358614 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970f479-bcaa-434b-be37-b49d0dd126f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe63efddfe04a6ca789314491f9cf5e, user_id=54f42da9dce84649999538220bb7250a, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:06.361549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7970f479-bcaa-434b-be37-b49d0dd126f1 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:06.454019 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1321/2645] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:04:06 2022] PUT /identity/v3/projects/fbe63efddfe04a6ca789314491f9cf5e/users/54f42da9dce84649999538220bb7250a/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:06.465459 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b2ff0-7b75-4e64-92f4-777dee7559c2 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:06.465760 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b2ff0-7b75-4e64-92f4-777dee7559c2 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:06.466048 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b2ff0-7b75-4e64-92f4-777dee7559c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:06.496177 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3b3b2ff0-7b75-4e64-92f4-777dee7559c2 None None] MFA Rules not processed for user `54f42da9dce84649999538220bb7250a`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:06.497364 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3b3b2ff0-7b75-4e64-92f4-777dee7559c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:06.522982 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:06.563184 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1325/2646] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:06.567914 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970f479-bcaa-434b-be37-b49d0dd126f1 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:06.641549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7970f479-bcaa-434b-be37-b49d0dd126f1 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:06.646375 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa5d43-8cfc-4a28-adb3-08433c9e33fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:06.647078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa5d43-8cfc-4a28-adb3-08433c9e33fa admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:06.647366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa5d43-8cfc-4a28-adb3-08433c9e33fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:06.647649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aa5d43-8cfc-4a28-adb3-08433c9e33fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:06.648359 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa5d43-8cfc-4a28-adb3-08433c9e33fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:06.651131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aa5d43-8cfc-4a28-adb3-08433c9e33fa admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:06.661839 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:06.809235 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1322/2647] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:04:06 2022] POST /identity/v3/projects => generated 375 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:04:06.812820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b2ff0-7b75-4e64-92f4-777dee7559c2 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:06.824377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b2ff0-7b75-4e64-92f4-777dee7559c2 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:06.890331 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8f297-b8a3-46bf-9bdc-b1d06a345596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:06.891179 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8f297-b8a3-46bf-9bdc-b1d06a345596 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:06.891472 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8f297-b8a3-46bf-9bdc-b1d06a345596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:06.891750 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8f297-b8a3-46bf-9bdc-b1d06a345596 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:06.892507 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8f297-b8a3-46bf-9bdc-b1d06a345596 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:06.894560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8f297-b8a3-46bf-9bdc-b1d06a345596 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:06.972177 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1326/2648] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:04:06 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:04:06.976189 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa5d43-8cfc-4a28-adb3-08433c9e33fa admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:06.987520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aa5d43-8cfc-4a28-adb3-08433c9e33fa admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:06.992975 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2cbf4-09bc-422f-96fc-b84669245f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:06.993719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2cbf4-09bc-422f-96fc-b84669245f5c admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:06.994006 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2cbf4-09bc-422f-96fc-b84669245f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:06.994287 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2cbf4-09bc-422f-96fc-b84669245f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:06.995347 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2cbf4-09bc-422f-96fc-b84669245f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:06.997341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2cbf4-09bc-422f-96fc-b84669245f5c admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:07.008875 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1323/2649] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:04:07.017160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8f297-b8a3-46bf-9bdc-b1d06a345596 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:07.029371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8f297-b8a3-46bf-9bdc-b1d06a345596 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:07.034371 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1fe8b-d72a-4b04-ae48-3250818c7d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:07.035261 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1fe8b-d72a-4b04-ae48-3250818c7d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:07.035548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1fe8b-d72a-4b04-ae48-3250818c7d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:07.035883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1fe8b-d72a-4b04-ae48-3250818c7d6d admin admin] PATH_INFO: `/v3/projects/e79ce0cbbb704a16bea0fc1c1461a690/users/58d8c5b6e5934f1587304d2938b7e820/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:07.051532 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1fe8b-d72a-4b04-ae48-3250818c7d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e79ce0cbbb704a16bea0fc1c1461a690, user_id=58d8c5b6e5934f1587304d2938b7e820, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:07.054233 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1fe8b-d72a-4b04-ae48-3250818c7d6d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:07.126310 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1327/2650] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:04:07 2022] PUT /identity/v3/projects/e79ce0cbbb704a16bea0fc1c1461a690/users/58d8c5b6e5934f1587304d2938b7e820/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:07.130272 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2cbf4-09bc-422f-96fc-b84669245f5c admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:07.140976 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2cbf4-09bc-422f-96fc-b84669245f5c admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:07.206129 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab6999-12b8-4f69-9292-5ec0af47ca0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:07.206803 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab6999-12b8-4f69-9292-5ec0af47ca0b admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:07.207085 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab6999-12b8-4f69-9292-5ec0af47ca0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:07.207360 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab6999-12b8-4f69-9292-5ec0af47ca0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:07.208079 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab6999-12b8-4f69-9292-5ec0af47ca0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:07.209705 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab6999-12b8-4f69-9292-5ec0af47ca0b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:07.220624 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1324/2651] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:04:07.225067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1fe8b-d72a-4b04-ae48-3250818c7d6d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:07.235901 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1fe8b-d72a-4b04-ae48-3250818c7d6d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:07.240518 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af6a99-16f4-422d-8593-ed9101bcb752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:07.241426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af6a99-16f4-422d-8593-ed9101bcb752 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:07.241781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af6a99-16f4-422d-8593-ed9101bcb752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:07.241996 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3af6a99-16f4-422d-8593-ed9101bcb752 admin admin] PATH_INFO: `/v3/projects/e79ce0cbbb704a16bea0fc1c1461a690/users/58d8c5b6e5934f1587304d2938b7e820/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:07.243973 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af6a99-16f4-422d-8593-ed9101bcb752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e79ce0cbbb704a16bea0fc1c1461a690, user_id=58d8c5b6e5934f1587304d2938b7e820, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:07.247009 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3af6a99-16f4-422d-8593-ed9101bcb752 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:07.257097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1328/2652] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:04:07 2022] PUT /identity/v3/projects/e79ce0cbbb704a16bea0fc1c1461a690/users/58d8c5b6e5934f1587304d2938b7e820/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:07.268276 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aad1d-fbf2-40fa-8fa3-179aba62d77f None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:07.268568 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aad1d-fbf2-40fa-8fa3-179aba62d77f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:07.268850 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aad1d-fbf2-40fa-8fa3-179aba62d77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:07.298263 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-bd0aad1d-fbf2-40fa-8fa3-179aba62d77f None None] MFA Rules not processed for user `58d8c5b6e5934f1587304d2938b7e820`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:07.299493 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-bd0aad1d-fbf2-40fa-8fa3-179aba62d77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:07.375674 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1325/2653] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:07.387169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af6a99-16f4-422d-8593-ed9101bcb752 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:07.390977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c3af6a99-16f4-422d-8593-ed9101bcb752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:07.450950 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3af6a99-16f4-422d-8593-ed9101bcb752 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:07.455405 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d41fdd2-3c66-4ad7-b8de-794fc6a372b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:07.456058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41fdd2-3c66-4ad7-b8de-794fc6a372b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:07.459756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41fdd2-3c66-4ad7-b8de-794fc6a372b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:07.459756 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d41fdd2-3c66-4ad7-b8de-794fc6a372b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:07.498023 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:07.524550 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41fdd2-3c66-4ad7-b8de-794fc6a372b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:07.527192 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d41fdd2-3c66-4ad7-b8de-794fc6a372b9 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:07.537507 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1329/2654] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:04:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:04:14.744663 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0aad1d-fbf2-40fa-8fa3-179aba62d77f None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:14.832232 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0aad1d-fbf2-40fa-8fa3-179aba62d77f None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:14.837917 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bf8bc-e899-48a0-a836-fc67777a591c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:14.842856 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bf8bc-e899-48a0-a836-fc67777a591c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:14.842856 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bf8bc-e899-48a0-a836-fc67777a591c admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:14.842856 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0bf8bc-e899-48a0-a836-fc67777a591c admin admin] PATH_INFO: `/v3/users/54f42da9dce84649999538220bb7250a` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:14.842856 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0bf8bc-e899-48a0-a836-fc67777a591c admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f42da9dce84649999538220bb7250a)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:14.843881 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0bf8bc-e899-48a0-a836-fc67777a591c admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:14.846541 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:15.022991 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7b0bf8bc-e899-48a0-a836-fc67777a591c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f42da9dce84649999538220bb7250a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:15.091509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7b0bf8bc-e899-48a0-a836-fc67777a591c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f42da9dce84649999538220bb7250a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:15.101795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7b0bf8bc-e899-48a0-a836-fc67777a591c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f42da9dce84649999538220bb7250a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:15.102577 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7b0bf8bc-e899-48a0-a836-fc67777a591c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f42da9dce84649999538220bb7250a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:15.118529 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-7b0bf8bc-e899-48a0-a836-fc67777a591c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f42da9dce84649999538220bb7250a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:15.124751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1326/2655] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:04:14 2022] DELETE /identity/v3/users/54f42da9dce84649999538220bb7250a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:15.129287 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c40d4-9fef-4cc2-84f8-8d14615b9118 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:15.129801 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c40d4-9fef-4cc2-84f8-8d14615b9118 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:15.129899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c40d4-9fef-4cc2-84f8-8d14615b9118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:15.149124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-c18c40d4-9fef-4cc2-84f8-8d14615b9118 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:15.149124 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c18c40d4-9fef-4cc2-84f8-8d14615b9118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:15.224762 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1330/2656] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:15.236299 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bf8bc-e899-48a0-a836-fc67777a591c admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:15.237799 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7b0bf8bc-e899-48a0-a836-fc67777a591c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:15.302268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0bf8bc-e899-48a0-a836-fc67777a591c admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:15.309953 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd879bb-ce22-4508-b12b-fab5f98595bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:15.309953 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd879bb-ce22-4508-b12b-fab5f98595bd service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:15.309953 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd879bb-ce22-4508-b12b-fab5f98595bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:15.309953 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd879bb-ce22-4508-b12b-fab5f98595bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:15.316791 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd879bb-ce22-4508-b12b-fab5f98595bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:15.318245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd879bb-ce22-4508-b12b-fab5f98595bd service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:15.328604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1327/2657] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:04:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:04:16.012750 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c40d4-9fef-4cc2-84f8-8d14615b9118 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:16.014453 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-c18c40d4-9fef-4cc2-84f8-8d14615b9118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:16.036133 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c40d4-9fef-4cc2-84f8-8d14615b9118 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:16.048356 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e11b6d-c78f-4032-99a0-8fda04cba384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:16.049435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e11b6d-c78f-4032-99a0-8fda04cba384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:16.049797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e11b6d-c78f-4032-99a0-8fda04cba384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:16.050081 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e11b6d-c78f-4032-99a0-8fda04cba384 admin admin] PATH_INFO: `/v3/projects/fbe63efddfe04a6ca789314491f9cf5e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:16.051394 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e11b6d-c78f-4032-99a0-8fda04cba384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe63efddfe04a6ca789314491f9cf5e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:16.053356 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e11b6d-c78f-4032-99a0-8fda04cba384 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:16.225095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f8e11b6d-c78f-4032-99a0-8fda04cba384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe63efddfe04a6ca789314491f9cf5e', 'request_id': 'req-f8e11b6d-c78f-4032-99a0-8fda04cba384'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:16.233730 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f8e11b6d-c78f-4032-99a0-8fda04cba384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe63efddfe04a6ca789314491f9cf5e', 'request_id': 'req-f8e11b6d-c78f-4032-99a0-8fda04cba384'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:16.241916 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f8e11b6d-c78f-4032-99a0-8fda04cba384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe63efddfe04a6ca789314491f9cf5e', 'request_id': 'req-f8e11b6d-c78f-4032-99a0-8fda04cba384'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:16.380656 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f8e11b6d-c78f-4032-99a0-8fda04cba384 admin admin] The token cache is being invalidate because project fbe63efddfe04a6ca789314491f9cf5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:04:16.380856 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f8e11b6d-c78f-4032-99a0-8fda04cba384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:16.381575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f8e11b6d-c78f-4032-99a0-8fda04cba384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:16.383658 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1331/2658] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:04:16 2022] DELETE /identity/v3/projects/fbe63efddfe04a6ca789314491f9cf5e => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:16.388821 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd879bb-ce22-4508-b12b-fab5f98595bd service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:16.402196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd879bb-ce22-4508-b12b-fab5f98595bd service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:16.476372 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75a172-74d8-4821-92c2-03c2ca4196f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:16.477788 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75a172-74d8-4821-92c2-03c2ca4196f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:16.477788 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75a172-74d8-4821-92c2-03c2ca4196f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:16.478142 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75a172-74d8-4821-92c2-03c2ca4196f6 admin admin] PATH_INFO: `/v3/users/58d8c5b6e5934f1587304d2938b7e820` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:16.480654 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75a172-74d8-4821-92c2-03c2ca4196f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58d8c5b6e5934f1587304d2938b7e820)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:16.482896 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f75a172-74d8-4821-92c2-03c2ca4196f6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:16.578200 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:16.709695 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8f75a172-74d8-4821-92c2-03c2ca4196f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58d8c5b6e5934f1587304d2938b7e820'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:16.843297 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8f75a172-74d8-4821-92c2-03c2ca4196f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58d8c5b6e5934f1587304d2938b7e820'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:16.858700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8f75a172-74d8-4821-92c2-03c2ca4196f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58d8c5b6e5934f1587304d2938b7e820'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:16.861383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8f75a172-74d8-4821-92c2-03c2ca4196f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58d8c5b6e5934f1587304d2938b7e820'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:16.875885 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8f75a172-74d8-4821-92c2-03c2ca4196f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58d8c5b6e5934f1587304d2938b7e820'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:16.883530 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1328/2659] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:04:16 2022] DELETE /identity/v3/users/58d8c5b6e5934f1587304d2938b7e820 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:17.316736 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e11b6d-c78f-4032-99a0-8fda04cba384 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:17.318264 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f8e11b6d-c78f-4032-99a0-8fda04cba384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:17.331291 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e11b6d-c78f-4032-99a0-8fda04cba384 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:17.392186 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:17.398350 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0bea2-369e-44dd-a5e3-c1dca101aa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:17.399222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0bea2-369e-44dd-a5e3-c1dca101aa29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:17.399508 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0bea2-369e-44dd-a5e3-c1dca101aa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:17.399794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0bea2-369e-44dd-a5e3-c1dca101aa29 admin admin] PATH_INFO: `/v3/projects/e79ce0cbbb704a16bea0fc1c1461a690` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:17.401541 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0bea2-369e-44dd-a5e3-c1dca101aa29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e79ce0cbbb704a16bea0fc1c1461a690)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:17.403882 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0bea2-369e-44dd-a5e3-c1dca101aa29 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:17.528180 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fea0bea2-369e-44dd-a5e3-c1dca101aa29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e79ce0cbbb704a16bea0fc1c1461a690', 'request_id': 'req-fea0bea2-369e-44dd-a5e3-c1dca101aa29'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:17.535159 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fea0bea2-369e-44dd-a5e3-c1dca101aa29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e79ce0cbbb704a16bea0fc1c1461a690', 'request_id': 'req-fea0bea2-369e-44dd-a5e3-c1dca101aa29'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:17.541651 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fea0bea2-369e-44dd-a5e3-c1dca101aa29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e79ce0cbbb704a16bea0fc1c1461a690', 'request_id': 'req-fea0bea2-369e-44dd-a5e3-c1dca101aa29'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:17.614133 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fea0bea2-369e-44dd-a5e3-c1dca101aa29 admin admin] The token cache is being invalidate because project e79ce0cbbb704a16bea0fc1c1461a690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:04:17.614866 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fea0bea2-369e-44dd-a5e3-c1dca101aa29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:17.616294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-fea0bea2-369e-44dd-a5e3-c1dca101aa29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:17.619203 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1332/2660] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:04:17 2022] DELETE /identity/v3/projects/e79ce0cbbb704a16bea0fc1c1461a690 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:17.624469 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f66dd-0706-4530-9e6e-71d1c586be55 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:17.625331 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f66dd-0706-4530-9e6e-71d1c586be55 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:17.625522 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5f66dd-0706-4530-9e6e-71d1c586be55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:17.657244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-1a5f66dd-0706-4530-9e6e-71d1c586be55 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:17.658500 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1a5f66dd-0706-4530-9e6e-71d1c586be55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:17.734839 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1329/2661] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:04:17.736855 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20aa80-a902-402d-b5dd-6c30fe751bd5 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:17.737191 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20aa80-a902-402d-b5dd-6c30fe751bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:17.737474 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20aa80-a902-402d-b5dd-6c30fe751bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:17.758886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ac20aa80-a902-402d-b5dd-6c30fe751bd5 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:17.760726 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ac20aa80-a902-402d-b5dd-6c30fe751bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:17.772820 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1333/2662] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:17.778254 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f66dd-0706-4530-9e6e-71d1c586be55 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:17.787997 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5f66dd-0706-4530-9e6e-71d1c586be55 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:17.793268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d6250-fdae-472f-8e30-98d7edf09c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:17.793958 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d6250-fdae-472f-8e30-98d7edf09c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:17.794243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d6250-fdae-472f-8e30-98d7edf09c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:17.794524 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d6250-fdae-472f-8e30-98d7edf09c21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:17.795265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d6250-fdae-472f-8e30-98d7edf09c21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:04:17.795576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d6250-fdae-472f-8e30-98d7edf09c21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:17.797383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d6250-fdae-472f-8e30-98d7edf09c21 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:17.811317 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1330/2663] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:04:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:04:17.815858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20aa80-a902-402d-b5dd-6c30fe751bd5 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:17.826019 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20aa80-a902-402d-b5dd-6c30fe751bd5 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:17.830579 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87926256-5395-42f4-ae8b-c91e4437a231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:17.831279 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87926256-5395-42f4-ae8b-c91e4437a231 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:17.831561 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87926256-5395-42f4-ae8b-c91e4437a231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:17.831867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87926256-5395-42f4-ae8b-c91e4437a231 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:17.832585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87926256-5395-42f4-ae8b-c91e4437a231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:17.834533 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87926256-5395-42f4-ae8b-c91e4437a231 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:17.917189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1334/2664] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:04:17 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:04:17.918035 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d6250-fdae-472f-8e30-98d7edf09c21 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:17.928417 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d6250-fdae-472f-8e30-98d7edf09c21 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:17.987997 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c5705-b277-4f32-9f58-734527365eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:17.988556 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c5705-b277-4f32-9f58-734527365eac admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:17.988844 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c5705-b277-4f32-9f58-734527365eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:17.989151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c5705-b277-4f32-9f58-734527365eac admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:17.989846 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c5705-b277-4f32-9f58-734527365eac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:17.991798 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c5705-b277-4f32-9f58-734527365eac admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:18.066761 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1331/2665] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:04:17 2022] POST /identity/v3/users => generated 287 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:04:18.067997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87926256-5395-42f4-ae8b-c91e4437a231 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:18.079107 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87926256-5395-42f4-ae8b-c91e4437a231 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:18.084320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafda980-5d6c-4284-8c1d-2c2edd36a69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:18.085058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafda980-5d6c-4284-8c1d-2c2edd36a69d admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:18.085353 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafda980-5d6c-4284-8c1d-2c2edd36a69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:18.085636 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafda980-5d6c-4284-8c1d-2c2edd36a69d admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:18.086404 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafda980-5d6c-4284-8c1d-2c2edd36a69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:18.088552 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafda980-5d6c-4284-8c1d-2c2edd36a69d admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:18.104406 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1335/2666] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:04:18.105952 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c5705-b277-4f32-9f58-734527365eac admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:18.116310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c5705-b277-4f32-9f58-734527365eac admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:18.121535 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc42a8c-edff-4ff6-91de-601f13ee23f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:18.122237 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc42a8c-edff-4ff6-91de-601f13ee23f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:18.122519 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc42a8c-edff-4ff6-91de-601f13ee23f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:18.122793 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc42a8c-edff-4ff6-91de-601f13ee23f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:18.123518 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc42a8c-edff-4ff6-91de-601f13ee23f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:18.125216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc42a8c-edff-4ff6-91de-601f13ee23f7 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:18.137636 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1332/2667] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:04:18.142529 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafda980-5d6c-4284-8c1d-2c2edd36a69d admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:18.155160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafda980-5d6c-4284-8c1d-2c2edd36a69d admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:18.161164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00ab35-73e4-4ef1-b1b9-cb536d0d8e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:18.162059 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00ab35-73e4-4ef1-b1b9-cb536d0d8e43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:18.162348 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00ab35-73e4-4ef1-b1b9-cb536d0d8e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:18.162628 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00ab35-73e4-4ef1-b1b9-cb536d0d8e43 admin admin] PATH_INFO: `/v3/projects/bae047a4da364bb1912416ff3b41152d/users/bbb62616b2df4513b826cf581f07e63d/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:18.180198 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00ab35-73e4-4ef1-b1b9-cb536d0d8e43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bae047a4da364bb1912416ff3b41152d, user_id=bbb62616b2df4513b826cf581f07e63d, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:18.183747 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00ab35-73e4-4ef1-b1b9-cb536d0d8e43 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:18.292534 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1336/2668] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:04:18 2022] PUT /identity/v3/projects/bae047a4da364bb1912416ff3b41152d/users/bbb62616b2df4513b826cf581f07e63d/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:18.302995 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3eed2a-fac2-4474-851f-b7db9c55d2e5 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:18.303272 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3eed2a-fac2-4474-851f-b7db9c55d2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:18.303525 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3eed2a-fac2-4474-851f-b7db9c55d2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:18.323980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:18.333884 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-3c3eed2a-fac2-4474-851f-b7db9c55d2e5 None None] MFA Rules not processed for user `bbb62616b2df4513b826cf581f07e63d`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:18.338830 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3c3eed2a-fac2-4474-851f-b7db9c55d2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:18.401348 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1333/2669] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:04:18.577627 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00ab35-73e4-4ef1-b1b9-cb536d0d8e43 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:18.579688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-dd00ab35-73e4-4ef1-b1b9-cb536d0d8e43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:18.639397 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00ab35-73e4-4ef1-b1b9-cb536d0d8e43 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:18.642970 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8071a-d588-4762-9efe-2fed10f432e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:18.643640 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8071a-d588-4762-9efe-2fed10f432e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:18.643922 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8071a-d588-4762-9efe-2fed10f432e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:18.644198 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8071a-d588-4762-9efe-2fed10f432e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:18.653585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8071a-d588-4762-9efe-2fed10f432e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:18.655027 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8071a-d588-4762-9efe-2fed10f432e4 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:18.663766 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1337/2670] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:04:18 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:04:18.688624 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3eed2a-fac2-4474-851f-b7db9c55d2e5 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:18.753641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3eed2a-fac2-4474-851f-b7db9c55d2e5 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:18.758443 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9271b-b353-441b-a0e0-dcced2a45d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:18.759327 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9271b-b353-441b-a0e0-dcced2a45d72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:18.759617 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9271b-b353-441b-a0e0-dcced2a45d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:18.759908 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd9271b-b353-441b-a0e0-dcced2a45d72 admin admin] PATH_INFO: `/v3/users/bbb62616b2df4513b826cf581f07e63d` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:18.761847 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9271b-b353-441b-a0e0-dcced2a45d72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb62616b2df4513b826cf581f07e63d)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:18.763798 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd9271b-b353-441b-a0e0-dcced2a45d72 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:18.910330 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1cd9271b-b353-441b-a0e0-dcced2a45d72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb62616b2df4513b826cf581f07e63d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:18.954039 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1cd9271b-b353-441b-a0e0-dcced2a45d72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb62616b2df4513b826cf581f07e63d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:18.961996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1cd9271b-b353-441b-a0e0-dcced2a45d72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb62616b2df4513b826cf581f07e63d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:18.962776 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1cd9271b-b353-441b-a0e0-dcced2a45d72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb62616b2df4513b826cf581f07e63d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:18.976317 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1cd9271b-b353-441b-a0e0-dcced2a45d72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb62616b2df4513b826cf581f07e63d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:18.983438 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1334/2671] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:04:18 2022] DELETE /identity/v3/users/bbb62616b2df4513b826cf581f07e63d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:18.988475 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e217b-a463-464f-8c9f-c1b678a6b536 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:18.988801 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e217b-a463-464f-8c9f-c1b678a6b536 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:18.989111 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145e217b-a463-464f-8c9f-c1b678a6b536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:19.006989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-145e217b-a463-464f-8c9f-c1b678a6b536 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:19.008200 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-145e217b-a463-464f-8c9f-c1b678a6b536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:19.029336 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:19.069543 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1338/2672] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:19.079539 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9271b-b353-441b-a0e0-dcced2a45d72 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:19.081321 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1cd9271b-b353-441b-a0e0-dcced2a45d72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:19.101306 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:19.139802 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd9271b-b353-441b-a0e0-dcced2a45d72 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:19.143504 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c872c-9836-4f2b-8493-3b19d50fb9d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:19.144159 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c872c-9836-4f2b-8493-3b19d50fb9d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:19.144443 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c872c-9836-4f2b-8493-3b19d50fb9d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:19.144722 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c872c-9836-4f2b-8493-3b19d50fb9d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:19.155479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c872c-9836-4f2b-8493-3b19d50fb9d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:19.156938 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c872c-9836-4f2b-8493-3b19d50fb9d1 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:19.167284 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1335/2673] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:04:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:04:19.584111 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e217b-a463-464f-8c9f-c1b678a6b536 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:19.585606 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-145e217b-a463-464f-8c9f-c1b678a6b536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:19.598475 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145e217b-a463-464f-8c9f-c1b678a6b536 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:19.603088 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4beb907-69fb-41e6-ad5a-47b573317655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:19.605136 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4beb907-69fb-41e6-ad5a-47b573317655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:19.605268 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4beb907-69fb-41e6-ad5a-47b573317655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:19.605539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4beb907-69fb-41e6-ad5a-47b573317655 admin admin] PATH_INFO: `/v3/projects/bae047a4da364bb1912416ff3b41152d` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:19.606762 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4beb907-69fb-41e6-ad5a-47b573317655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bae047a4da364bb1912416ff3b41152d)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:19.608691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4beb907-69fb-41e6-ad5a-47b573317655 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:19.751109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d4beb907-69fb-41e6-ad5a-47b573317655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bae047a4da364bb1912416ff3b41152d', 'request_id': 'req-d4beb907-69fb-41e6-ad5a-47b573317655'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:19.757640 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d4beb907-69fb-41e6-ad5a-47b573317655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bae047a4da364bb1912416ff3b41152d', 'request_id': 'req-d4beb907-69fb-41e6-ad5a-47b573317655'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:19.764944 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d4beb907-69fb-41e6-ad5a-47b573317655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bae047a4da364bb1912416ff3b41152d', 'request_id': 'req-d4beb907-69fb-41e6-ad5a-47b573317655'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:19.833813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d4beb907-69fb-41e6-ad5a-47b573317655 admin admin] The token cache is being invalidate because project bae047a4da364bb1912416ff3b41152d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:04:19.834104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d4beb907-69fb-41e6-ad5a-47b573317655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:19.834729 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-d4beb907-69fb-41e6-ad5a-47b573317655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:19.836364 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1339/2674] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:04:19 2022] DELETE /identity/v3/projects/bae047a4da364bb1912416ff3b41152d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:19.841486 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5b60a-d04b-4f48-bbda-fba1b90ea8dc None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:19.841978 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5b60a-d04b-4f48-bbda-fba1b90ea8dc None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:19.842112 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5b60a-d04b-4f48-bbda-fba1b90ea8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:19.860730 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-a3f5b60a-d04b-4f48-bbda-fba1b90ea8dc None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:19.862026 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a3f5b60a-d04b-4f48-bbda-fba1b90ea8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:19.922539 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1336/2675] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:19.930223 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97225165-6271-4487-a6de-15f30bd17037 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:19.930513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97225165-6271-4487-a6de-15f30bd17037 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:19.930824 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97225165-6271-4487-a6de-15f30bd17037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:19.950141 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-97225165-6271-4487-a6de-15f30bd17037 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:19.951365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-97225165-6271-4487-a6de-15f30bd17037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:19.959623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1340/2676] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:19.963941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5b60a-d04b-4f48-bbda-fba1b90ea8dc None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:19.974122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5b60a-d04b-4f48-bbda-fba1b90ea8dc None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:19.979585 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f855b-9c8b-478b-96cb-e2918dc6ff19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:19.980277 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f855b-9c8b-478b-96cb-e2918dc6ff19 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:19.980561 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f855b-9c8b-478b-96cb-e2918dc6ff19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:19.980840 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f855b-9c8b-478b-96cb-e2918dc6ff19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:19.981730 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f855b-9c8b-478b-96cb-e2918dc6ff19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:04:19.982034 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f855b-9c8b-478b-96cb-e2918dc6ff19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:19.983653 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f855b-9c8b-478b-96cb-e2918dc6ff19 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:19.996785 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1337/2677] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 17:04:20.001003 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97225165-6271-4487-a6de-15f30bd17037 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:20.010433 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97225165-6271-4487-a6de-15f30bd17037 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:20.015177 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11b824-38fe-4e1c-a595-7db6fd4b4e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:20.015847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11b824-38fe-4e1c-a595-7db6fd4b4e68 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:20.016142 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11b824-38fe-4e1c-a595-7db6fd4b4e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:20.016424 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d11b824-38fe-4e1c-a595-7db6fd4b4e68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:20.017163 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11b824-38fe-4e1c-a595-7db6fd4b4e68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:20.019062 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d11b824-38fe-4e1c-a595-7db6fd4b4e68 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:20.150160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1341/2678] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:04:20 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:04:20.155076 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f855b-9c8b-478b-96cb-e2918dc6ff19 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:20.165313 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f855b-9c8b-478b-96cb-e2918dc6ff19 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:20.224120 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0170f-0fbd-41fe-9d26-8e24a0bac96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:20.224795 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0170f-0fbd-41fe-9d26-8e24a0bac96d admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:20.225108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0170f-0fbd-41fe-9d26-8e24a0bac96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:20.225392 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff0170f-0fbd-41fe-9d26-8e24a0bac96d admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:20.226081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0170f-0fbd-41fe-9d26-8e24a0bac96d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:20.228078 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff0170f-0fbd-41fe-9d26-8e24a0bac96d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:20.314647 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1338/2679] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:04:20 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:04:20.319028 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11b824-38fe-4e1c-a595-7db6fd4b4e68 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:20.329633 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d11b824-38fe-4e1c-a595-7db6fd4b4e68 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:20.334225 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb0131-7189-4b22-9805-f6389d81256a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:20.334920 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb0131-7189-4b22-9805-f6389d81256a admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:20.335213 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb0131-7189-4b22-9805-f6389d81256a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:20.335536 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb0131-7189-4b22-9805-f6389d81256a admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:20.336270 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb0131-7189-4b22-9805-f6389d81256a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:20.338413 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb0131-7189-4b22-9805-f6389d81256a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:20.349555 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1342/2680] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:04:20.354244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0170f-0fbd-41fe-9d26-8e24a0bac96d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:20.364797 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff0170f-0fbd-41fe-9d26-8e24a0bac96d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:20.369948 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c131b2-9822-44e0-9ddf-6d76da3633c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:20.370730 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c131b2-9822-44e0-9ddf-6d76da3633c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:20.371031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c131b2-9822-44e0-9ddf-6d76da3633c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:20.371337 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c131b2-9822-44e0-9ddf-6d76da3633c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:20.372074 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c131b2-9822-44e0-9ddf-6d76da3633c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:20.373767 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c131b2-9822-44e0-9ddf-6d76da3633c4 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:20.384108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1339/2681] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:04:20.388727 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb0131-7189-4b22-9805-f6389d81256a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:20.398729 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb0131-7189-4b22-9805-f6389d81256a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:20.404424 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff648a1-574a-4d9e-bf96-4dd3224ca04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:20.405342 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff648a1-574a-4d9e-bf96-4dd3224ca04c admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:20.405629 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff648a1-574a-4d9e-bf96-4dd3224ca04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:20.405904 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff648a1-574a-4d9e-bf96-4dd3224ca04c admin admin] PATH_INFO: `/v3/projects/1954560e876d4b1fbfec255b13ca7ba4/users/ab865b95180849e0aaf9eacb9eabc446/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:20.421273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff648a1-574a-4d9e-bf96-4dd3224ca04c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1954560e876d4b1fbfec255b13ca7ba4, user_id=ab865b95180849e0aaf9eacb9eabc446, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:20.423997 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff648a1-574a-4d9e-bf96-4dd3224ca04c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:20.491138 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1343/2682] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:04:20 2022] PUT /identity/v3/projects/1954560e876d4b1fbfec255b13ca7ba4/users/ab865b95180849e0aaf9eacb9eabc446/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:20.502696 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31479efb-72a0-4a27-9aa1-fc4f23cee28c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:20.502984 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31479efb-72a0-4a27-9aa1-fc4f23cee28c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:20.503286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31479efb-72a0-4a27-9aa1-fc4f23cee28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:20.532057 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-31479efb-72a0-4a27-9aa1-fc4f23cee28c None None] MFA Rules not processed for user `ab865b95180849e0aaf9eacb9eabc446`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:20.533315 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-31479efb-72a0-4a27-9aa1-fc4f23cee28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:20.546081 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:20.597887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1340/2683] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:20.609207 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff648a1-574a-4d9e-bf96-4dd3224ca04c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:20.610979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0ff648a1-574a-4d9e-bf96-4dd3224ca04c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:20.664501 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:20.671376 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff648a1-574a-4d9e-bf96-4dd3224ca04c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:20.683618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e25bf-13a7-4364-a104-4294f8af523f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:20.683618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e25bf-13a7-4364-a104-4294f8af523f service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:20.683618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e25bf-13a7-4364-a104-4294f8af523f service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:20.683618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e25bf-13a7-4364-a104-4294f8af523f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:20.685283 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e25bf-13a7-4364-a104-4294f8af523f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:20.686714 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e25bf-13a7-4364-a104-4294f8af523f service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:20.695691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1344/2684] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:04:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:04:23.453199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91adafe-78bf-427f-9659-bff806ad6e65 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:23.453726 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91adafe-78bf-427f-9659-bff806ad6e65 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:23.453971 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91adafe-78bf-427f-9659-bff806ad6e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:23.472997 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c91adafe-78bf-427f-9659-bff806ad6e65 None None] MFA Rules not processed for user `ab865b95180849e0aaf9eacb9eabc446`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:23.474276 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c91adafe-78bf-427f-9659-bff806ad6e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:23.481827 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1341/2685] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:25.618752 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e25bf-13a7-4364-a104-4294f8af523f service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:25.620360 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f95e25bf-13a7-4364-a104-4294f8af523f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:25.678743 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e25bf-13a7-4364-a104-4294f8af523f service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:25.682450 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839c5ee-b238-4ec9-b4c4-0e5005ae2382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:25.683074 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839c5ee-b238-4ec9-b4c4-0e5005ae2382 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:25.683362 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839c5ee-b238-4ec9-b4c4-0e5005ae2382 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:25.683644 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839c5ee-b238-4ec9-b4c4-0e5005ae2382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:25.685479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8839c5ee-b238-4ec9-b4c4-0e5005ae2382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:25.749106 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839c5ee-b238-4ec9-b4c4-0e5005ae2382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:25.750380 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839c5ee-b238-4ec9-b4c4-0e5005ae2382 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:25.760686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1345/2686] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:04:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:04:26.140494 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91adafe-78bf-427f-9659-bff806ad6e65 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:26.142588 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c91adafe-78bf-427f-9659-bff806ad6e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:26.232790 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91adafe-78bf-427f-9659-bff806ad6e65 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:26.240446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bc400-0b7f-47f5-a4c5-a0723002c6b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c8d6afb4ccd41a5972e3241a3eebc7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:26.241158 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bc400-0b7f-47f5-a4c5-a0723002c6b3 service placement] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:26.241439 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bc400-0b7f-47f5-a4c5-a0723002c6b3 service placement] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:26.241715 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bc400-0b7f-47f5-a4c5-a0723002c6b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:26.243609 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-773bc400-0b7f-47f5-a4c5-a0723002c6b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:26.256696 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bc400-0b7f-47f5-a4c5-a0723002c6b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:26.258356 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773bc400-0b7f-47f5-a4c5-a0723002c6b3 service placement] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:26.270128 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1342/2687] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:04:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:04:31.598691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839c5ee-b238-4ec9-b4c4-0e5005ae2382 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:31.600262 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8839c5ee-b238-4ec9-b4c4-0e5005ae2382 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:31.615706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839c5ee-b238-4ec9-b4c4-0e5005ae2382 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:31.618602 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12163085-9c1a-4243-9d8a-3d960b6fcbc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:31.619381 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12163085-9c1a-4243-9d8a-3d960b6fcbc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:31.619705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12163085-9c1a-4243-9d8a-3d960b6fcbc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:31.619994 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12163085-9c1a-4243-9d8a-3d960b6fcbc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:31.622047 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-12163085-9c1a-4243-9d8a-3d960b6fcbc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:31.645994 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12163085-9c1a-4243-9d8a-3d960b6fcbc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:31.647474 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12163085-9c1a-4243-9d8a-3d960b6fcbc0 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:31.660672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1346/2688] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:04:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:04:34.377775 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bc400-0b7f-47f5-a4c5-a0723002c6b3 service placement] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:34.381056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-773bc400-0b7f-47f5-a4c5-a0723002c6b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:34.398270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bc400-0b7f-47f5-a4c5-a0723002c6b3 service placement] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:34.408951 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4711035-1f7c-4307-8854-bb3fb1757c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:34.410906 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4711035-1f7c-4307-8854-bb3fb1757c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:34.411208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4711035-1f7c-4307-8854-bb3fb1757c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:34.411491 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4711035-1f7c-4307-8854-bb3fb1757c67 admin admin] PATH_INFO: `/v3/users/4ad27549c1824d45b1d55653e2c121a8` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:34.459848 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4711035-1f7c-4307-8854-bb3fb1757c67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ad27549c1824d45b1d55653e2c121a8)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:34.461845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4711035-1f7c-4307-8854-bb3fb1757c67 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:34.694704 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c4711035-1f7c-4307-8854-bb3fb1757c67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ad27549c1824d45b1d55653e2c121a8'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:34.795622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c4711035-1f7c-4307-8854-bb3fb1757c67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ad27549c1824d45b1d55653e2c121a8'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:34.805395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c4711035-1f7c-4307-8854-bb3fb1757c67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ad27549c1824d45b1d55653e2c121a8'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:34.806416 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c4711035-1f7c-4307-8854-bb3fb1757c67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ad27549c1824d45b1d55653e2c121a8'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:34.831186 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c4711035-1f7c-4307-8854-bb3fb1757c67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ad27549c1824d45b1d55653e2c121a8'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:34.839240 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:34.848909 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1343/2689] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:04:34 2022] DELETE /identity/v3/users/4ad27549c1824d45b1d55653e2c121a8 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:35.350382 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12163085-9c1a-4243-9d8a-3d960b6fcbc0 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:35.361920 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12163085-9c1a-4243-9d8a-3d960b6fcbc0 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:35.435369 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda6406-5acd-4264-999e-2c883024c877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:35.436505 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda6406-5acd-4264-999e-2c883024c877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:35.436857 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda6406-5acd-4264-999e-2c883024c877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:35.437234 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda6406-5acd-4264-999e-2c883024c877 admin admin] PATH_INFO: `/v3/projects/997c256859f2484e8465c043b3d2299d` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:35.449241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda6406-5acd-4264-999e-2c883024c877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=997c256859f2484e8465c043b3d2299d)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:35.451213 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda6406-5acd-4264-999e-2c883024c877 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:35.481641 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:35.510478 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4711035-1f7c-4307-8854-bb3fb1757c67 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:35.512955 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c4711035-1f7c-4307-8854-bb3fb1757c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:35.529943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4711035-1f7c-4307-8854-bb3fb1757c67 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:35.534936 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41774b1e-e4f1-486c-b905-0d898eb3c894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:35.536555 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41774b1e-e4f1-486c-b905-0d898eb3c894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:35.536555 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41774b1e-e4f1-486c-b905-0d898eb3c894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:35.536555 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41774b1e-e4f1-486c-b905-0d898eb3c894 admin admin] PATH_INFO: `/v3/users/ffb43314dab24176a9610bd197f711dc` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:35.537906 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41774b1e-e4f1-486c-b905-0d898eb3c894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffb43314dab24176a9610bd197f711dc)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:35.539854 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41774b1e-e4f1-486c-b905-0d898eb3c894 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:35.604575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0dda6406-5acd-4264-999e-2c883024c877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '997c256859f2484e8465c043b3d2299d', 'request_id': 'req-0dda6406-5acd-4264-999e-2c883024c877'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:35.613642 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0dda6406-5acd-4264-999e-2c883024c877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '997c256859f2484e8465c043b3d2299d', 'request_id': 'req-0dda6406-5acd-4264-999e-2c883024c877'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:35.623697 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0dda6406-5acd-4264-999e-2c883024c877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '997c256859f2484e8465c043b3d2299d', 'request_id': 'req-0dda6406-5acd-4264-999e-2c883024c877'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:35.769940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0dda6406-5acd-4264-999e-2c883024c877 admin admin] The token cache is being invalidate because project 997c256859f2484e8465c043b3d2299d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:04:35.769940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0dda6406-5acd-4264-999e-2c883024c877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:35.770276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0dda6406-5acd-4264-999e-2c883024c877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:35.771948 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1347/2690] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:04:35 2022] DELETE /identity/v3/projects/997c256859f2484e8465c043b3d2299d => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:35.776853 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda6406-5acd-4264-999e-2c883024c877 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:35.778496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0dda6406-5acd-4264-999e-2c883024c877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:35.813546 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-41774b1e-e4f1-486c-b905-0d898eb3c894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffb43314dab24176a9610bd197f711dc'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:35.903643 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda6406-5acd-4264-999e-2c883024c877 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:35.917593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-41774b1e-e4f1-486c-b905-0d898eb3c894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffb43314dab24176a9610bd197f711dc'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:35.919378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ad9cb-7cfb-4bbe-865b-32fc48911212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:35.924149 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ad9cb-7cfb-4bbe-865b-32fc48911212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:35.924149 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ad9cb-7cfb-4bbe-865b-32fc48911212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:35.924149 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ad9cb-7cfb-4bbe-865b-32fc48911212 admin admin] PATH_INFO: `/v3/users/da79d652275341ecad56734db5665f87` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:35.944946 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-41774b1e-e4f1-486c-b905-0d898eb3c894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffb43314dab24176a9610bd197f711dc'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:35.946980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-41774b1e-e4f1-486c-b905-0d898eb3c894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffb43314dab24176a9610bd197f711dc'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:35.958965 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ad9cb-7cfb-4bbe-865b-32fc48911212 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da79d652275341ecad56734db5665f87)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:35.958965 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ad9cb-7cfb-4bbe-865b-32fc48911212 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:35.994242 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-41774b1e-e4f1-486c-b905-0d898eb3c894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffb43314dab24176a9610bd197f711dc'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:36.003782 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1344/2691] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:04:35 2022] DELETE /identity/v3/users/ffb43314dab24176a9610bd197f711dc => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:04:36.010173 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012b643-d872-47f6-98af-f0792c0df65a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:36.010951 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012b643-d872-47f6-98af-f0792c0df65a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:36.011470 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012b643-d872-47f6-98af-f0792c0df65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:36.045453 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-1012b643-d872-47f6-98af-f0792c0df65a None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:36.047353 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1012b643-d872-47f6-98af-f0792c0df65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:36.167146 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1345/2692] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:36.177837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012b643-d872-47f6-98af-f0792c0df65a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:36.179477 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1012b643-d872-47f6-98af-f0792c0df65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:36.220900 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b80ad9cb-7cfb-4bbe-865b-32fc48911212 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da79d652275341ecad56734db5665f87'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:36.248348 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012b643-d872-47f6-98af-f0792c0df65a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:36.252376 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735be790-c586-4ee6-a36c-a257fa25d355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:36.253255 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735be790-c586-4ee6-a36c-a257fa25d355 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:36.253421 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735be790-c586-4ee6-a36c-a257fa25d355 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:36.253706 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735be790-c586-4ee6-a36c-a257fa25d355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:36.265288 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735be790-c586-4ee6-a36c-a257fa25d355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:36.266750 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735be790-c586-4ee6-a36c-a257fa25d355 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:36.277043 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1346/2693] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:04:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:04:36.285458 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b80ad9cb-7cfb-4bbe-865b-32fc48911212 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da79d652275341ecad56734db5665f87'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:36.295009 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b80ad9cb-7cfb-4bbe-865b-32fc48911212 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da79d652275341ecad56734db5665f87'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:36.295802 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b80ad9cb-7cfb-4bbe-865b-32fc48911212 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da79d652275341ecad56734db5665f87'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:36.313059 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b80ad9cb-7cfb-4bbe-865b-32fc48911212 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da79d652275341ecad56734db5665f87'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:36.325207 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1348/2694] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:04:35 2022] DELETE /identity/v3/users/da79d652275341ecad56734db5665f87 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:04:36.721209 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735be790-c586-4ee6-a36c-a257fa25d355 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:36.722733 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-735be790-c586-4ee6-a36c-a257fa25d355 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:36.743032 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735be790-c586-4ee6-a36c-a257fa25d355 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:36.756345 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:36.844698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee812b-ca68-4823-8ada-70217dd292f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:36.844698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee812b-ca68-4823-8ada-70217dd292f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:36.844698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee812b-ca68-4823-8ada-70217dd292f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:36.844698 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee812b-ca68-4823-8ada-70217dd292f2 admin admin] PATH_INFO: `/v3/projects/67c56b2cb75549c4a3e35941acfbed73` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:36.851592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ad9cb-7cfb-4bbe-865b-32fc48911212 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:36.853459 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b80ad9cb-7cfb-4bbe-865b-32fc48911212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:36.870920 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee812b-ca68-4823-8ada-70217dd292f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67c56b2cb75549c4a3e35941acfbed73)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:36.873554 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee812b-ca68-4823-8ada-70217dd292f2 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:36.877223 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ad9cb-7cfb-4bbe-865b-32fc48911212 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:36.889117 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e093373-2e3b-43d1-b073-ef5f5027e0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:36.890263 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e093373-2e3b-43d1-b073-ef5f5027e0e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:36.891619 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e093373-2e3b-43d1-b073-ef5f5027e0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:36.891918 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e093373-2e3b-43d1-b073-ef5f5027e0e0 admin admin] PATH_INFO: `/v3/projects/8b16481909894fc88d9be118c8f4d4cf` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:36.893794 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e093373-2e3b-43d1-b073-ef5f5027e0e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b16481909894fc88d9be118c8f4d4cf)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:36.897364 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e093373-2e3b-43d1-b073-ef5f5027e0e0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:36.913545 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:37.025955 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-feee812b-ca68-4823-8ada-70217dd292f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67c56b2cb75549c4a3e35941acfbed73', 'request_id': 'req-feee812b-ca68-4823-8ada-70217dd292f2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:37.031574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-feee812b-ca68-4823-8ada-70217dd292f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67c56b2cb75549c4a3e35941acfbed73', 'request_id': 'req-feee812b-ca68-4823-8ada-70217dd292f2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:37.044593 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-feee812b-ca68-4823-8ada-70217dd292f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67c56b2cb75549c4a3e35941acfbed73', 'request_id': 'req-feee812b-ca68-4823-8ada-70217dd292f2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:37.055146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1e093373-2e3b-43d1-b073-ef5f5027e0e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b16481909894fc88d9be118c8f4d4cf', 'request_id': 'req-1e093373-2e3b-43d1-b073-ef5f5027e0e0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:37.065189 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1e093373-2e3b-43d1-b073-ef5f5027e0e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b16481909894fc88d9be118c8f4d4cf', 'request_id': 'req-1e093373-2e3b-43d1-b073-ef5f5027e0e0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:37.071545 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1e093373-2e3b-43d1-b073-ef5f5027e0e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b16481909894fc88d9be118c8f4d4cf', 'request_id': 'req-1e093373-2e3b-43d1-b073-ef5f5027e0e0'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:37.122396 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-feee812b-ca68-4823-8ada-70217dd292f2 admin admin] The token cache is being invalidate because project 67c56b2cb75549c4a3e35941acfbed73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:04:37.122696 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-feee812b-ca68-4823-8ada-70217dd292f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:37.128555 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-feee812b-ca68-4823-8ada-70217dd292f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:37.128555 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1347/2695] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:04:36 2022] DELETE /identity/v3/projects/67c56b2cb75549c4a3e35941acfbed73 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:37.200366 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1e093373-2e3b-43d1-b073-ef5f5027e0e0 admin admin] The token cache is being invalidate because project 8b16481909894fc88d9be118c8f4d4cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:04:37.201436 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1e093373-2e3b-43d1-b073-ef5f5027e0e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:37.202451 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-1e093373-2e3b-43d1-b073-ef5f5027e0e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:37.207112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1349/2696] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:04:36 2022] DELETE /identity/v3/projects/8b16481909894fc88d9be118c8f4d4cf => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:37.217097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee812b-ca68-4823-8ada-70217dd292f2 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:37.217097 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-feee812b-ca68-4823-8ada-70217dd292f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:37.289493 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee812b-ca68-4823-8ada-70217dd292f2 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:37.357777 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04f8c1-72ae-4a24-a9b6-84d35a5a93bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:37.358976 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04f8c1-72ae-4a24-a9b6-84d35a5a93bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:37.359258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04f8c1-72ae-4a24-a9b6-84d35a5a93bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:37.359531 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04f8c1-72ae-4a24-a9b6-84d35a5a93bf admin admin] PATH_INFO: `/v3/users/2319dbf6c3e24b12a598911dfd2747b7` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:37.360870 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04f8c1-72ae-4a24-a9b6-84d35a5a93bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2319dbf6c3e24b12a598911dfd2747b7)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:37.362909 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a04f8c1-72ae-4a24-a9b6-84d35a5a93bf admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:37.401150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e093373-2e3b-43d1-b073-ef5f5027e0e0 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:37.405869 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1e093373-2e3b-43d1-b073-ef5f5027e0e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:37.432130 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e093373-2e3b-43d1-b073-ef5f5027e0e0 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:37.439771 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbd48f-748e-4352-a741-aaefca98722e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:37.440667 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbd48f-748e-4352-a741-aaefca98722e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:37.440948 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbd48f-748e-4352-a741-aaefca98722e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:37.441258 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbd48f-748e-4352-a741-aaefca98722e admin admin] PATH_INFO: `/v3/users/0cf277a2d03443c8af7a7bee2731d9d1` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:37.442478 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbd48f-748e-4352-a741-aaefca98722e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cf277a2d03443c8af7a7bee2731d9d1)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:37.444431 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbd48f-748e-4352-a741-aaefca98722e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:37.479927 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:37.556174 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8a04f8c1-72ae-4a24-a9b6-84d35a5a93bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2319dbf6c3e24b12a598911dfd2747b7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:37.602867 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bdfbd48f-748e-4352-a741-aaefca98722e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cf277a2d03443c8af7a7bee2731d9d1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:37.616341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8a04f8c1-72ae-4a24-a9b6-84d35a5a93bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2319dbf6c3e24b12a598911dfd2747b7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:37.624890 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8a04f8c1-72ae-4a24-a9b6-84d35a5a93bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2319dbf6c3e24b12a598911dfd2747b7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:37.626356 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8a04f8c1-72ae-4a24-a9b6-84d35a5a93bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2319dbf6c3e24b12a598911dfd2747b7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:37.638170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8a04f8c1-72ae-4a24-a9b6-84d35a5a93bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2319dbf6c3e24b12a598911dfd2747b7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:37.648290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1348/2697] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:04:37 2022] DELETE /identity/v3/users/2319dbf6c3e24b12a598911dfd2747b7 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:37.714066 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bdfbd48f-748e-4352-a741-aaefca98722e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cf277a2d03443c8af7a7bee2731d9d1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:37.722139 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bdfbd48f-748e-4352-a741-aaefca98722e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cf277a2d03443c8af7a7bee2731d9d1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:37.722872 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bdfbd48f-748e-4352-a741-aaefca98722e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cf277a2d03443c8af7a7bee2731d9d1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:37.738151 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-bdfbd48f-748e-4352-a741-aaefca98722e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cf277a2d03443c8af7a7bee2731d9d1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:37.749764 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1350/2698] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:04:37 2022] DELETE /identity/v3/users/0cf277a2d03443c8af7a7bee2731d9d1 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:38.052297 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04f8c1-72ae-4a24-a9b6-84d35a5a93bf admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:38.053769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-8a04f8c1-72ae-4a24-a9b6-84d35a5a93bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:38.088340 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbd48f-748e-4352-a741-aaefca98722e admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:38.088340 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-bdfbd48f-748e-4352-a741-aaefca98722e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:38.129607 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04f8c1-72ae-4a24-a9b6-84d35a5a93bf admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:38.157835 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbd48f-748e-4352-a741-aaefca98722e admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:38.162561 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ef5ee-1ea0-4e07-bf46-18fcc77fdfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:38.163436 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ef5ee-1ea0-4e07-bf46-18fcc77fdfc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:38.163728 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ef5ee-1ea0-4e07-bf46-18fcc77fdfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:38.164011 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ef5ee-1ea0-4e07-bf46-18fcc77fdfc6 admin admin] PATH_INFO: `/v3/projects/4a35abaaac714727be6055b9231b6839` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:38.165226 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ef5ee-1ea0-4e07-bf46-18fcc77fdfc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a35abaaac714727be6055b9231b6839)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:38.167779 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ef5ee-1ea0-4e07-bf46-18fcc77fdfc6 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:38.180216 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:38.200106 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc80c26-cedc-4fd6-97a4-441e9f45e3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:38.200997 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc80c26-cedc-4fd6-97a4-441e9f45e3e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:38.201308 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc80c26-cedc-4fd6-97a4-441e9f45e3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:38.201585 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc80c26-cedc-4fd6-97a4-441e9f45e3e8 admin admin] PATH_INFO: `/v3/projects/4f82344d2255427582cc29e253b37f0b` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:38.202780 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc80c26-cedc-4fd6-97a4-441e9f45e3e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f82344d2255427582cc29e253b37f0b)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:38.204705 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc80c26-cedc-4fd6-97a4-441e9f45e3e8 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:38.216932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:38.319485 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-554ef5ee-1ea0-4e07-bf46-18fcc77fdfc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a35abaaac714727be6055b9231b6839', 'request_id': 'req-554ef5ee-1ea0-4e07-bf46-18fcc77fdfc6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:38.326500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-554ef5ee-1ea0-4e07-bf46-18fcc77fdfc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a35abaaac714727be6055b9231b6839', 'request_id': 'req-554ef5ee-1ea0-4e07-bf46-18fcc77fdfc6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:38.332445 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-554ef5ee-1ea0-4e07-bf46-18fcc77fdfc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a35abaaac714727be6055b9231b6839', 'request_id': 'req-554ef5ee-1ea0-4e07-bf46-18fcc77fdfc6'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:38.356181 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4fc80c26-cedc-4fd6-97a4-441e9f45e3e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f82344d2255427582cc29e253b37f0b', 'request_id': 'req-4fc80c26-cedc-4fd6-97a4-441e9f45e3e8'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:38.362182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4fc80c26-cedc-4fd6-97a4-441e9f45e3e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f82344d2255427582cc29e253b37f0b', 'request_id': 'req-4fc80c26-cedc-4fd6-97a4-441e9f45e3e8'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:38.368551 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4fc80c26-cedc-4fd6-97a4-441e9f45e3e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f82344d2255427582cc29e253b37f0b', 'request_id': 'req-4fc80c26-cedc-4fd6-97a4-441e9f45e3e8'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:38.473029 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-554ef5ee-1ea0-4e07-bf46-18fcc77fdfc6 admin admin] The token cache is being invalidate because project 4a35abaaac714727be6055b9231b6839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:04:38.473525 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-554ef5ee-1ea0-4e07-bf46-18fcc77fdfc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:38.474550 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-554ef5ee-1ea0-4e07-bf46-18fcc77fdfc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:38.476150 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1351/2699] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:04:38 2022] DELETE /identity/v3/projects/4a35abaaac714727be6055b9231b6839 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:04:38.483148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09176b3-441c-4b0d-a7ef-49ff395cb95f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:38.483440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09176b3-441c-4b0d-a7ef-49ff395cb95f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:38.483983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09176b3-441c-4b0d-a7ef-49ff395cb95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:38.503169 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f09176b3-441c-4b0d-a7ef-49ff395cb95f None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:38.504384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f09176b3-441c-4b0d-a7ef-49ff395cb95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:38.530720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4fc80c26-cedc-4fd6-97a4-441e9f45e3e8 admin admin] The token cache is being invalidate because project 4f82344d2255427582cc29e253b37f0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:04:38.531083 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4fc80c26-cedc-4fd6-97a4-441e9f45e3e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:38.531723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-4fc80c26-cedc-4fd6-97a4-441e9f45e3e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:38.533541 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1349/2700] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:04:38 2022] DELETE /identity/v3/projects/4f82344d2255427582cc29e253b37f0b => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:38.538257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9cf23-0d1d-4d3e-b1b1-fab04a39a41f None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:38.538543 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9cf23-0d1d-4d3e-b1b1-fab04a39a41f None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:38.538817 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af9cf23-0d1d-4d3e-b1b1-fab04a39a41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:38.558778 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-4af9cf23-0d1d-4d3e-b1b1-fab04a39a41f None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:38.560233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4af9cf23-0d1d-4d3e-b1b1-fab04a39a41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:38.568196 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1352/2701] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:38.629573 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1350/2702] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:38.632420 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd01ad-76d8-4bfd-95a4-591c0d984f85 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:38.632715 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd01ad-76d8-4bfd-95a4-591c0d984f85 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:38.633002 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd01ad-76d8-4bfd-95a4-591c0d984f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:38.637960 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6faa4f-5d22-4723-b586-0b861bb490f8 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:38.638155 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6faa4f-5d22-4723-b586-0b861bb490f8 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:38.638433 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6faa4f-5d22-4723-b586-0b861bb490f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:38.655502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-21cd01ad-76d8-4bfd-95a4-591c0d984f85 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:38.656724 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-21cd01ad-76d8-4bfd-95a4-591c0d984f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:38.658313 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-5b6faa4f-5d22-4723-b586-0b861bb490f8 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:38.659476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5b6faa4f-5d22-4723-b586-0b861bb490f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:38.665102 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1353/2703] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:38.669856 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd01ad-76d8-4bfd-95a4-591c0d984f85 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:38.671009 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1351/2704] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:04:38.679500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd01ad-76d8-4bfd-95a4-591c0d984f85 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:38.680162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6faa4f-5d22-4723-b586-0b861bb490f8 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:38.685051 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07482f35-3f29-4790-bfde-49703cf62f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:38.685639 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07482f35-3f29-4790-bfde-49703cf62f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:38.685946 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07482f35-3f29-4790-bfde-49703cf62f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:38.686209 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07482f35-3f29-4790-bfde-49703cf62f08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:38.686947 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07482f35-3f29-4790-bfde-49703cf62f08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:04:38.687255 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07482f35-3f29-4790-bfde-49703cf62f08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:38.688884 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07482f35-3f29-4790-bfde-49703cf62f08 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:38.690257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6faa4f-5d22-4723-b586-0b861bb490f8 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:38.695036 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d2244-5172-4118-9b08-af28491ef9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:38.695705 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d2244-5172-4118-9b08-af28491ef9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:38.696034 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d2244-5172-4118-9b08-af28491ef9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:38.696312 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d2244-5172-4118-9b08-af28491ef9b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:38.697695 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d2244-5172-4118-9b08-af28491ef9b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:04:38.698065 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d2244-5172-4118-9b08-af28491ef9b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:38.699765 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d2244-5172-4118-9b08-af28491ef9b5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:38.705269 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1354/2705] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 17:04:38.706310 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07482f35-3f29-4790-bfde-49703cf62f08 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:38.712161 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1352/2706] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 17:04:38.718003 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07482f35-3f29-4790-bfde-49703cf62f08 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:38.725423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485d9dd-a672-4e41-a0ff-fc6f7142a29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:38.725423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485d9dd-a672-4e41-a0ff-fc6f7142a29c admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:38.725423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485d9dd-a672-4e41-a0ff-fc6f7142a29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:38.725423 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485d9dd-a672-4e41-a0ff-fc6f7142a29c admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:38.725785 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485d9dd-a672-4e41-a0ff-fc6f7142a29c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:38.727163 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485d9dd-a672-4e41-a0ff-fc6f7142a29c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:38.727949 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d2244-5172-4118-9b08-af28491ef9b5 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:38.739014 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d2244-5172-4118-9b08-af28491ef9b5 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:38.743802 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffc891-46f9-43f3-8d85-2e8de915f9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:38.745101 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffc891-46f9-43f3-8d85-2e8de915f9bc admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:38.745365 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffc891-46f9-43f3-8d85-2e8de915f9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:38.745646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daffc891-46f9-43f3-8d85-2e8de915f9bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:38.746353 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffc891-46f9-43f3-8d85-2e8de915f9bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:38.748293 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daffc891-46f9-43f3-8d85-2e8de915f9bc admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:38.817901 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1355/2707] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:04:38 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:04:38.822486 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485d9dd-a672-4e41-a0ff-fc6f7142a29c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:38.847629 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1353/2708] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:04:38 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:04:38.851783 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffc891-46f9-43f3-8d85-2e8de915f9bc admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:38.892310 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485d9dd-a672-4e41-a0ff-fc6f7142a29c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:38.896097 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:38.917457 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daffc891-46f9-43f3-8d85-2e8de915f9bc admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:38.922218 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faf16a-1073-47e4-92ad-b52d39c07f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:38.922926 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faf16a-1073-47e4-92ad-b52d39c07f4c admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:38.923210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faf16a-1073-47e4-92ad-b52d39c07f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:38.923491 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15faf16a-1073-47e4-92ad-b52d39c07f4c admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:38.924180 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15faf16a-1073-47e4-92ad-b52d39c07f4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:38.926623 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15faf16a-1073-47e4-92ad-b52d39c07f4c admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:38.933929 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:38.952249 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35278ce-9a20-42a1-9704-ff6bf53ac879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:38.953136 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35278ce-9a20-42a1-9704-ff6bf53ac879 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:38.953493 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35278ce-9a20-42a1-9704-ff6bf53ac879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:38.957368 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35278ce-9a20-42a1-9704-ff6bf53ac879 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:38.957368 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35278ce-9a20-42a1-9704-ff6bf53ac879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:38.957368 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35278ce-9a20-42a1-9704-ff6bf53ac879 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:39.039491 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1354/2709] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:04:38 2022] POST /identity/v3/users => generated 291 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:04:39.044128 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faf16a-1073-47e4-92ad-b52d39c07f4c admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:39.053758 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15faf16a-1073-47e4-92ad-b52d39c07f4c admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:39.059322 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bca76c-1fe6-40e5-b4f4-4ef2f4c2133c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:39.066515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bca76c-1fe6-40e5-b4f4-4ef2f4c2133c admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:39.066515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bca76c-1fe6-40e5-b4f4-4ef2f4c2133c admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:39.066515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bca76c-1fe6-40e5-b4f4-4ef2f4c2133c admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:39.066515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bca76c-1fe6-40e5-b4f4-4ef2f4c2133c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:39.066515 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bca76c-1fe6-40e5-b4f4-4ef2f4c2133c admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:39.073210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1355/2710] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:04:39.077093 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bca76c-1fe6-40e5-b4f4-4ef2f4c2133c admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:39.087740 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bca76c-1fe6-40e5-b4f4-4ef2f4c2133c admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:39.092087 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1356/2711] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:04:38 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:04:39.093129 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365368d-fdd1-4c93-b208-550b7845fffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:39.093801 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365368d-fdd1-4c93-b208-550b7845fffe admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:39.095101 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365368d-fdd1-4c93-b208-550b7845fffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:39.095101 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365368d-fdd1-4c93-b208-550b7845fffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:39.095101 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365368d-fdd1-4c93-b208-550b7845fffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:39.096784 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365368d-fdd1-4c93-b208-550b7845fffe admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:39.097651 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35278ce-9a20-42a1-9704-ff6bf53ac879 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:39.107701 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35278ce-9a20-42a1-9704-ff6bf53ac879 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:39.108163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1356/2712] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:04:39.112485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365368d-fdd1-4c93-b208-550b7845fffe admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:39.116332 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4cf08-e5a5-425d-87ea-3b7322017c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:39.116538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4cf08-e5a5-425d-87ea-3b7322017c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:39.116720 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4cf08-e5a5-425d-87ea-3b7322017c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:39.117022 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e4cf08-e5a5-425d-87ea-3b7322017c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:39.117771 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4cf08-e5a5-425d-87ea-3b7322017c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:39.120058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e4cf08-e5a5-425d-87ea-3b7322017c16 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:39.123111 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365368d-fdd1-4c93-b208-550b7845fffe admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:39.127841 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe93a61e-25c0-4cbd-b114-f447946666bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:39.128727 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93a61e-25c0-4cbd-b114-f447946666bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:39.129131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93a61e-25c0-4cbd-b114-f447946666bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:39.129358 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe93a61e-25c0-4cbd-b114-f447946666bc admin admin] PATH_INFO: `/v3/projects/ea9b521a11604bf8bff74a9ceca67350/users/63a33e6621114b4d9e0eb7c7fd296923/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:39.130796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1357/2713] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:04:39.140054 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4cf08-e5a5-425d-87ea-3b7322017c16 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:39.147497 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93a61e-25c0-4cbd-b114-f447946666bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea9b521a11604bf8bff74a9ceca67350, user_id=63a33e6621114b4d9e0eb7c7fd296923, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:39.151405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe93a61e-25c0-4cbd-b114-f447946666bc admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:39.151768 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e4cf08-e5a5-425d-87ea-3b7322017c16 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:39.156655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce585ba-9d5e-41a4-9626-9d5018a86f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:39.157381 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce585ba-9d5e-41a4-9626-9d5018a86f5b admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:39.157672 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce585ba-9d5e-41a4-9626-9d5018a86f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:39.157954 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce585ba-9d5e-41a4-9626-9d5018a86f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:39.158729 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce585ba-9d5e-41a4-9626-9d5018a86f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:39.160324 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce585ba-9d5e-41a4-9626-9d5018a86f5b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:39.171775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1358/2714] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:04:39.176080 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce585ba-9d5e-41a4-9626-9d5018a86f5b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:39.186229 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce585ba-9d5e-41a4-9626-9d5018a86f5b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:39.190979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4fb8f-2f96-45e9-9a95-b5b025bea64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:39.191854 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4fb8f-2f96-45e9-9a95-b5b025bea64f admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:39.192147 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4fb8f-2f96-45e9-9a95-b5b025bea64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:39.192426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4fb8f-2f96-45e9-9a95-b5b025bea64f admin admin] PATH_INFO: `/v3/projects/cb172f22f7584448b5afbdaf7c3f1999/users/32a92964d9694345ba2c77639d9a9472/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:39.207391 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4fb8f-2f96-45e9-9a95-b5b025bea64f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb172f22f7584448b5afbdaf7c3f1999, user_id=32a92964d9694345ba2c77639d9a9472, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:39.210087 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4fb8f-2f96-45e9-9a95-b5b025bea64f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:39.217344 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1357/2715] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:04:39 2022] PUT /identity/v3/projects/ea9b521a11604bf8bff74a9ceca67350/users/63a33e6621114b4d9e0eb7c7fd296923/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:04:39.227266 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3b447-a20d-4fcc-b3b3-d19a5767ea3a None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:39.227558 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3b447-a20d-4fcc-b3b3-d19a5767ea3a None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:39.227837 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea3b447-a20d-4fcc-b3b3-d19a5767ea3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:39.254344 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-6ea3b447-a20d-4fcc-b3b3-d19a5767ea3a None None] MFA Rules not processed for user `63a33e6621114b4d9e0eb7c7fd296923`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:39.255594 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6ea3b447-a20d-4fcc-b3b3-d19a5767ea3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:39.280425 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1359/2716] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:04:39 2022] PUT /identity/v3/projects/cb172f22f7584448b5afbdaf7c3f1999/users/32a92964d9694345ba2c77639d9a9472/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:04:39.290970 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d793f7d-ff05-48d5-bcc4-e2b2a75dc27b None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:39.291265 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d793f7d-ff05-48d5-bcc4-e2b2a75dc27b None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:39.291550 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d793f7d-ff05-48d5-bcc4-e2b2a75dc27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:39.319841 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-2d793f7d-ff05-48d5-bcc4-e2b2a75dc27b None None] MFA Rules not processed for user `32a92964d9694345ba2c77639d9a9472`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:39.321138 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2d793f7d-ff05-48d5-bcc4-e2b2a75dc27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:39.326240 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1358/2717] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:04:39.331279 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3b447-a20d-4fcc-b3b3-d19a5767ea3a None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:39.390400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1360/2718] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:04:39.397393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea3b447-a20d-4fcc-b3b3-d19a5767ea3a None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:39.405723 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d793f7d-ff05-48d5-bcc4-e2b2a75dc27b None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:39.405723 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2d793f7d-ff05-48d5-bcc4-e2b2a75dc27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:39.438514 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:39.450241 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:39.458853 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b2dc8-0616-4834-ae6e-eb2d0c92768e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:39.459530 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b2dc8-0616-4834-ae6e-eb2d0c92768e admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:39.459811 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b2dc8-0616-4834-ae6e-eb2d0c92768e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:39.460116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b2dc8-0616-4834-ae6e-eb2d0c92768e admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:39.460873 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b2dc8-0616-4834-ae6e-eb2d0c92768e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:39.463562 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b2dc8-0616-4834-ae6e-eb2d0c92768e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:39.465104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d793f7d-ff05-48d5-bcc4-e2b2a75dc27b None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:39.468805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f261f-8cff-4136-9661-873ea070d6a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:39.469509 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f261f-8cff-4136-9661-873ea070d6a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:39.469805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f261f-8cff-4136-9661-873ea070d6a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:39.470086 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f261f-8cff-4136-9661-873ea070d6a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:39.479296 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f261f-8cff-4136-9661-873ea070d6a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:39.485989 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f261f-8cff-4136-9661-873ea070d6a4 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:39.490199 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1361/2719] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:04:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:04:39.510784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f261f-8cff-4136-9661-873ea070d6a4 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:39.521882 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f261f-8cff-4136-9661-873ea070d6a4 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:39.527993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369be84-7b4d-46a6-b42b-2dc4f6c3dc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:39.529081 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369be84-7b4d-46a6-b42b-2dc4f6c3dc82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:39.529368 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369be84-7b4d-46a6-b42b-2dc4f6c3dc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:39.529642 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369be84-7b4d-46a6-b42b-2dc4f6c3dc82 admin admin] PATH_INFO: `/v3/users/32a92964d9694345ba2c77639d9a9472` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:39.530866 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369be84-7b4d-46a6-b42b-2dc4f6c3dc82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32a92964d9694345ba2c77639d9a9472)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:39.532775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369be84-7b4d-46a6-b42b-2dc4f6c3dc82 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:39.569092 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1359/2720] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:04:39 2022] POST /identity/v3/projects => generated 381 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:04:39.570843 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b2dc8-0616-4834-ae6e-eb2d0c92768e admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:39.650385 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b2dc8-0616-4834-ae6e-eb2d0c92768e admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:39.658215 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce68b0-56b7-42d0-b4c4-0c2196f83be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:39.659315 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce68b0-56b7-42d0-b4c4-0c2196f83be0 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:39.659828 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce68b0-56b7-42d0-b4c4-0c2196f83be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:39.660337 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce68b0-56b7-42d0-b4c4-0c2196f83be0 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:39.661635 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce68b0-56b7-42d0-b4c4-0c2196f83be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:39.665694 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce68b0-56b7-42d0-b4c4-0c2196f83be0 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:39.768618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0369be84-7b4d-46a6-b42b-2dc4f6c3dc82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32a92964d9694345ba2c77639d9a9472'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:39.815598 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1360/2721] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:04:39 2022] POST /identity/v3/users => generated 297 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:04:39.817285 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce68b0-56b7-42d0-b4c4-0c2196f83be0 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:39.828652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce68b0-56b7-42d0-b4c4-0c2196f83be0 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:39.833491 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa7e4c-6716-449d-bb3e-ec70720a5210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:39.834202 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa7e4c-6716-449d-bb3e-ec70720a5210 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:39.834489 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa7e4c-6716-449d-bb3e-ec70720a5210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:39.834770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa7e4c-6716-449d-bb3e-ec70720a5210 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:39.835502 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa7e4c-6716-449d-bb3e-ec70720a5210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:39.837128 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa7e4c-6716-449d-bb3e-ec70720a5210 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:39.847885 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1361/2722] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:04:39.863504 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa7e4c-6716-449d-bb3e-ec70720a5210 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:39.873974 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa7e4c-6716-449d-bb3e-ec70720a5210 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:39.878824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99481347-5cfa-4079-bce5-1f23913038c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:39.879699 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99481347-5cfa-4079-bce5-1f23913038c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:39.879995 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99481347-5cfa-4079-bce5-1f23913038c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:39.880274 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99481347-5cfa-4079-bce5-1f23913038c6 admin admin] PATH_INFO: `/v3/projects/a8dcc8849f764974bd2c5b736ba55af6/users/a5b97fac26fd4004bae368ae651282d2/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:39.896265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99481347-5cfa-4079-bce5-1f23913038c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8dcc8849f764974bd2c5b736ba55af6, user_id=a5b97fac26fd4004bae368ae651282d2, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:39.898989 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99481347-5cfa-4079-bce5-1f23913038c6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:39.952061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0369be84-7b4d-46a6-b42b-2dc4f6c3dc82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32a92964d9694345ba2c77639d9a9472'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:39.952061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0369be84-7b4d-46a6-b42b-2dc4f6c3dc82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32a92964d9694345ba2c77639d9a9472'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:39.952061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0369be84-7b4d-46a6-b42b-2dc4f6c3dc82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32a92964d9694345ba2c77639d9a9472'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:39.953321 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0369be84-7b4d-46a6-b42b-2dc4f6c3dc82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32a92964d9694345ba2c77639d9a9472'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:39.959431 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1362/2723] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:04:39 2022] DELETE /identity/v3/users/32a92964d9694345ba2c77639d9a9472 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:04:39.963888 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d3bad-7f4e-4477-b41b-9daa04cdbc14 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:39.964178 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d3bad-7f4e-4477-b41b-9daa04cdbc14 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:39.964463 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d3bad-7f4e-4477-b41b-9daa04cdbc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:39.981983 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3f6d3bad-7f4e-4477-b41b-9daa04cdbc14 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:39.983183 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3f6d3bad-7f4e-4477-b41b-9daa04cdbc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:40.042650 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1363/2724] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:04:40.052550 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d3bad-7f4e-4477-b41b-9daa04cdbc14 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:40.053926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3f6d3bad-7f4e-4477-b41b-9daa04cdbc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:40.099832 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1362/2725] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:04:39 2022] PUT /identity/v3/projects/a8dcc8849f764974bd2c5b736ba55af6/users/a5b97fac26fd4004bae368ae651282d2/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:04:40.104532 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99481347-5cfa-4079-bce5-1f23913038c6 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:40.106492 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-99481347-5cfa-4079-bce5-1f23913038c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:40.114119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d3bad-7f4e-4477-b41b-9daa04cdbc14 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:40.166437 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b8937-640f-4fcd-916d-49c9a8804527 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:40.167190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b8937-640f-4fcd-916d-49c9a8804527 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:40.167480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b8937-640f-4fcd-916d-49c9a8804527 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:40.167762 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b8937-640f-4fcd-916d-49c9a8804527 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:40.184652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99481347-5cfa-4079-bce5-1f23913038c6 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:40.189400 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337ec63-85a2-4685-ac20-3e8b689efc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:40.190089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337ec63-85a2-4685-ac20-3e8b689efc3a admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:40.190373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337ec63-85a2-4685-ac20-3e8b689efc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:40.190649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d337ec63-85a2-4685-ac20-3e8b689efc3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:40.191383 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337ec63-85a2-4685-ac20-3e8b689efc3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:40.192986 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d337ec63-85a2-4685-ac20-3e8b689efc3a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:40.206125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1363/2726] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:04:40 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:04:40.208069 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:40.208664 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337ec63-85a2-4685-ac20-3e8b689efc3a admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:40.218988 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d337ec63-85a2-4685-ac20-3e8b689efc3a admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:40.223736 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24a89e-b220-47cd-a60e-ebd075add83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:40.225160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24a89e-b220-47cd-a60e-ebd075add83f admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:40.225160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24a89e-b220-47cd-a60e-ebd075add83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:40.225377 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24a89e-b220-47cd-a60e-ebd075add83f admin admin] PATH_INFO: `/v3/projects/a8dcc8849f764974bd2c5b736ba55af6/users/a5b97fac26fd4004bae368ae651282d2/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:40.227269 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24a89e-b220-47cd-a60e-ebd075add83f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8dcc8849f764974bd2c5b736ba55af6, user_id=a5b97fac26fd4004bae368ae651282d2, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:40.230578 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24a89e-b220-47cd-a60e-ebd075add83f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:40.236858 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b8937-640f-4fcd-916d-49c9a8804527 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:40.238385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558b8937-640f-4fcd-916d-49c9a8804527 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:40.249616 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1364/2727] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:04:40 2022] PUT /identity/v3/projects/a8dcc8849f764974bd2c5b736ba55af6/users/a5b97fac26fd4004bae368ae651282d2/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:04:40.250706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1364/2728] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:04:40.261716 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d6a33-83af-4146-9456-920aac6c5c23 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:40.262002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d6a33-83af-4146-9456-920aac6c5c23 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:40.262280 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8d6a33-83af-4146-9456-920aac6c5c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:40.268304 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:40.291634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-1a8d6a33-83af-4146-9456-920aac6c5c23 None None] MFA Rules not processed for user `a5b97fac26fd4004bae368ae651282d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:40.293462 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1a8d6a33-83af-4146-9456-920aac6c5c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:40.367942 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1365/2729] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:40.380311 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b8937-640f-4fcd-916d-49c9a8804527 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:40.381730 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-558b8937-640f-4fcd-916d-49c9a8804527 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:40.439655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b8937-640f-4fcd-916d-49c9a8804527 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:40.492745 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc93630-daa4-4ed0-a950-459481488161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:40.493435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc93630-daa4-4ed0-a950-459481488161 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:40.493722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc93630-daa4-4ed0-a950-459481488161 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:40.494061 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc93630-daa4-4ed0-a950-459481488161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:40.503959 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc93630-daa4-4ed0-a950-459481488161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:40.505491 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc93630-daa4-4ed0-a950-459481488161 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:40.515948 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1365/2730] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:04:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:04:40.691992 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d6a33-83af-4146-9456-920aac6c5c23 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:40.693578 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1a8d6a33-83af-4146-9456-920aac6c5c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:40.754513 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc93630-daa4-4ed0-a950-459481488161 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:40.769364 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc93630-daa4-4ed0-a950-459481488161 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:40.775739 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff972ff-230d-4203-8e53-b4c857edcc4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:40.776829 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff972ff-230d-4203-8e53-b4c857edcc4c service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:40.777337 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff972ff-230d-4203-8e53-b4c857edcc4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:40.777731 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff972ff-230d-4203-8e53-b4c857edcc4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:40.779937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8d6a33-83af-4146-9456-920aac6c5c23 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:40.781883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1ff972ff-230d-4203-8e53-b4c857edcc4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:40.786341 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c671e21-20ff-4a3b-9a43-9b5467a823d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:40.786603 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c671e21-20ff-4a3b-9a43-9b5467a823d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:40.786971 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c671e21-20ff-4a3b-9a43-9b5467a823d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:40.787432 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c671e21-20ff-4a3b-9a43-9b5467a823d7 admin admin] PATH_INFO: `/v3/projects/cb172f22f7584448b5afbdaf7c3f1999` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:40.788707 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c671e21-20ff-4a3b-9a43-9b5467a823d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb172f22f7584448b5afbdaf7c3f1999)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:40.791289 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c671e21-20ff-4a3b-9a43-9b5467a823d7 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:40.820262 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:40.870718 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff972ff-230d-4203-8e53-b4c857edcc4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:40.872411 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff972ff-230d-4203-8e53-b4c857edcc4c service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:40.881803 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1366/2731] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:04:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:04:40.911108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8c671e21-20ff-4a3b-9a43-9b5467a823d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb172f22f7584448b5afbdaf7c3f1999', 'request_id': 'req-8c671e21-20ff-4a3b-9a43-9b5467a823d7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:40.917923 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8c671e21-20ff-4a3b-9a43-9b5467a823d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb172f22f7584448b5afbdaf7c3f1999', 'request_id': 'req-8c671e21-20ff-4a3b-9a43-9b5467a823d7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:40.924325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8c671e21-20ff-4a3b-9a43-9b5467a823d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb172f22f7584448b5afbdaf7c3f1999', 'request_id': 'req-8c671e21-20ff-4a3b-9a43-9b5467a823d7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:40.993142 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8c671e21-20ff-4a3b-9a43-9b5467a823d7 admin admin] The token cache is being invalidate because project cb172f22f7584448b5afbdaf7c3f1999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:04:40.993451 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8c671e21-20ff-4a3b-9a43-9b5467a823d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:40.995113 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-8c671e21-20ff-4a3b-9a43-9b5467a823d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:40.996509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1366/2732] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:04:40 2022] DELETE /identity/v3/projects/cb172f22f7584448b5afbdaf7c3f1999 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:41.001702 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbabd8c-05de-413c-9dcb-ad34fc757eef None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:41.001982 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbabd8c-05de-413c-9dcb-ad34fc757eef None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:41.002262 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbabd8c-05de-413c-9dcb-ad34fc757eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:41.021493 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3dbabd8c-05de-413c-9dcb-ad34fc757eef None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:41.026795 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3dbabd8c-05de-413c-9dcb-ad34fc757eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:41.082207 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1367/2733] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:41.090972 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9280253-ab94-46a7-b7b4-a9f218c7eb9b None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:41.091288 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9280253-ab94-46a7-b7b4-a9f218c7eb9b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:41.091574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9280253-ab94-46a7-b7b4-a9f218c7eb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:41.110330 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e9280253-ab94-46a7-b7b4-a9f218c7eb9b None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:41.111656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e9280253-ab94-46a7-b7b4-a9f218c7eb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:41.121183 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1367/2734] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:41.126823 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbabd8c-05de-413c-9dcb-ad34fc757eef None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:41.137321 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbabd8c-05de-413c-9dcb-ad34fc757eef None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:41.142083 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b28961-e785-4de8-b07a-3d3352541492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:41.142755 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b28961-e785-4de8-b07a-3d3352541492 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:41.143043 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b28961-e785-4de8-b07a-3d3352541492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:41.143356 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b28961-e785-4de8-b07a-3d3352541492 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:41.144132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b28961-e785-4de8-b07a-3d3352541492 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:04:41.144726 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b28961-e785-4de8-b07a-3d3352541492 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:41.146142 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b28961-e785-4de8-b07a-3d3352541492 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:41.159251 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1368/2735] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:04:41.164353 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9280253-ab94-46a7-b7b4-a9f218c7eb9b None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:41.173845 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9280253-ab94-46a7-b7b4-a9f218c7eb9b None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:41.178537 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c2322-e5aa-44fc-bc2d-d8d3c7e9954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:41.179208 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c2322-e5aa-44fc-bc2d-d8d3c7e9954b admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:41.179490 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c2322-e5aa-44fc-bc2d-d8d3c7e9954b admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:41.179832 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c2322-e5aa-44fc-bc2d-d8d3c7e9954b admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:41.180477 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c2322-e5aa-44fc-bc2d-d8d3c7e9954b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:41.182956 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c2322-e5aa-44fc-bc2d-d8d3c7e9954b admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:41.191967 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:41.303830 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1368/2736] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:04:41 2022] POST /identity/v3/projects => generated 367 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:04:41.308564 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b28961-e785-4de8-b07a-3d3352541492 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:41.333365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b28961-e785-4de8-b07a-3d3352541492 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:41.394792 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4baa63-2a2b-4da8-b4ac-947e42f27a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:41.395461 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4baa63-2a2b-4da8-b4ac-947e42f27a50 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:41.395746 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4baa63-2a2b-4da8-b4ac-947e42f27a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:41.396010 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4baa63-2a2b-4da8-b4ac-947e42f27a50 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:41.396706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4baa63-2a2b-4da8-b4ac-947e42f27a50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:41.398643 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4baa63-2a2b-4da8-b4ac-947e42f27a50 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:41.531954 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1369/2737] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:04:41 2022] POST /identity/v3/users => generated 284 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:04:41.535405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c2322-e5aa-44fc-bc2d-d8d3c7e9954b admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:41.546454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c2322-e5aa-44fc-bc2d-d8d3c7e9954b admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:41.551503 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27f4e8-c344-4768-bf25-9b741e886139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:41.552184 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27f4e8-c344-4768-bf25-9b741e886139 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:41.552471 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27f4e8-c344-4768-bf25-9b741e886139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:41.552747 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb27f4e8-c344-4768-bf25-9b741e886139 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:41.553554 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27f4e8-c344-4768-bf25-9b741e886139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:41.555163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb27f4e8-c344-4768-bf25-9b741e886139 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:41.566936 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1369/2738] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:04:41.573979 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4baa63-2a2b-4da8-b4ac-947e42f27a50 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:41.584209 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4baa63-2a2b-4da8-b4ac-947e42f27a50 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:41.589178 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623acaf9-4f1b-4365-bb0c-cc37eeaff6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:41.589839 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623acaf9-4f1b-4365-bb0c-cc37eeaff6c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:41.590126 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623acaf9-4f1b-4365-bb0c-cc37eeaff6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:41.590405 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623acaf9-4f1b-4365-bb0c-cc37eeaff6c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:41.591135 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623acaf9-4f1b-4365-bb0c-cc37eeaff6c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:41.592772 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623acaf9-4f1b-4365-bb0c-cc37eeaff6c9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:41.602932 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1370/2739] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:04:41.607817 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27f4e8-c344-4768-bf25-9b741e886139 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:41.618134 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb27f4e8-c344-4768-bf25-9b741e886139 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:41.623919 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab613d9-91b3-468a-ad5c-d7d986179700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:41.624814 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab613d9-91b3-468a-ad5c-d7d986179700 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:41.625120 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab613d9-91b3-468a-ad5c-d7d986179700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:41.625398 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab613d9-91b3-468a-ad5c-d7d986179700 admin admin] PATH_INFO: `/v3/projects/d139aa7382fd41d19f1f2a74c24c2326/users/94ce2e2151d5438c952d64357109afcb/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:41.640469 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab613d9-91b3-468a-ad5c-d7d986179700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d139aa7382fd41d19f1f2a74c24c2326, user_id=94ce2e2151d5438c952d64357109afcb, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:41.643182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab613d9-91b3-468a-ad5c-d7d986179700 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:41.724961 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1370/2740] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:04:41 2022] PUT /identity/v3/projects/d139aa7382fd41d19f1f2a74c24c2326/users/94ce2e2151d5438c952d64357109afcb/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:04:41.737558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53b5c4-0166-4e3f-b458-c0834e0fef0e None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:41.737860 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53b5c4-0166-4e3f-b458-c0834e0fef0e None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:41.738171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53b5c4-0166-4e3f-b458-c0834e0fef0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:41.768797 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-5b53b5c4-0166-4e3f-b458-c0834e0fef0e None None] MFA Rules not processed for user `94ce2e2151d5438c952d64357109afcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:41.770091 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5b53b5c4-0166-4e3f-b458-c0834e0fef0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:41.783259 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:41.842508 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1371/2741] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:41.855875 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab613d9-91b3-468a-ad5c-d7d986179700 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:41.857910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-3ab613d9-91b3-468a-ad5c-d7d986179700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:41.969277 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab613d9-91b3-468a-ad5c-d7d986179700 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:41.973458 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35c8440-c97d-4a5b-a4ef-43bcec030c0c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e1900754214020931b202e98f660a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:41.974130 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c8440-c97d-4a5b-a4ef-43bcec030c0c service glance] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:41.974417 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c8440-c97d-4a5b-a4ef-43bcec030c0c service glance] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:41.974691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35c8440-c97d-4a5b-a4ef-43bcec030c0c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:41.986138 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c8440-c97d-4a5b-a4ef-43bcec030c0c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:41.987743 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35c8440-c97d-4a5b-a4ef-43bcec030c0c service glance] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:41.998403 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1371/2742] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:04:41 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:04:43.440451 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53b5c4-0166-4e3f-b458-c0834e0fef0e None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:43.442100 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5b53b5c4-0166-4e3f-b458-c0834e0fef0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:43.523092 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53b5c4-0166-4e3f-b458-c0834e0fef0e None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:43.529500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1367b4d-9dd4-449c-b981-11a328d2c49a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '381cf4381ce64379b285d75e2909813d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:43.532018 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1367b4d-9dd4-449c-b981-11a328d2c49a service nova] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:43.532018 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1367b4d-9dd4-449c-b981-11a328d2c49a service nova] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:43.532018 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1367b4d-9dd4-449c-b981-11a328d2c49a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:43.533119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b1367b4d-9dd4-449c-b981-11a328d2c49a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:43.546743 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1367b4d-9dd4-449c-b981-11a328d2c49a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:43.548379 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1367b4d-9dd4-449c-b981-11a328d2c49a service nova] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:43.569479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1372/2743] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:04:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:04:51.994031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=54,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:53.554860 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=55 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:56.929689 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42769ffb-7bde-4e7a-b614-cb3cea507eb9 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:56.930162 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42769ffb-7bde-4e7a-b614-cb3cea507eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:56.930257 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42769ffb-7bde-4e7a-b614-cb3cea507eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:56.949440 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-42769ffb-7bde-4e7a-b614-cb3cea507eb9 None None] MFA Rules not processed for user `ff65e481807b4344897b1499cd450f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:56.950673 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-42769ffb-7bde-4e7a-b614-cb3cea507eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:57.013223 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1372/2744] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 17:04:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:57.065322 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1367b4d-9dd4-449c-b981-11a328d2c49a service nova] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:57.066792 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b1367b4d-9dd4-449c-b981-11a328d2c49a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:57.138035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1367b4d-9dd4-449c-b981-11a328d2c49a service nova] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:57.142620 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb358c-fc17-463d-bd4b-f11a882c7d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:57.143499 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb358c-fc17-463d-bd4b-f11a882c7d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:57.143789 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb358c-fc17-463d-bd4b-f11a882c7d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:57.144069 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fb358c-fc17-463d-bd4b-f11a882c7d84 admin admin] PATH_INFO: `/v3/users/63a33e6621114b4d9e0eb7c7fd296923` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:57.145395 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb358c-fc17-463d-bd4b-f11a882c7d84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63a33e6621114b4d9e0eb7c7fd296923)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:57.147583 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fb358c-fc17-463d-bd4b-f11a882c7d84 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:57.163040 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42769ffb-7bde-4e7a-b614-cb3cea507eb9 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:57.164475 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-42769ffb-7bde-4e7a-b614-cb3cea507eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:57.244442 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42769ffb-7bde-4e7a-b614-cb3cea507eb9 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:57.249561 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524546e7-364d-4c68-8ba2-749de46220ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bc0fa34b414328a342d685bc1eaca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:57.250236 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524546e7-364d-4c68-8ba2-749de46220ee service swift] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:57.250517 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524546e7-364d-4c68-8ba2-749de46220ee service swift] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:57.250799 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524546e7-364d-4c68-8ba2-749de46220ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:57.259682 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524546e7-364d-4c68-8ba2-749de46220ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:57.261291 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524546e7-364d-4c68-8ba2-749de46220ee service swift] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:57.269445 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1373/2745] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 17:04:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 17:04:57.310112 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-87fb358c-fc17-463d-bd4b-f11a882c7d84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63a33e6621114b4d9e0eb7c7fd296923'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:57.398367 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-87fb358c-fc17-463d-bd4b-f11a882c7d84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63a33e6621114b4d9e0eb7c7fd296923'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:57.406393 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-87fb358c-fc17-463d-bd4b-f11a882c7d84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63a33e6621114b4d9e0eb7c7fd296923'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:57.407046 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-87fb358c-fc17-463d-bd4b-f11a882c7d84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63a33e6621114b4d9e0eb7c7fd296923'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:57.420467 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-87fb358c-fc17-463d-bd4b-f11a882c7d84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63a33e6621114b4d9e0eb7c7fd296923'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:57.430161 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1373/2746] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:04:57 2022] DELETE /identity/v3/users/63a33e6621114b4d9e0eb7c7fd296923 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:57.435895 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb01c59-2b23-418e-821d-a6d199ec84ff None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:57.436193 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb01c59-2b23-418e-821d-a6d199ec84ff None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:57.436474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb01c59-2b23-418e-821d-a6d199ec84ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:57.455754 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-5eb01c59-2b23-418e-821d-a6d199ec84ff None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:57.456993 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5eb01c59-2b23-418e-821d-a6d199ec84ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:57.517990 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1374/2747] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:04:57.527822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb358c-fc17-463d-bd4b-f11a882c7d84 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:57.529306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-87fb358c-fc17-463d-bd4b-f11a882c7d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:57.594220 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fb358c-fc17-463d-bd4b-f11a882c7d84 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:57.597900 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f3aa6-2b61-4550-8bc5-aa40c4df0f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:57.598549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f3aa6-2b61-4550-8bc5-aa40c4df0f42 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:57.598860 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f3aa6-2b61-4550-8bc5-aa40c4df0f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:57.599133 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f3aa6-2b61-4550-8bc5-aa40c4df0f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:57.609880 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f3aa6-2b61-4550-8bc5-aa40c4df0f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:57.611312 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f3aa6-2b61-4550-8bc5-aa40c4df0f42 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:57.622203 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1374/2748] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:04:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:04:58.085774 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb01c59-2b23-418e-821d-a6d199ec84ff None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:58.088145 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5eb01c59-2b23-418e-821d-a6d199ec84ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:58.106984 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb01c59-2b23-418e-821d-a6d199ec84ff None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:58.116288 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4873ec-d955-49dd-8bb1-b5af7a7223a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:58.116288 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4873ec-d955-49dd-8bb1-b5af7a7223a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:58.116288 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4873ec-d955-49dd-8bb1-b5af7a7223a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:58.116288 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4873ec-d955-49dd-8bb1-b5af7a7223a2 admin admin] PATH_INFO: `/v3/projects/ea9b521a11604bf8bff74a9ceca67350` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:58.117185 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4873ec-d955-49dd-8bb1-b5af7a7223a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea9b521a11604bf8bff74a9ceca67350)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:58.117545 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4873ec-d955-49dd-8bb1-b5af7a7223a2 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:58.174928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16ba6b-a2b7-482a-86e5-4a3d34137e37 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:58.175312 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16ba6b-a2b7-482a-86e5-4a3d34137e37 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:58.175421 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16ba6b-a2b7-482a-86e5-4a3d34137e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:58.193237 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4d16ba6b-a2b7-482a-86e5-4a3d34137e37 None None] MFA Rules not processed for user `ff65e481807b4344897b1499cd450f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:58.194471 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4d16ba6b-a2b7-482a-86e5-4a3d34137e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:58.213164 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:58.227422 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:58.241504 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5a4873ec-d955-49dd-8bb1-b5af7a7223a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea9b521a11604bf8bff74a9ceca67350', 'request_id': 'req-5a4873ec-d955-49dd-8bb1-b5af7a7223a2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:58.247820 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5a4873ec-d955-49dd-8bb1-b5af7a7223a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea9b521a11604bf8bff74a9ceca67350', 'request_id': 'req-5a4873ec-d955-49dd-8bb1-b5af7a7223a2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:58.255080 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5a4873ec-d955-49dd-8bb1-b5af7a7223a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea9b521a11604bf8bff74a9ceca67350', 'request_id': 'req-5a4873ec-d955-49dd-8bb1-b5af7a7223a2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:58.257103 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1375/2749] 10.222.0.76 () {58 vars in 967 bytes} [Mon Jul 18 17:04:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:58.270638 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16ba6b-a2b7-482a-86e5-4a3d34137e37 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:58.273181 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4d16ba6b-a2b7-482a-86e5-4a3d34137e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:58.342240 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5a4873ec-d955-49dd-8bb1-b5af7a7223a2 admin admin] The token cache is being invalidate because project ea9b521a11604bf8bff74a9ceca67350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:04:58.342450 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5a4873ec-d955-49dd-8bb1-b5af7a7223a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:58.343092 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5a4873ec-d955-49dd-8bb1-b5af7a7223a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:58.344798 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1375/2750] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:04:58 2022] DELETE /identity/v3/projects/ea9b521a11604bf8bff74a9ceca67350 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:58.348793 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4873ec-d955-49dd-8bb1-b5af7a7223a2 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:58.350209 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5a4873ec-d955-49dd-8bb1-b5af7a7223a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:58.353003 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16ba6b-a2b7-482a-86e5-4a3d34137e37 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:58.418990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605a98ce-84f1-4759-b05a-71ec4561f0f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bc0fa34b414328a342d685bc1eaca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:58.419688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a98ce-84f1-4759-b05a-71ec4561f0f8 service swift] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:58.419981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a98ce-84f1-4759-b05a-71ec4561f0f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:58.420492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605a98ce-84f1-4759-b05a-71ec4561f0f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:58.422466 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-605a98ce-84f1-4759-b05a-71ec4561f0f8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:58.424690 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4873ec-d955-49dd-8bb1-b5af7a7223a2 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:58.431860 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76495fa-f2e8-4c49-a778-5078ddc61db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:58.432866 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76495fa-f2e8-4c49-a778-5078ddc61db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:58.433290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76495fa-f2e8-4c49-a778-5078ddc61db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:58.433723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76495fa-f2e8-4c49-a778-5078ddc61db7 admin admin] PATH_INFO: `/v3/users/a5b97fac26fd4004bae368ae651282d2` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:58.435540 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76495fa-f2e8-4c49-a778-5078ddc61db7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5b97fac26fd4004bae368ae651282d2)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:58.438169 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76495fa-f2e8-4c49-a778-5078ddc61db7 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:58.484206 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a98ce-84f1-4759-b05a-71ec4561f0f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:58.486004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605a98ce-84f1-4759-b05a-71ec4561f0f8 service swift] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:58.495142 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1376/2751] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 17:04:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 17:04:58.637583 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d76495fa-f2e8-4c49-a778-5078ddc61db7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5b97fac26fd4004bae368ae651282d2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:58.718568 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d76495fa-f2e8-4c49-a778-5078ddc61db7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5b97fac26fd4004bae368ae651282d2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:58.726187 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d76495fa-f2e8-4c49-a778-5078ddc61db7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5b97fac26fd4004bae368ae651282d2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:58.726905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d76495fa-f2e8-4c49-a778-5078ddc61db7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5b97fac26fd4004bae368ae651282d2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:58.739404 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d76495fa-f2e8-4c49-a778-5078ddc61db7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5b97fac26fd4004bae368ae651282d2'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:58.746506 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1376/2752] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:04:58 2022] DELETE /identity/v3/users/a5b97fac26fd4004bae368ae651282d2 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:04:59.159480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e9f8a-4e15-49c6-b526-eec448ad0888 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:59.159776 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e9f8a-4e15-49c6-b526-eec448ad0888 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:59.160065 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e9f8a-4e15-49c6-b526-eec448ad0888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:59.179160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ec3e9f8a-4e15-49c6-b526-eec448ad0888 None None] MFA Rules not processed for user `ff65e481807b4344897b1499cd450f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:59.187454 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ec3e9f8a-4e15-49c6-b526-eec448ad0888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:59.187454 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:59.241402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1377/2753] 10.222.0.76 () {58 vars in 1009 bytes} [Mon Jul 18 17:04:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:04:59.254834 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76495fa-f2e8-4c49-a778-5078ddc61db7 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:59.258553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d76495fa-f2e8-4c49-a778-5078ddc61db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:59.304612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:04:59.333096 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76495fa-f2e8-4c49-a778-5078ddc61db7 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:59.339694 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f33a840-f452-468f-8494-5b8f3feca684 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bc0fa34b414328a342d685bc1eaca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:59.340615 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33a840-f452-468f-8494-5b8f3feca684 service swift] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:59.341115 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33a840-f452-468f-8494-5b8f3feca684 service swift] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:59.341467 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33a840-f452-468f-8494-5b8f3feca684 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:59.350831 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33a840-f452-468f-8494-5b8f3feca684 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:59.353170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f33a840-f452-468f-8494-5b8f3feca684 service swift] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:59.362274 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1377/2754] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 17:04:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 18 17:04:59.537289 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e9f8a-4e15-49c6-b526-eec448ad0888 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:04:59.538956 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ec3e9f8a-4e15-49c6-b526-eec448ad0888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:04:59.610574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e9f8a-4e15-49c6-b526-eec448ad0888 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:04:59.615315 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973e714-6d0e-4658-9fe9-776106766c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:04:59.616184 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973e714-6d0e-4658-9fe9-776106766c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:59.616470 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973e714-6d0e-4658-9fe9-776106766c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:59.616744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973e714-6d0e-4658-9fe9-776106766c5b admin admin] PATH_INFO: `/v3/projects/a8dcc8849f764974bd2c5b736ba55af6` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:59.618607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973e714-6d0e-4658-9fe9-776106766c5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8dcc8849f764974bd2c5b736ba55af6)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:04:59.620604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973e714-6d0e-4658-9fe9-776106766c5b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:04:59.766229 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5973e714-6d0e-4658-9fe9-776106766c5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8dcc8849f764974bd2c5b736ba55af6', 'request_id': 'req-5973e714-6d0e-4658-9fe9-776106766c5b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:59.775885 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5973e714-6d0e-4658-9fe9-776106766c5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8dcc8849f764974bd2c5b736ba55af6', 'request_id': 'req-5973e714-6d0e-4658-9fe9-776106766c5b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:59.781771 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5973e714-6d0e-4658-9fe9-776106766c5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8dcc8849f764974bd2c5b736ba55af6', 'request_id': 'req-5973e714-6d0e-4658-9fe9-776106766c5b'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:59.924122 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5973e714-6d0e-4658-9fe9-776106766c5b admin admin] The token cache is being invalidate because project a8dcc8849f764974bd2c5b736ba55af6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:04:59.924332 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5973e714-6d0e-4658-9fe9-776106766c5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:59.924910 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-5973e714-6d0e-4658-9fe9-776106766c5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:04:59.926771 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1378/2755] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:04:59 2022] DELETE /identity/v3/projects/a8dcc8849f764974bd2c5b736ba55af6 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:04:59.932550 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809eb76-de97-4429-982b-c409610d5cc2 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:04:59.932917 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809eb76-de97-4429-982b-c409610d5cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:04:59.933292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809eb76-de97-4429-982b-c409610d5cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:04:59.951757 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c809eb76-de97-4429-982b-c409610d5cc2 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:04:59.952973 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c809eb76-de97-4429-982b-c409610d5cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:00.022952 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1378/2756] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:04:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:00.031743 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37ed2b-081b-4904-971f-e13fb22f1c84 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:00.032080 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37ed2b-081b-4904-971f-e13fb22f1c84 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:00.032337 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37ed2b-081b-4904-971f-e13fb22f1c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:00.051529 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-ea37ed2b-081b-4904-971f-e13fb22f1c84 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:00.052818 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ea37ed2b-081b-4904-971f-e13fb22f1c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:00.061467 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1379/2757] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:00.065776 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809eb76-de97-4429-982b-c409610d5cc2 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:00.075881 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809eb76-de97-4429-982b-c409610d5cc2 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:00.080753 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad0f6c-5664-4cbd-bfa6-562d2befcb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:00.081469 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad0f6c-5664-4cbd-bfa6-562d2befcb18 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:00.081756 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad0f6c-5664-4cbd-bfa6-562d2befcb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:00.082037 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad0f6c-5664-4cbd-bfa6-562d2befcb18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:00.082885 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad0f6c-5664-4cbd-bfa6-562d2befcb18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:05:00.083072 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad0f6c-5664-4cbd-bfa6-562d2befcb18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:00.084719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad0f6c-5664-4cbd-bfa6-562d2befcb18 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:00.097980 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1379/2758] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:05:00.102999 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37ed2b-081b-4904-971f-e13fb22f1c84 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:00.112710 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37ed2b-081b-4904-971f-e13fb22f1c84 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:00.120487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415f26c-5352-46e2-b5e5-3777db2c9bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:00.121203 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415f26c-5352-46e2-b5e5-3777db2c9bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:00.121511 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415f26c-5352-46e2-b5e5-3777db2c9bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:00.121890 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415f26c-5352-46e2-b5e5-3777db2c9bb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:00.122607 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415f26c-5352-46e2-b5e5-3777db2c9bb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:00.124510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415f26c-5352-46e2-b5e5-3777db2c9bb2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:00.144662 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd39cb5-5589-4d85-8582-be9ff31e8655 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:00.144962 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd39cb5-5589-4d85-8582-be9ff31e8655 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:00.145283 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd39cb5-5589-4d85-8582-be9ff31e8655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:00.164232 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-9fd39cb5-5589-4d85-8582-be9ff31e8655 None None] MFA Rules not processed for user `ff65e481807b4344897b1499cd450f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:00.166065 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9fd39cb5-5589-4d85-8582-be9ff31e8655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:00.209171 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1380/2759] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:05:00 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:05:00.210433 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415f26c-5352-46e2-b5e5-3777db2c9bb2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:00.225649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1380/2760] 10.222.0.76 () {58 vars in 967 bytes} [Mon Jul 18 17:05:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:05:00.232222 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:00.239456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd39cb5-5589-4d85-8582-be9ff31e8655 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:00.241164 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-9fd39cb5-5589-4d85-8582-be9ff31e8655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:00.278690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415f26c-5352-46e2-b5e5-3777db2c9bb2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:00.283763 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70a89e-5dba-478a-bd45-ed8576903383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:00.284367 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70a89e-5dba-478a-bd45-ed8576903383 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:00.284660 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70a89e-5dba-478a-bd45-ed8576903383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:00.284940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70a89e-5dba-478a-bd45-ed8576903383 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:00.285697 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70a89e-5dba-478a-bd45-ed8576903383 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:00.287701 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70a89e-5dba-478a-bd45-ed8576903383 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:00.391068 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1381/2761] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:05:00 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:05:00.392365 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70a89e-5dba-478a-bd45-ed8576903383 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:00.402636 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70a89e-5dba-478a-bd45-ed8576903383 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:00.407475 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b39bc-6119-4c03-95aa-4fc663e187ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:00.408153 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b39bc-6119-4c03-95aa-4fc663e187ad admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:00.408491 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b39bc-6119-4c03-95aa-4fc663e187ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:00.408816 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529b39bc-6119-4c03-95aa-4fc663e187ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:00.409602 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b39bc-6119-4c03-95aa-4fc663e187ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:00.411227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529b39bc-6119-4c03-95aa-4fc663e187ad admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:00.426535 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1382/2762] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:00.427604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b39bc-6119-4c03-95aa-4fc663e187ad admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:00.438597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529b39bc-6119-4c03-95aa-4fc663e187ad admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:00.443345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc081b56-6f15-4379-90aa-af5e2f6f9e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:00.444002 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc081b56-6f15-4379-90aa-af5e2f6f9e7c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:00.444296 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc081b56-6f15-4379-90aa-af5e2f6f9e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:00.444574 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc081b56-6f15-4379-90aa-af5e2f6f9e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:00.445230 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:00.445699 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc081b56-6f15-4379-90aa-af5e2f6f9e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:00.447483 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc081b56-6f15-4379-90aa-af5e2f6f9e7c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:00.451304 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd39cb5-5589-4d85-8582-be9ff31e8655 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:00.458458 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1383/2763] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:00.462778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc081b56-6f15-4379-90aa-af5e2f6f9e7c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:00.472592 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc081b56-6f15-4379-90aa-af5e2f6f9e7c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:00.477787 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c4bb77-2c2b-422d-9202-3beb965c798f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:00.478667 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4bb77-2c2b-422d-9202-3beb965c798f admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:00.478955 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4bb77-2c2b-422d-9202-3beb965c798f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:00.479230 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c4bb77-2c2b-422d-9202-3beb965c798f admin admin] PATH_INFO: `/v3/projects/b25feb16b0ef4a389b900dc177615e9f/users/e4d5284d07854ee68b956a27919caa36/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:00.495307 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4bb77-2c2b-422d-9202-3beb965c798f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b25feb16b0ef4a389b900dc177615e9f, user_id=e4d5284d07854ee68b956a27919caa36, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:00.498144 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c4bb77-2c2b-422d-9202-3beb965c798f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:00.513543 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2a1df-cc0d-4c19-8c03-98380e5df5e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50bc0fa34b414328a342d685bc1eaca3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:00.514207 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2a1df-cc0d-4c19-8c03-98380e5df5e5 service swift] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:00.514498 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2a1df-cc0d-4c19-8c03-98380e5df5e5 service swift] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:00.514777 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2a1df-cc0d-4c19-8c03-98380e5df5e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:00.547899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1384/2764] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:05:00 2022] PUT /identity/v3/projects/b25feb16b0ef4a389b900dc177615e9f/users/e4d5284d07854ee68b956a27919caa36/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:05:00.559257 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778442f7-83cc-4024-b0c0-ad42849e13e0 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:00.559548 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778442f7-83cc-4024-b0c0-ad42849e13e0 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:00.559831 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778442f7-83cc-4024-b0c0-ad42849e13e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:00.572127 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2a1df-cc0d-4c19-8c03-98380e5df5e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:00.573465 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2a1df-cc0d-4c19-8c03-98380e5df5e5 service swift] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:00.582292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1381/2765] 10.222.0.76 () {60 vars in 1384 bytes} [Mon Jul 18 17:05:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 18 17:05:00.590242 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-778442f7-83cc-4024-b0c0-ad42849e13e0 None None] MFA Rules not processed for user `e4d5284d07854ee68b956a27919caa36`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:00.591486 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-778442f7-83cc-4024-b0c0-ad42849e13e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:00.664040 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1385/2766] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:05:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:05:00.669648 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2a1df-cc0d-4c19-8c03-98380e5df5e5 service swift] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:00.680822 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2a1df-cc0d-4c19-8c03-98380e5df5e5 service swift] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:00.739411 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d84a9f-63b8-4350-b749-28f5460f11df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:00.740221 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84a9f-63b8-4350-b749-28f5460f11df admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:00.740488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84a9f-63b8-4350-b749-28f5460f11df admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:00.740789 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d84a9f-63b8-4350-b749-28f5460f11df admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:00.741570 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d84a9f-63b8-4350-b749-28f5460f11df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:00.743574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d84a9f-63b8-4350-b749-28f5460f11df admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:00.851759 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1382/2767] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:05:00 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:05:00.858868 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778442f7-83cc-4024-b0c0-ad42849e13e0 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:00.870095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778442f7-83cc-4024-b0c0-ad42849e13e0 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:00.934711 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:00.944697 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694688e2-3862-429e-8d2b-c0faaede243b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:00.945406 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694688e2-3862-429e-8d2b-c0faaede243b admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:00.945696 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694688e2-3862-429e-8d2b-c0faaede243b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:00.946822 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694688e2-3862-429e-8d2b-c0faaede243b admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:00.947693 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694688e2-3862-429e-8d2b-c0faaede243b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:00.949658 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694688e2-3862-429e-8d2b-c0faaede243b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:01.036111 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1386/2768] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:05:00 2022] POST /identity/v3/users => generated 291 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:05:01.038941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d84a9f-63b8-4350-b749-28f5460f11df admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:01.050694 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d84a9f-63b8-4350-b749-28f5460f11df admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:01.055499 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81710532-c340-4d78-b35c-453f7818c2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:01.065057 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81710532-c340-4d78-b35c-453f7818c2b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:01.065057 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81710532-c340-4d78-b35c-453f7818c2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:01.065057 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81710532-c340-4d78-b35c-453f7818c2b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:01.065057 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81710532-c340-4d78-b35c-453f7818c2b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:01.065057 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81710532-c340-4d78-b35c-453f7818c2b6 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:01.072241 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1383/2769] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:01.076931 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694688e2-3862-429e-8d2b-c0faaede243b admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:01.092428 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694688e2-3862-429e-8d2b-c0faaede243b admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:01.099649 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e72013-152a-452a-872b-b7b3fec2e073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:01.099649 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e72013-152a-452a-872b-b7b3fec2e073 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:01.099649 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e72013-152a-452a-872b-b7b3fec2e073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:01.099649 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e72013-152a-452a-872b-b7b3fec2e073 admin admin] PATH_INFO: `/v3/projects/eec0ea771ca14bf085e3be36cba11724/users/7a1b6de508dd420bb6c4840bf80f40b9/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:01.121693 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e72013-152a-452a-872b-b7b3fec2e073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec0ea771ca14bf085e3be36cba11724, user_id=7a1b6de508dd420bb6c4840bf80f40b9, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:01.125668 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e72013-152a-452a-872b-b7b3fec2e073 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:01.342294 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1387/2770] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:05:01 2022] PUT /identity/v3/projects/eec0ea771ca14bf085e3be36cba11724/users/7a1b6de508dd420bb6c4840bf80f40b9/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:01.346437 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81710532-c340-4d78-b35c-453f7818c2b6 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:01.357435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81710532-c340-4d78-b35c-453f7818c2b6 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:01.371642 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:01.422925 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45adc61-7c29-41ed-b8c6-04f73b72e410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:01.423606 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45adc61-7c29-41ed-b8c6-04f73b72e410 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:01.423971 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45adc61-7c29-41ed-b8c6-04f73b72e410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:01.424210 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45adc61-7c29-41ed-b8c6-04f73b72e410 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:01.424954 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45adc61-7c29-41ed-b8c6-04f73b72e410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:01.429176 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45adc61-7c29-41ed-b8c6-04f73b72e410 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:01.437962 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1384/2771] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:01.441623 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e72013-152a-452a-872b-b7b3fec2e073 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:01.453868 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e72013-152a-452a-872b-b7b3fec2e073 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:01.458520 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fea3b8-0a0c-4ace-82e6-5c718dabda33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:01.462557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fea3b8-0a0c-4ace-82e6-5c718dabda33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:01.462557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fea3b8-0a0c-4ace-82e6-5c718dabda33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:01.462557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fea3b8-0a0c-4ace-82e6-5c718dabda33 admin admin] PATH_INFO: `/v3/projects/eec0ea771ca14bf085e3be36cba11724/users/7a1b6de508dd420bb6c4840bf80f40b9/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:01.462557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fea3b8-0a0c-4ace-82e6-5c718dabda33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eec0ea771ca14bf085e3be36cba11724, user_id=7a1b6de508dd420bb6c4840bf80f40b9, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:01.465185 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fea3b8-0a0c-4ace-82e6-5c718dabda33 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:01.476095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1388/2772] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:05:01 2022] PUT /identity/v3/projects/eec0ea771ca14bf085e3be36cba11724/users/7a1b6de508dd420bb6c4840bf80f40b9/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:01.488355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8aa8e-fde7-47c1-8020-311c16bccca1 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:01.488932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8aa8e-fde7-47c1-8020-311c16bccca1 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:01.488932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8aa8e-fde7-47c1-8020-311c16bccca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:01.514930 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-61f8aa8e-fde7-47c1-8020-311c16bccca1 None None] MFA Rules not processed for user `7a1b6de508dd420bb6c4840bf80f40b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:01.516126 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-61f8aa8e-fde7-47c1-8020-311c16bccca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:01.589229 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1385/2773] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:05:01 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:01.600717 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fea3b8-0a0c-4ace-82e6-5c718dabda33 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:01.603055 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e6fea3b8-0a0c-4ace-82e6-5c718dabda33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:01.662131 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fea3b8-0a0c-4ace-82e6-5c718dabda33 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:01.666568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a1b16-39b4-4a72-82f7-68c6e9d78836 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:01.667224 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a1b16-39b4-4a72-82f7-68c6e9d78836 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:01.667512 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a1b16-39b4-4a72-82f7-68c6e9d78836 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:01.667800 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a1b16-39b4-4a72-82f7-68c6e9d78836 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:01.677806 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a1b16-39b4-4a72-82f7-68c6e9d78836 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:01.679296 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a1b16-39b4-4a72-82f7-68c6e9d78836 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:01.690139 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1389/2774] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:01 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:05:01.815582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8aa8e-fde7-47c1-8020-311c16bccca1 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:01.828202 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8aa8e-fde7-47c1-8020-311c16bccca1 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:01.832128 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daf8863-dd54-4b73-9aaa-835f11e1bb26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:01.832785 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf8863-dd54-4b73-9aaa-835f11e1bb26 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:01.833101 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf8863-dd54-4b73-9aaa-835f11e1bb26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:01.833386 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daf8863-dd54-4b73-9aaa-835f11e1bb26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:01.898296 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf8863-dd54-4b73-9aaa-835f11e1bb26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:01.900526 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daf8863-dd54-4b73-9aaa-835f11e1bb26 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:01.910483 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1386/2775] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:01 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:05:03.280389 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a1b16-39b4-4a72-82f7-68c6e9d78836 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:03.281834 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1a1a1b16-39b4-4a72-82f7-68c6e9d78836 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:03.348658 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a1b16-39b4-4a72-82f7-68c6e9d78836 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:03.353901 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01929380-39d8-4308-92a9-be0ac51dc6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:03.354776 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01929380-39d8-4308-92a9-be0ac51dc6e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:03.355089 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01929380-39d8-4308-92a9-be0ac51dc6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:03.355372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01929380-39d8-4308-92a9-be0ac51dc6e9 admin admin] PATH_INFO: `/v3/users/ab865b95180849e0aaf9eacb9eabc446` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:03.356564 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01929380-39d8-4308-92a9-be0ac51dc6e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab865b95180849e0aaf9eacb9eabc446)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:03.358815 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01929380-39d8-4308-92a9-be0ac51dc6e9 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:03.526913 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-01929380-39d8-4308-92a9-be0ac51dc6e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab865b95180849e0aaf9eacb9eabc446'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:03.528685 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:03.621156 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-01929380-39d8-4308-92a9-be0ac51dc6e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab865b95180849e0aaf9eacb9eabc446'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:03.628836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-01929380-39d8-4308-92a9-be0ac51dc6e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab865b95180849e0aaf9eacb9eabc446'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:03.629515 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-01929380-39d8-4308-92a9-be0ac51dc6e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab865b95180849e0aaf9eacb9eabc446'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:03.643348 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-01929380-39d8-4308-92a9-be0ac51dc6e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab865b95180849e0aaf9eacb9eabc446'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:03.654866 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1390/2776] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:05:03 2022] DELETE /identity/v3/users/ab865b95180849e0aaf9eacb9eabc446 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:03.656416 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8dc4e6-ffe4-4ca4-8073-c3419c41b6b0 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:03.656965 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8dc4e6-ffe4-4ca4-8073-c3419c41b6b0 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:03.657114 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8dc4e6-ffe4-4ca4-8073-c3419c41b6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:03.675204 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-df8dc4e6-ffe4-4ca4-8073-c3419c41b6b0 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:03.676427 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-df8dc4e6-ffe4-4ca4-8073-c3419c41b6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:03.711061 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=100 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:03.738950 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1387/2777] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:03.748854 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01929380-39d8-4308-92a9-be0ac51dc6e9 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:03.750332 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-01929380-39d8-4308-92a9-be0ac51dc6e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:03.810642 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01929380-39d8-4308-92a9-be0ac51dc6e9 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:03.814104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb1f22-e44c-4c65-a8dc-25e7b11c1d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:03.814750 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb1f22-e44c-4c65-a8dc-25e7b11c1d9c service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:03.815037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb1f22-e44c-4c65-a8dc-25e7b11c1d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:03.815310 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb1f22-e44c-4c65-a8dc-25e7b11c1d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:03.826143 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb1f22-e44c-4c65-a8dc-25e7b11c1d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:03.827655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb1f22-e44c-4c65-a8dc-25e7b11c1d9c service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:03.838527 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1391/2778] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:05:04.163639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8dc4e6-ffe4-4ca4-8073-c3419c41b6b0 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:04.163874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-df8dc4e6-ffe4-4ca4-8073-c3419c41b6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:04.182216 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8dc4e6-ffe4-4ca4-8073-c3419c41b6b0 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:04.190182 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e32ed-dcbe-419e-8c7b-ca283e0cb098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:04.191066 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e32ed-dcbe-419e-8c7b-ca283e0cb098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:04.191352 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e32ed-dcbe-419e-8c7b-ca283e0cb098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:04.191691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e32ed-dcbe-419e-8c7b-ca283e0cb098 admin admin] PATH_INFO: `/v3/projects/1954560e876d4b1fbfec255b13ca7ba4` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:04.193167 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e32ed-dcbe-419e-8c7b-ca283e0cb098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1954560e876d4b1fbfec255b13ca7ba4)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:04.195188 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e32ed-dcbe-419e-8c7b-ca283e0cb098 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:04.313429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d01e32ed-dcbe-419e-8c7b-ca283e0cb098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1954560e876d4b1fbfec255b13ca7ba4', 'request_id': 'req-d01e32ed-dcbe-419e-8c7b-ca283e0cb098'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:04.318818 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d01e32ed-dcbe-419e-8c7b-ca283e0cb098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1954560e876d4b1fbfec255b13ca7ba4', 'request_id': 'req-d01e32ed-dcbe-419e-8c7b-ca283e0cb098'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:04.325439 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d01e32ed-dcbe-419e-8c7b-ca283e0cb098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1954560e876d4b1fbfec255b13ca7ba4', 'request_id': 'req-d01e32ed-dcbe-419e-8c7b-ca283e0cb098'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:04.421683 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d01e32ed-dcbe-419e-8c7b-ca283e0cb098 admin admin] The token cache is being invalidate because project 1954560e876d4b1fbfec255b13ca7ba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:05:04.421998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d01e32ed-dcbe-419e-8c7b-ca283e0cb098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:04.422632 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-d01e32ed-dcbe-419e-8c7b-ca283e0cb098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:04.424220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1388/2779] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:05:04 2022] DELETE /identity/v3/projects/1954560e876d4b1fbfec255b13ca7ba4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:07.082108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb1f22-e44c-4c65-a8dc-25e7b11c1d9c service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:07.083586 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0bbb1f22-e44c-4c65-a8dc-25e7b11c1d9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:07.096647 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb1f22-e44c-4c65-a8dc-25e7b11c1d9c service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:07.156804 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4dc02d-778f-4b7d-9e01-cec7b7c1dea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:07.157682 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dc02d-778f-4b7d-9e01-cec7b7c1dea1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:07.157998 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dc02d-778f-4b7d-9e01-cec7b7c1dea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:07.158278 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4dc02d-778f-4b7d-9e01-cec7b7c1dea1 admin admin] PATH_INFO: `/v3/users/e4d5284d07854ee68b956a27919caa36` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:07.159496 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4dc02d-778f-4b7d-9e01-cec7b7c1dea1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d5284d07854ee68b956a27919caa36)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:07.162155 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4dc02d-778f-4b7d-9e01-cec7b7c1dea1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:07.337831 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0a4dc02d-778f-4b7d-9e01-cec7b7c1dea1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d5284d07854ee68b956a27919caa36'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:07.415761 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0a4dc02d-778f-4b7d-9e01-cec7b7c1dea1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d5284d07854ee68b956a27919caa36'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:07.423301 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0a4dc02d-778f-4b7d-9e01-cec7b7c1dea1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d5284d07854ee68b956a27919caa36'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:07.432480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0a4dc02d-778f-4b7d-9e01-cec7b7c1dea1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d5284d07854ee68b956a27919caa36'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:07.432480 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:INSERT=2,keystone:DELETE=12,keystone:SELECT=86 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:07.438035 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0a4dc02d-778f-4b7d-9e01-cec7b7c1dea1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d5284d07854ee68b956a27919caa36'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:07.444019 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1392/2780] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:05:07 2022] DELETE /identity/v3/users/e4d5284d07854ee68b956a27919caa36 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:07.449264 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb62f0-996f-4318-9daf-4bca4ab9e756 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:07.449770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb62f0-996f-4318-9daf-4bca4ab9e756 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:07.449873 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb62f0-996f-4318-9daf-4bca4ab9e756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:07.468739 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-37cb62f0-996f-4318-9daf-4bca4ab9e756 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:07.470027 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-37cb62f0-996f-4318-9daf-4bca4ab9e756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:07.532770 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1389/2781] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:05:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:07.544149 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4dc02d-778f-4b7d-9e01-cec7b7c1dea1 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:07.545618 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-0a4dc02d-778f-4b7d-9e01-cec7b7c1dea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:07.604106 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4dc02d-778f-4b7d-9e01-cec7b7c1dea1 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:07.607826 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1982f1-3208-40f0-9236-9dcd5eb4a4cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:07.608748 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1982f1-3208-40f0-9236-9dcd5eb4a4cd service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:07.609062 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1982f1-3208-40f0-9236-9dcd5eb4a4cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:07.609345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1982f1-3208-40f0-9236-9dcd5eb4a4cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:07.619588 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1982f1-3208-40f0-9236-9dcd5eb4a4cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:07.621064 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1982f1-3208-40f0-9236-9dcd5eb4a4cd service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:07.631056 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1393/2782] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:05:08.166045 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb62f0-996f-4318-9daf-4bca4ab9e756 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:08.167556 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-37cb62f0-996f-4318-9daf-4bca4ab9e756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:08.182970 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb62f0-996f-4318-9daf-4bca4ab9e756 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:08.188121 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7ce78-cad9-404a-8ee1-852187c015ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:08.188977 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7ce78-cad9-404a-8ee1-852187c015ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:08.189303 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7ce78-cad9-404a-8ee1-852187c015ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:08.189587 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7ce78-cad9-404a-8ee1-852187c015ab admin admin] PATH_INFO: `/v3/projects/b25feb16b0ef4a389b900dc177615e9f` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:08.190789 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7ce78-cad9-404a-8ee1-852187c015ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=b25feb16b0ef4a389b900dc177615e9f)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:08.193721 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7ce78-cad9-404a-8ee1-852187c015ab admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:08.337641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1de7ce78-cad9-404a-8ee1-852187c015ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b25feb16b0ef4a389b900dc177615e9f', 'request_id': 'req-1de7ce78-cad9-404a-8ee1-852187c015ab'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:08.344405 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:08.345710 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1de7ce78-cad9-404a-8ee1-852187c015ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b25feb16b0ef4a389b900dc177615e9f', 'request_id': 'req-1de7ce78-cad9-404a-8ee1-852187c015ab'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:08.352350 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1de7ce78-cad9-404a-8ee1-852187c015ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b25feb16b0ef4a389b900dc177615e9f', 'request_id': 'req-1de7ce78-cad9-404a-8ee1-852187c015ab'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:08.437473 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1de7ce78-cad9-404a-8ee1-852187c015ab admin admin] The token cache is being invalidate because project b25feb16b0ef4a389b900dc177615e9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:05:08.437819 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1de7ce78-cad9-404a-8ee1-852187c015ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:08.438492 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-1de7ce78-cad9-404a-8ee1-852187c015ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:08.440033 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1390/2783] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:05:08 2022] DELETE /identity/v3/projects/b25feb16b0ef4a389b900dc177615e9f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:08.444100 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1982f1-3208-40f0-9236-9dcd5eb4a4cd service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:08.454918 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1982f1-3208-40f0-9236-9dcd5eb4a4cd service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:08.518071 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4415089-86c5-4001-b720-c8ed5af27115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:08.518982 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4415089-86c5-4001-b720-c8ed5af27115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:08.519271 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4415089-86c5-4001-b720-c8ed5af27115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:08.519555 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4415089-86c5-4001-b720-c8ed5af27115 admin admin] PATH_INFO: `/v3/users/7a1b6de508dd420bb6c4840bf80f40b9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:08.520753 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4415089-86c5-4001-b720-c8ed5af27115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a1b6de508dd420bb6c4840bf80f40b9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:08.522701 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4415089-86c5-4001-b720-c8ed5af27115 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:08.766569 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b4415089-86c5-4001-b720-c8ed5af27115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a1b6de508dd420bb6c4840bf80f40b9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:08.838539 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b4415089-86c5-4001-b720-c8ed5af27115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a1b6de508dd420bb6c4840bf80f40b9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:08.847184 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b4415089-86c5-4001-b720-c8ed5af27115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a1b6de508dd420bb6c4840bf80f40b9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:08.848049 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b4415089-86c5-4001-b720-c8ed5af27115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a1b6de508dd420bb6c4840bf80f40b9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:08.862425 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-b4415089-86c5-4001-b720-c8ed5af27115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a1b6de508dd420bb6c4840bf80f40b9'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:08.869514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1394/2784] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:05:08 2022] DELETE /identity/v3/users/7a1b6de508dd420bb6c4840bf80f40b9 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:05:09.285431 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7ce78-cad9-404a-8ee1-852187c015ab admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:09.286941 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-1de7ce78-cad9-404a-8ee1-852187c015ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:09.300908 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7ce78-cad9-404a-8ee1-852187c015ab admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:09.368075 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a86f5-e8f3-4962-9908-f0b8ac6f600a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:09.368959 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a86f5-e8f3-4962-9908-f0b8ac6f600a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:09.369272 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a86f5-e8f3-4962-9908-f0b8ac6f600a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:09.369549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a86f5-e8f3-4962-9908-f0b8ac6f600a admin admin] PATH_INFO: `/v3/projects/eec0ea771ca14bf085e3be36cba11724` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:09.370759 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a86f5-e8f3-4962-9908-f0b8ac6f600a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eec0ea771ca14bf085e3be36cba11724)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:09.372655 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a86f5-e8f3-4962-9908-f0b8ac6f600a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:09.501122 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3e0a86f5-e8f3-4962-9908-f0b8ac6f600a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eec0ea771ca14bf085e3be36cba11724', 'request_id': 'req-3e0a86f5-e8f3-4962-9908-f0b8ac6f600a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:09.506551 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3e0a86f5-e8f3-4962-9908-f0b8ac6f600a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eec0ea771ca14bf085e3be36cba11724', 'request_id': 'req-3e0a86f5-e8f3-4962-9908-f0b8ac6f600a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:09.513282 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3e0a86f5-e8f3-4962-9908-f0b8ac6f600a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eec0ea771ca14bf085e3be36cba11724', 'request_id': 'req-3e0a86f5-e8f3-4962-9908-f0b8ac6f600a'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:09.564396 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3e0a86f5-e8f3-4962-9908-f0b8ac6f600a admin admin] The token cache is being invalidate because project eec0ea771ca14bf085e3be36cba11724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:05:09.564599 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3e0a86f5-e8f3-4962-9908-f0b8ac6f600a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:09.565265 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-3e0a86f5-e8f3-4962-9908-f0b8ac6f600a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:09.566827 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1391/2785] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:05:09 2022] DELETE /identity/v3/projects/eec0ea771ca14bf085e3be36cba11724 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:05:09.572990 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab3cc8-a4c6-4f6a-8b19-5a22f30b1377 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:09.573544 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab3cc8-a4c6-4f6a-8b19-5a22f30b1377 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:09.573650 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab3cc8-a4c6-4f6a-8b19-5a22f30b1377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:09.592257 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-14ab3cc8-a4c6-4f6a-8b19-5a22f30b1377 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:09.593525 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-14ab3cc8-a4c6-4f6a-8b19-5a22f30b1377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:09.597849 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:09.655601 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1395/2786] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:05:09.663228 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c565cb-f681-499d-84a2-0d3133a8c4f1 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:09.674573 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c565cb-f681-499d-84a2-0d3133a8c4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:09.674573 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c565cb-f681-499d-84a2-0d3133a8c4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:09.683393 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-b1c565cb-f681-499d-84a2-0d3133a8c4f1 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:09.684727 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-b1c565cb-f681-499d-84a2-0d3133a8c4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:09.692830 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1392/2787] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:09.697829 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab3cc8-a4c6-4f6a-8b19-5a22f30b1377 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:09.707341 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ab3cc8-a4c6-4f6a-8b19-5a22f30b1377 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:09.712118 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c45582-095b-4b65-b4a0-5ccb8c3a532c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:09.712774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c45582-095b-4b65-b4a0-5ccb8c3a532c admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:09.713096 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c45582-095b-4b65-b4a0-5ccb8c3a532c admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:09.713375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c45582-095b-4b65-b4a0-5ccb8c3a532c admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:09.714101 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c45582-095b-4b65-b4a0-5ccb8c3a532c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:05:09.714407 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c45582-095b-4b65-b4a0-5ccb8c3a532c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:09.716040 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c45582-095b-4b65-b4a0-5ccb8c3a532c admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:09.727875 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1396/2788] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 18 17:05:09.740822 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c565cb-f681-499d-84a2-0d3133a8c4f1 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:09.750975 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c565cb-f681-499d-84a2-0d3133a8c4f1 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:09.755703 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93117ac8-19ed-430c-a81d-40d33227bf6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:09.756354 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93117ac8-19ed-430c-a81d-40d33227bf6d admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:09.756641 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93117ac8-19ed-430c-a81d-40d33227bf6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:09.756921 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93117ac8-19ed-430c-a81d-40d33227bf6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:09.757643 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93117ac8-19ed-430c-a81d-40d33227bf6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:09.760281 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93117ac8-19ed-430c-a81d-40d33227bf6d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:09.881649 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1393/2789] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:05:09 2022] POST /identity/v3/projects => generated 409 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:05:09.884206 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c45582-095b-4b65-b4a0-5ccb8c3a532c admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:09.894611 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c45582-095b-4b65-b4a0-5ccb8c3a532c admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:09.953109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750cffa-3b6d-46aa-a81b-44ac10687436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:09.953778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750cffa-3b6d-46aa-a81b-44ac10687436 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:09.954063 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750cffa-3b6d-46aa-a81b-44ac10687436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:09.954344 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750cffa-3b6d-46aa-a81b-44ac10687436 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:09.955050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750cffa-3b6d-46aa-a81b-44ac10687436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:09.957036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750cffa-3b6d-46aa-a81b-44ac10687436 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:10.038328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1397/2790] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:05:09 2022] POST /identity/v3/users => generated 305 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:05:10.042787 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93117ac8-19ed-430c-a81d-40d33227bf6d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:10.053399 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93117ac8-19ed-430c-a81d-40d33227bf6d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:10.058401 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b2397-0422-4ac2-8595-5b6d1dffe161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:10.059089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b2397-0422-4ac2-8595-5b6d1dffe161 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:10.059381 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b2397-0422-4ac2-8595-5b6d1dffe161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:10.059656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b2397-0422-4ac2-8595-5b6d1dffe161 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:10.060424 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b2397-0422-4ac2-8595-5b6d1dffe161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:10.062043 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b2397-0422-4ac2-8595-5b6d1dffe161 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:10.073320 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1394/2791] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:10.077435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750cffa-3b6d-46aa-a81b-44ac10687436 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:10.088412 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750cffa-3b6d-46aa-a81b-44ac10687436 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:10.093613 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b802bbd-a438-4d09-bf92-e3e7139ecac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:10.094485 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b802bbd-a438-4d09-bf92-e3e7139ecac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:10.094724 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b802bbd-a438-4d09-bf92-e3e7139ecac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:10.095002 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b802bbd-a438-4d09-bf92-e3e7139ecac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:10.095736 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b802bbd-a438-4d09-bf92-e3e7139ecac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:10.097377 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b802bbd-a438-4d09-bf92-e3e7139ecac7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:10.107752 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1398/2792] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:10.112150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b2397-0422-4ac2-8595-5b6d1dffe161 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:10.122559 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b2397-0422-4ac2-8595-5b6d1dffe161 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:10.127334 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70026024-58cf-4699-89e9-f88ba5f812a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:10.128223 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70026024-58cf-4699-89e9-f88ba5f812a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:10.128508 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70026024-58cf-4699-89e9-f88ba5f812a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:10.128779 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70026024-58cf-4699-89e9-f88ba5f812a3 admin admin] PATH_INFO: `/v3/projects/f1744f72350d4e668bc5ba311fa6549c/users/8cd2034a87464d4181875a7efc6880ee/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:10.144053 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70026024-58cf-4699-89e9-f88ba5f812a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1744f72350d4e668bc5ba311fa6549c, user_id=8cd2034a87464d4181875a7efc6880ee, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:10.146759 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70026024-58cf-4699-89e9-f88ba5f812a3 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:10.284911 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1395/2793] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:05:10 2022] PUT /identity/v3/projects/f1744f72350d4e668bc5ba311fa6549c/users/8cd2034a87464d4181875a7efc6880ee/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:10.296752 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441db252-67af-49e3-93db-5e6378de79f1 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:10.297077 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441db252-67af-49e3-93db-5e6378de79f1 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:10.297368 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441db252-67af-49e3-93db-5e6378de79f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:10.325796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-441db252-67af-49e3-93db-5e6378de79f1 None None] MFA Rules not processed for user `8cd2034a87464d4181875a7efc6880ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:10.327014 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-441db252-67af-49e3-93db-5e6378de79f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:10.393727 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1399/2794] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:05:10 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:10.398132 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70026024-58cf-4699-89e9-f88ba5f812a3 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:10.411563 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:10.461996 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70026024-58cf-4699-89e9-f88ba5f812a3 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:10.467258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642f864-0dc6-4d01-9c87-9f7646286c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:10.467910 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642f864-0dc6-4d01-9c87-9f7646286c0c admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:10.468192 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642f864-0dc6-4d01-9c87-9f7646286c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:10.468489 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a642f864-0dc6-4d01-9c87-9f7646286c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:10.469217 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642f864-0dc6-4d01-9c87-9f7646286c0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:10.471101 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a642f864-0dc6-4d01-9c87-9f7646286c0c admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:10.560435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1396/2795] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:05:10 2022] POST /identity/v3/projects => generated 407 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:05:10.564515 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441db252-67af-49e3-93db-5e6378de79f1 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:10.571804 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:10.577139 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441db252-67af-49e3-93db-5e6378de79f1 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:10.636378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1a07d-a5e5-400e-9337-e2ba57811010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:10.637089 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1a07d-a5e5-400e-9337-e2ba57811010 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:10.637389 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1a07d-a5e5-400e-9337-e2ba57811010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:10.637669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1a07d-a5e5-400e-9337-e2ba57811010 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:10.638374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1a07d-a5e5-400e-9337-e2ba57811010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:10.640363 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e1a07d-a5e5-400e-9337-e2ba57811010 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:10.736440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1400/2796] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:05:10 2022] POST /identity/v3/users => generated 310 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:05:10.740302 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642f864-0dc6-4d01-9c87-9f7646286c0c admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:10.751695 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a642f864-0dc6-4d01-9c87-9f7646286c0c admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:10.756322 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4710cb7-c5a1-4cf6-9a89-ffcba3efbcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:10.756992 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4710cb7-c5a1-4cf6-9a89-ffcba3efbcc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:10.762518 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4710cb7-c5a1-4cf6-9a89-ffcba3efbcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:10.762518 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4710cb7-c5a1-4cf6-9a89-ffcba3efbcc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:10.762518 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4710cb7-c5a1-4cf6-9a89-ffcba3efbcc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:10.762518 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4710cb7-c5a1-4cf6-9a89-ffcba3efbcc2 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:10.778313 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1397/2797] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:10.783113 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1a07d-a5e5-400e-9337-e2ba57811010 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:10.793808 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1a07d-a5e5-400e-9337-e2ba57811010 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:10.798518 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58e76d-ad79-40b5-85cb-27ba6582c98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:10.799399 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58e76d-ad79-40b5-85cb-27ba6582c98a admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:10.799680 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58e76d-ad79-40b5-85cb-27ba6582c98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:10.799962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc58e76d-ad79-40b5-85cb-27ba6582c98a admin admin] PATH_INFO: `/v3/projects/4843b7a7c3dd4f4e8e1a5e7a36775c8e/users/a7e9ea3a08d044bb973db39b488d959c/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:10.816095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58e76d-ad79-40b5-85cb-27ba6582c98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4843b7a7c3dd4f4e8e1a5e7a36775c8e, user_id=a7e9ea3a08d044bb973db39b488d959c, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:10.818882 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc58e76d-ad79-40b5-85cb-27ba6582c98a admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:10.924678 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1401/2798] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:05:10 2022] PUT /identity/v3/projects/4843b7a7c3dd4f4e8e1a5e7a36775c8e/users/a7e9ea3a08d044bb973db39b488d959c/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:05:10.928947 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4710cb7-c5a1-4cf6-9a89-ffcba3efbcc2 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:10.940541 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4710cb7-c5a1-4cf6-9a89-ffcba3efbcc2 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:10.999491 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8831db88-e3bc-46c0-a217-a98b40b62c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:11.000209 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831db88-e3bc-46c0-a217-a98b40b62c2a admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:11.000500 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831db88-e3bc-46c0-a217-a98b40b62c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:11.000820 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8831db88-e3bc-46c0-a217-a98b40b62c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:11.001623 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831db88-e3bc-46c0-a217-a98b40b62c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:11.003270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8831db88-e3bc-46c0-a217-a98b40b62c2a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:11.013727 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1398/2799] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:11.017937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58e76d-ad79-40b5-85cb-27ba6582c98a admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:11.028615 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc58e76d-ad79-40b5-85cb-27ba6582c98a admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:11.033404 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac039d3-5505-4128-9b71-20fe57a76508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:11.034337 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac039d3-5505-4128-9b71-20fe57a76508 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:11.034622 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac039d3-5505-4128-9b71-20fe57a76508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:11.034902 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac039d3-5505-4128-9b71-20fe57a76508 admin admin] PATH_INFO: `/v3/projects/4843b7a7c3dd4f4e8e1a5e7a36775c8e/users/a7e9ea3a08d044bb973db39b488d959c/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:11.036907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac039d3-5505-4128-9b71-20fe57a76508 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4843b7a7c3dd4f4e8e1a5e7a36775c8e, user_id=a7e9ea3a08d044bb973db39b488d959c, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:11.040355 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac039d3-5505-4128-9b71-20fe57a76508 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:11.052076 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1402/2800] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:05:11 2022] PUT /identity/v3/projects/4843b7a7c3dd4f4e8e1a5e7a36775c8e/users/a7e9ea3a08d044bb973db39b488d959c/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:05:11.063390 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b0796-170f-4b62-9afa-8a020afc6eee None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:11.063685 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b0796-170f-4b62-9afa-8a020afc6eee None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:11.063962 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b0796-170f-4b62-9afa-8a020afc6eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:11.091096 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-6f8b0796-170f-4b62-9afa-8a020afc6eee None None] MFA Rules not processed for user `a7e9ea3a08d044bb973db39b488d959c`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:11.092305 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-6f8b0796-170f-4b62-9afa-8a020afc6eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:11.159697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1399/2801] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:05:11 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:11.171201 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac039d3-5505-4128-9b71-20fe57a76508 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:11.172903 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-1ac039d3-5505-4128-9b71-20fe57a76508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:11.234288 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac039d3-5505-4128-9b71-20fe57a76508 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:11.237917 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839b6b6-aea2-413a-afd5-1624f3abc493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:11.238560 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839b6b6-aea2-413a-afd5-1624f3abc493 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:11.238847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839b6b6-aea2-413a-afd5-1624f3abc493 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:11.239119 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2839b6b6-aea2-413a-afd5-1624f3abc493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:11.248722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839b6b6-aea2-413a-afd5-1624f3abc493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:11.250235 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2839b6b6-aea2-413a-afd5-1624f3abc493 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:11.260011 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1403/2802] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:11 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:05:11.619807 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b0796-170f-4b62-9afa-8a020afc6eee None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:11.629721 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b0796-170f-4b62-9afa-8a020afc6eee None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:11.633373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6399c99-b480-4e0e-9800-55f16f70d644 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:11.634030 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6399c99-b480-4e0e-9800-55f16f70d644 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:11.634312 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6399c99-b480-4e0e-9800-55f16f70d644 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:11.634587 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6399c99-b480-4e0e-9800-55f16f70d644 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:11.638731 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:11.694434 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6399c99-b480-4e0e-9800-55f16f70d644 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:11.696452 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6399c99-b480-4e0e-9800-55f16f70d644 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:11.705604 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1400/2803] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:11 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:05:13.089722 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839b6b6-aea2-413a-afd5-1624f3abc493 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:13.091106 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2839b6b6-aea2-413a-afd5-1624f3abc493 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:13.155506 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:13.161575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2839b6b6-aea2-413a-afd5-1624f3abc493 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:13.166744 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c7815-1b78-4c8a-bb57-675a0aa4f6b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c8d6afb4ccd41a5972e3241a3eebc7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:13.167400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c7815-1b78-4c8a-bb57-675a0aa4f6b1 service placement] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:13.167686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c7815-1b78-4c8a-bb57-675a0aa4f6b1 service placement] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:13.172137 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c7815-1b78-4c8a-bb57-675a0aa4f6b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:13.172137 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3d8c7815-1b78-4c8a-bb57-675a0aa4f6b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:13.181670 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c7815-1b78-4c8a-bb57-675a0aa4f6b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:13.183273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c7815-1b78-4c8a-bb57-675a0aa4f6b1 service placement] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:13.194067 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1404/2804] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:05:21.729222 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=25 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:23.244098 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=5 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:27.200485 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6399c99-b480-4e0e-9800-55f16f70d644 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:27.264763 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6399c99-b480-4e0e-9800-55f16f70d644 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:27.269310 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b337080-63f8-4d45-a9a2-7ad1e5680940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:27.270215 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b337080-63f8-4d45-a9a2-7ad1e5680940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:27.270496 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b337080-63f8-4d45-a9a2-7ad1e5680940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:27.270794 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b337080-63f8-4d45-a9a2-7ad1e5680940 admin admin] PATH_INFO: `/v3/users/8cd2034a87464d4181875a7efc6880ee` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:27.271947 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b337080-63f8-4d45-a9a2-7ad1e5680940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cd2034a87464d4181875a7efc6880ee)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:27.274574 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b337080-63f8-4d45-a9a2-7ad1e5680940 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:27.457315 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5b337080-63f8-4d45-a9a2-7ad1e5680940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cd2034a87464d4181875a7efc6880ee'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:27.534669 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5b337080-63f8-4d45-a9a2-7ad1e5680940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cd2034a87464d4181875a7efc6880ee'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:27.544203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5b337080-63f8-4d45-a9a2-7ad1e5680940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cd2034a87464d4181875a7efc6880ee'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:27.546068 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5b337080-63f8-4d45-a9a2-7ad1e5680940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cd2034a87464d4181875a7efc6880ee'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:27.558887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-5b337080-63f8-4d45-a9a2-7ad1e5680940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cd2034a87464d4181875a7efc6880ee'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:27.564965 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1401/2805] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:05:27 2022] DELETE /identity/v3/users/8cd2034a87464d4181875a7efc6880ee => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:27.569538 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c90e50-b2fa-43a8-8102-e44f8f350494 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:27.570045 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c90e50-b2fa-43a8-8102-e44f8f350494 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:27.570152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c90e50-b2fa-43a8-8102-e44f8f350494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:27.588952 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-53c90e50-b2fa-43a8-8102-e44f8f350494 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:27.590239 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-53c90e50-b2fa-43a8-8102-e44f8f350494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:27.650073 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1405/2806] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:27.659643 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b337080-63f8-4d45-a9a2-7ad1e5680940 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:27.661219 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-5b337080-63f8-4d45-a9a2-7ad1e5680940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:27.725384 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b337080-63f8-4d45-a9a2-7ad1e5680940 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:27.730132 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa8c40-fc30-42a6-83d5-a0e5b53133b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:27.730792 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa8c40-fc30-42a6-83d5-a0e5b53133b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:27.734439 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa8c40-fc30-42a6-83d5-a0e5b53133b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:27.734439 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa8c40-fc30-42a6-83d5-a0e5b53133b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:27.741342 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa8c40-fc30-42a6-83d5-a0e5b53133b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:27.742929 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa8c40-fc30-42a6-83d5-a0e5b53133b3 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:27.752623 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1402/2807] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:05:28.154815 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c90e50-b2fa-43a8-8102-e44f8f350494 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:28.156282 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-53c90e50-b2fa-43a8-8102-e44f8f350494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:28.173161 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c90e50-b2fa-43a8-8102-e44f8f350494 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:28.175630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca74d81-3092-4535-891d-27a8603596c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:28.176515 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca74d81-3092-4535-891d-27a8603596c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:28.176802 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca74d81-3092-4535-891d-27a8603596c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:28.177110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca74d81-3092-4535-891d-27a8603596c1 admin admin] PATH_INFO: `/v3/projects/f1744f72350d4e668bc5ba311fa6549c` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:28.178320 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca74d81-3092-4535-891d-27a8603596c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1744f72350d4e668bc5ba311fa6549c)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:28.180566 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca74d81-3092-4535-891d-27a8603596c1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:28.307440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2ca74d81-3092-4535-891d-27a8603596c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1744f72350d4e668bc5ba311fa6549c', 'request_id': 'req-2ca74d81-3092-4535-891d-27a8603596c1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:28.313817 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2ca74d81-3092-4535-891d-27a8603596c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1744f72350d4e668bc5ba311fa6549c', 'request_id': 'req-2ca74d81-3092-4535-891d-27a8603596c1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:28.319652 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2ca74d81-3092-4535-891d-27a8603596c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1744f72350d4e668bc5ba311fa6549c', 'request_id': 'req-2ca74d81-3092-4535-891d-27a8603596c1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:28.420116 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2ca74d81-3092-4535-891d-27a8603596c1 admin admin] The token cache is being invalidate because project f1744f72350d4e668bc5ba311fa6549c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:05:28.420350 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2ca74d81-3092-4535-891d-27a8603596c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:28.420954 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-2ca74d81-3092-4535-891d-27a8603596c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:28.422602 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1406/2808] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:05:28 2022] DELETE /identity/v3/projects/f1744f72350d4e668bc5ba311fa6549c => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:28.426577 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa8c40-fc30-42a6-83d5-a0e5b53133b3 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:28.437056 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa8c40-fc30-42a6-83d5-a0e5b53133b3 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:28.456251 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:28.495454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed90e0-1427-45de-bb68-182b9bafc531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:28.496333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed90e0-1427-45de-bb68-182b9bafc531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:28.496615 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed90e0-1427-45de-bb68-182b9bafc531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:28.496890 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed90e0-1427-45de-bb68-182b9bafc531 admin admin] PATH_INFO: `/v3/users/a7e9ea3a08d044bb973db39b488d959c` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:28.498121 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed90e0-1427-45de-bb68-182b9bafc531 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e9ea3a08d044bb973db39b488d959c)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:28.500047 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed90e0-1427-45de-bb68-182b9bafc531 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:28.760089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-94ed90e0-1427-45de-bb68-182b9bafc531 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e9ea3a08d044bb973db39b488d959c'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:28.866270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-94ed90e0-1427-45de-bb68-182b9bafc531 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e9ea3a08d044bb973db39b488d959c'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:28.875571 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-94ed90e0-1427-45de-bb68-182b9bafc531 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e9ea3a08d044bb973db39b488d959c'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:28.881145 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-94ed90e0-1427-45de-bb68-182b9bafc531 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e9ea3a08d044bb973db39b488d959c'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:28.893665 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-94ed90e0-1427-45de-bb68-182b9bafc531 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e9ea3a08d044bb973db39b488d959c'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:28.904279 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1403/2809] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:05:28 2022] DELETE /identity/v3/users/a7e9ea3a08d044bb973db39b488d959c => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:29.360937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca74d81-3092-4535-891d-27a8603596c1 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:29.362542 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-2ca74d81-3092-4535-891d-27a8603596c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:29.381428 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca74d81-3092-4535-891d-27a8603596c1 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:29.458148 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131e201-46f4-4253-94e7-c778476067a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:29.459052 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131e201-46f4-4253-94e7-c778476067a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:29.459338 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131e201-46f4-4253-94e7-c778476067a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:29.459962 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131e201-46f4-4253-94e7-c778476067a4 admin admin] PATH_INFO: `/v3/projects/4843b7a7c3dd4f4e8e1a5e7a36775c8e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:29.461841 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131e201-46f4-4253-94e7-c778476067a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4843b7a7c3dd4f4e8e1a5e7a36775c8e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:29.463705 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131e201-46f4-4253-94e7-c778476067a4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:29.576343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:29.596415 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6131e201-46f4-4253-94e7-c778476067a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4843b7a7c3dd4f4e8e1a5e7a36775c8e', 'request_id': 'req-6131e201-46f4-4253-94e7-c778476067a4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:29.603691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6131e201-46f4-4253-94e7-c778476067a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4843b7a7c3dd4f4e8e1a5e7a36775c8e', 'request_id': 'req-6131e201-46f4-4253-94e7-c778476067a4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:29.612190 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6131e201-46f4-4253-94e7-c778476067a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4843b7a7c3dd4f4e8e1a5e7a36775c8e', 'request_id': 'req-6131e201-46f4-4253-94e7-c778476067a4'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:29.666532 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6131e201-46f4-4253-94e7-c778476067a4 admin admin] The token cache is being invalidate because project 4843b7a7c3dd4f4e8e1a5e7a36775c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:05:29.666821 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6131e201-46f4-4253-94e7-c778476067a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:29.667506 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6131e201-46f4-4253-94e7-c778476067a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:29.669098 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1407/2810] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:05:29 2022] DELETE /identity/v3/projects/4843b7a7c3dd4f4e8e1a5e7a36775c8e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:29.674735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c82d5-7278-4c95-9bda-67003446effe None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:29.675258 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c82d5-7278-4c95-9bda-67003446effe None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:29.675362 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c82d5-7278-4c95-9bda-67003446effe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:29.702663 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e88c82d5-7278-4c95-9bda-67003446effe None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:29.702663 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e88c82d5-7278-4c95-9bda-67003446effe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:29.772409 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1404/2811] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:29.781235 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f92f76-7f7c-4759-92b4-6e8bc092e7e9 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:29.781533 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f92f76-7f7c-4759-92b4-6e8bc092e7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:29.781819 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f92f76-7f7c-4759-92b4-6e8bc092e7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:29.805599 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-37f92f76-7f7c-4759-92b4-6e8bc092e7e9 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:29.807424 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-37f92f76-7f7c-4759-92b4-6e8bc092e7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:29.816926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1408/2812] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:29.821863 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c82d5-7278-4c95-9bda-67003446effe None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:29.832355 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88c82d5-7278-4c95-9bda-67003446effe None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:29.837685 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6007ab1-c16a-40ca-93f6-22481fe15b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:29.838371 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6007ab1-c16a-40ca-93f6-22481fe15b5f admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:29.838666 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6007ab1-c16a-40ca-93f6-22481fe15b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:29.838934 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6007ab1-c16a-40ca-93f6-22481fe15b5f admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:29.839672 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6007ab1-c16a-40ca-93f6-22481fe15b5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:05:29.841609 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6007ab1-c16a-40ca-93f6-22481fe15b5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:29.843273 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6007ab1-c16a-40ca-93f6-22481fe15b5f admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:29.856830 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1405/2813] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:05:29.861430 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f92f76-7f7c-4759-92b4-6e8bc092e7e9 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:29.872227 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f92f76-7f7c-4759-92b4-6e8bc092e7e9 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:29.878807 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa57a0-e202-4049-864e-1e9cd3e35cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:29.879514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa57a0-e202-4049-864e-1e9cd3e35cff admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:29.879899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa57a0-e202-4049-864e-1e9cd3e35cff admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:29.880079 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fa57a0-e202-4049-864e-1e9cd3e35cff admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:29.880781 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa57a0-e202-4049-864e-1e9cd3e35cff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:29.885887 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fa57a0-e202-4049-864e-1e9cd3e35cff admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:29.971880 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1409/2814] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:05:29 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:05:29.973168 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6007ab1-c16a-40ca-93f6-22481fe15b5f admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:29.984476 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6007ab1-c16a-40ca-93f6-22481fe15b5f admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:30.021169 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:30.063463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4976c41-1b1d-4b49-b33a-9613db69b4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:30.064241 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4976c41-1b1d-4b49-b33a-9613db69b4bb admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:30.064519 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4976c41-1b1d-4b49-b33a-9613db69b4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:30.064793 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4976c41-1b1d-4b49-b33a-9613db69b4bb admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:30.065602 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4976c41-1b1d-4b49-b33a-9613db69b4bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:30.067427 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4976c41-1b1d-4b49-b33a-9613db69b4bb admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:30.164069 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1406/2815] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:05:29 2022] POST /identity/v3/users => generated 284 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:05:30.168807 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa57a0-e202-4049-864e-1e9cd3e35cff admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:30.179364 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fa57a0-e202-4049-864e-1e9cd3e35cff admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:30.184340 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319c2fa-526c-4e48-ba93-047530ab56d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:30.185004 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319c2fa-526c-4e48-ba93-047530ab56d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:30.185323 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319c2fa-526c-4e48-ba93-047530ab56d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:30.185604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0319c2fa-526c-4e48-ba93-047530ab56d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:30.186343 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319c2fa-526c-4e48-ba93-047530ab56d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:30.187967 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0319c2fa-526c-4e48-ba93-047530ab56d4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:30.199209 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1410/2816] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:30.203435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4976c41-1b1d-4b49-b33a-9613db69b4bb admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:30.214165 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4976c41-1b1d-4b49-b33a-9613db69b4bb admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:30.218890 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df8ace5-a44d-41db-a27c-c9b87eb9c3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:30.219556 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8ace5-a44d-41db-a27c-c9b87eb9c3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:30.219838 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8ace5-a44d-41db-a27c-c9b87eb9c3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:30.220114 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df8ace5-a44d-41db-a27c-c9b87eb9c3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:30.220844 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8ace5-a44d-41db-a27c-c9b87eb9c3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:30.222491 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df8ace5-a44d-41db-a27c-c9b87eb9c3a8 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:30.233836 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1407/2817] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:30.238243 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319c2fa-526c-4e48-ba93-047530ab56d4 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:30.248511 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0319c2fa-526c-4e48-ba93-047530ab56d4 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:30.253497 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73e154-b7b2-4118-9871-e46c33328bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:30.254519 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73e154-b7b2-4118-9871-e46c33328bef admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:30.254802 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73e154-b7b2-4118-9871-e46c33328bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:30.255087 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c73e154-b7b2-4118-9871-e46c33328bef admin admin] PATH_INFO: `/v3/projects/d893646e45ef47c586246dfe4d9f6f0a/users/d51056e71b10404aa1330c44e38be277/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:30.270737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73e154-b7b2-4118-9871-e46c33328bef admin admin] RBAC: Authorizing `identity:create_grant(project_id=d893646e45ef47c586246dfe4d9f6f0a, user_id=d51056e71b10404aa1330c44e38be277, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:30.273410 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c73e154-b7b2-4118-9871-e46c33328bef admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:30.380449 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1411/2818] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:05:30 2022] PUT /identity/v3/projects/d893646e45ef47c586246dfe4d9f6f0a/users/d51056e71b10404aa1330c44e38be277/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:30.392170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a02449-de6b-437a-8c30-a42283030f74 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:30.392466 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a02449-de6b-437a-8c30-a42283030f74 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:30.392750 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a02449-de6b-437a-8c30-a42283030f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:30.421823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-d6a02449-de6b-437a-8c30-a42283030f74 None None] MFA Rules not processed for user `d51056e71b10404aa1330c44e38be277`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:30.422953 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d6a02449-de6b-437a-8c30-a42283030f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:30.487926 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1408/2819] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:05:30 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:30.492568 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73e154-b7b2-4118-9871-e46c33328bef admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:30.554314 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c73e154-b7b2-4118-9871-e46c33328bef admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:30.559733 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea4a85-9875-4bca-ba4b-504b1474aad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:30.560398 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea4a85-9875-4bca-ba4b-504b1474aad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:30.560688 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea4a85-9875-4bca-ba4b-504b1474aad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:30.560970 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feea4a85-9875-4bca-ba4b-504b1474aad7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:30.561699 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea4a85-9875-4bca-ba4b-504b1474aad7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:30.563610 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feea4a85-9875-4bca-ba4b-504b1474aad7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:30.667669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1412/2820] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:05:30 2022] POST /identity/v3/projects => generated 367 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:05:30.672006 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a02449-de6b-437a-8c30-a42283030f74 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:30.683497 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a02449-de6b-437a-8c30-a42283030f74 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:30.739512 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0fe0c-6f7f-47a6-a631-38060232464e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:30.740188 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0fe0c-6f7f-47a6-a631-38060232464e admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:30.740479 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0fe0c-6f7f-47a6-a631-38060232464e admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:30.740749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0fe0c-6f7f-47a6-a631-38060232464e admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:30.741596 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c0fe0c-6f7f-47a6-a631-38060232464e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:30.744124 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c0fe0c-6f7f-47a6-a631-38060232464e admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:30.843268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1409/2821] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:05:30 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:05:30.847486 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea4a85-9875-4bca-ba4b-504b1474aad7 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:30.858271 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feea4a85-9875-4bca-ba4b-504b1474aad7 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:30.862911 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4abeb-c157-401b-9c35-f9ffc768d2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:30.863597 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4abeb-c157-401b-9c35-f9ffc768d2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:30.863883 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4abeb-c157-401b-9c35-f9ffc768d2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:30.864163 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4abeb-c157-401b-9c35-f9ffc768d2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:30.864926 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4abeb-c157-401b-9c35-f9ffc768d2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:30.866549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4abeb-c157-401b-9c35-f9ffc768d2d5 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:30.879014 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1413/2822] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 18 17:05:30.884163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0fe0c-6f7f-47a6-a631-38060232464e admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:30.894822 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0fe0c-6f7f-47a6-a631-38060232464e admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:30.899905 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8726979-d52a-46c3-8428-bbf251e3e7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:30.900832 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8726979-d52a-46c3-8428-bbf251e3e7b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:30.901149 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8726979-d52a-46c3-8428-bbf251e3e7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:30.901430 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8726979-d52a-46c3-8428-bbf251e3e7b0 admin admin] PATH_INFO: `/v3/projects/5868c4c4dc8f4692af97c0cbbb6db250/users/16a4da3d5ac04416a4bed5c4f200c10e/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:30.917055 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8726979-d52a-46c3-8428-bbf251e3e7b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5868c4c4dc8f4692af97c0cbbb6db250, user_id=16a4da3d5ac04416a4bed5c4f200c10e, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:30.919719 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8726979-d52a-46c3-8428-bbf251e3e7b0 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:30.993206 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1410/2823] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:05:30 2022] PUT /identity/v3/projects/5868c4c4dc8f4692af97c0cbbb6db250/users/16a4da3d5ac04416a4bed5c4f200c10e/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:30.996078 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4abeb-c157-401b-9c35-f9ffc768d2d5 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:31.006570 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4abeb-c157-401b-9c35-f9ffc768d2d5 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:31.028945 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:31.067774 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75086e27-4aca-4c97-9d60-458e6f08494b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:31.068528 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75086e27-4aca-4c97-9d60-458e6f08494b admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:31.068771 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75086e27-4aca-4c97-9d60-458e6f08494b admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:31.069077 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75086e27-4aca-4c97-9d60-458e6f08494b admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:31.070175 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75086e27-4aca-4c97-9d60-458e6f08494b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:31.072391 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75086e27-4aca-4c97-9d60-458e6f08494b admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:31.083489 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1414/2824] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:31.088243 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8726979-d52a-46c3-8428-bbf251e3e7b0 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:31.093730 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:31.099049 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8726979-d52a-46c3-8428-bbf251e3e7b0 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:31.103720 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23043352-2a6a-4bc1-99da-08739d1239b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:31.104623 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23043352-2a6a-4bc1-99da-08739d1239b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:31.104901 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23043352-2a6a-4bc1-99da-08739d1239b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:31.105206 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23043352-2a6a-4bc1-99da-08739d1239b1 admin admin] PATH_INFO: `/v3/projects/5868c4c4dc8f4692af97c0cbbb6db250/users/16a4da3d5ac04416a4bed5c4f200c10e/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:31.107163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23043352-2a6a-4bc1-99da-08739d1239b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5868c4c4dc8f4692af97c0cbbb6db250, user_id=16a4da3d5ac04416a4bed5c4f200c10e, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:31.110095 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23043352-2a6a-4bc1-99da-08739d1239b1 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:31.120092 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1411/2825] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:05:31 2022] PUT /identity/v3/projects/5868c4c4dc8f4692af97c0cbbb6db250/users/16a4da3d5ac04416a4bed5c4f200c10e/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:31.130375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184876ad-eb12-4577-bc77-548bee524255 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:31.130675 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184876ad-eb12-4577-bc77-548bee524255 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:31.130998 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184876ad-eb12-4577-bc77-548bee524255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:31.165258 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-184876ad-eb12-4577-bc77-548bee524255 None None] MFA Rules not processed for user `16a4da3d5ac04416a4bed5c4f200c10e`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:31.166487 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-184876ad-eb12-4577-bc77-548bee524255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:31.236103 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1415/2826] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:05:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:31.247734 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23043352-2a6a-4bc1-99da-08739d1239b1 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:31.249463 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-23043352-2a6a-4bc1-99da-08739d1239b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:31.307116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23043352-2a6a-4bc1-99da-08739d1239b1 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:31.310812 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a461c-faca-485a-b8e8-f0c0f00ffa24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:31.311460 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a461c-faca-485a-b8e8-f0c0f00ffa24 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:31.311746 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a461c-faca-485a-b8e8-f0c0f00ffa24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:31.312025 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894a461c-faca-485a-b8e8-f0c0f00ffa24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:31.321804 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a461c-faca-485a-b8e8-f0c0f00ffa24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:31.323350 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894a461c-faca-485a-b8e8-f0c0f00ffa24 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:31.333395 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1412/2827] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:31 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:05:31.548162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184876ad-eb12-4577-bc77-548bee524255 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:31.559218 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184876ad-eb12-4577-bc77-548bee524255 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:31.563160 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b721a098-1dd2-4739-9a8f-d7fe92556aba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:31.563813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721a098-1dd2-4739-9a8f-d7fe92556aba service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:31.564104 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721a098-1dd2-4739-9a8f-d7fe92556aba service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:31.564384 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b721a098-1dd2-4739-9a8f-d7fe92556aba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:31.623907 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721a098-1dd2-4739-9a8f-d7fe92556aba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:31.625386 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b721a098-1dd2-4739-9a8f-d7fe92556aba service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:31.635364 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1416/2828] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:31 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:05:37.223534 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a461c-faca-485a-b8e8-f0c0f00ffa24 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:37.225046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-894a461c-faca-485a-b8e8-f0c0f00ffa24 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:37.291568 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894a461c-faca-485a-b8e8-f0c0f00ffa24 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:37.296325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08071e-7c65-4423-ae59-915eeb81006d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:37.297233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08071e-7c65-4423-ae59-915eeb81006d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:37.297520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08071e-7c65-4423-ae59-915eeb81006d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:37.297794 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08071e-7c65-4423-ae59-915eeb81006d admin admin] PATH_INFO: `/v3/users/94ce2e2151d5438c952d64357109afcb` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:37.298979 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08071e-7c65-4423-ae59-915eeb81006d admin admin] RBAC: Authorizing `identity:delete_user(user_id=94ce2e2151d5438c952d64357109afcb)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:37.300891 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08071e-7c65-4423-ae59-915eeb81006d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:37.513523 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ef08071e-7c65-4423-ae59-915eeb81006d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94ce2e2151d5438c952d64357109afcb'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:37.557220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ef08071e-7c65-4423-ae59-915eeb81006d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94ce2e2151d5438c952d64357109afcb'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:37.565263 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ef08071e-7c65-4423-ae59-915eeb81006d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94ce2e2151d5438c952d64357109afcb'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:37.569139 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ef08071e-7c65-4423-ae59-915eeb81006d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94ce2e2151d5438c952d64357109afcb'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:37.579116 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ef08071e-7c65-4423-ae59-915eeb81006d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94ce2e2151d5438c952d64357109afcb'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:37.585724 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1413/2829] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:05:37 2022] DELETE /identity/v3/users/94ce2e2151d5438c952d64357109afcb => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:37.590632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8af28-e4a3-4699-8326-ea309cbbde0f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:37.591183 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8af28-e4a3-4699-8326-ea309cbbde0f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:37.591183 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8af28-e4a3-4699-8326-ea309cbbde0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:37.609596 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-17e8af28-e4a3-4699-8326-ea309cbbde0f None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:37.610841 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-17e8af28-e4a3-4699-8326-ea309cbbde0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:37.653499 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:37.677345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1417/2830] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:05:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:37.699350 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08071e-7c65-4423-ae59-915eeb81006d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:37.700342 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ef08071e-7c65-4423-ae59-915eeb81006d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:37.716254 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:37.768503 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08071e-7c65-4423-ae59-915eeb81006d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:37.772622 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264701f3-6f9f-45fd-b668-33ade9c20099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:37.773559 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264701f3-6f9f-45fd-b668-33ade9c20099 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:37.773877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264701f3-6f9f-45fd-b668-33ade9c20099 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:37.774307 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264701f3-6f9f-45fd-b668-33ade9c20099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:37.785618 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264701f3-6f9f-45fd-b668-33ade9c20099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:37.787080 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264701f3-6f9f-45fd-b668-33ade9c20099 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:37.798824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1414/2831] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:05:38.221778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8af28-e4a3-4699-8326-ea309cbbde0f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:38.223367 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-17e8af28-e4a3-4699-8326-ea309cbbde0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:38.238385 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8af28-e4a3-4699-8326-ea309cbbde0f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:38.243628 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df767a4-bf50-49f8-a981-f0e949aa1fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:38.245161 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df767a4-bf50-49f8-a981-f0e949aa1fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:38.245524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df767a4-bf50-49f8-a981-f0e949aa1fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:38.245877 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df767a4-bf50-49f8-a981-f0e949aa1fb1 admin admin] PATH_INFO: `/v3/projects/d139aa7382fd41d19f1f2a74c24c2326` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:38.247281 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df767a4-bf50-49f8-a981-f0e949aa1fb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d139aa7382fd41d19f1f2a74c24c2326)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:38.249287 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df767a4-bf50-49f8-a981-f0e949aa1fb1 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:38.370224 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6df767a4-bf50-49f8-a981-f0e949aa1fb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd139aa7382fd41d19f1f2a74c24c2326', 'request_id': 'req-6df767a4-bf50-49f8-a981-f0e949aa1fb1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:38.376920 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6df767a4-bf50-49f8-a981-f0e949aa1fb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd139aa7382fd41d19f1f2a74c24c2326', 'request_id': 'req-6df767a4-bf50-49f8-a981-f0e949aa1fb1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:38.384276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6df767a4-bf50-49f8-a981-f0e949aa1fb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd139aa7382fd41d19f1f2a74c24c2326', 'request_id': 'req-6df767a4-bf50-49f8-a981-f0e949aa1fb1'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:38.429129 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264701f3-6f9f-45fd-b668-33ade9c20099 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:38.430610 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-264701f3-6f9f-45fd-b668-33ade9c20099 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:38.444892 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264701f3-6f9f-45fd-b668-33ade9c20099 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:38.476120 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6df767a4-bf50-49f8-a981-f0e949aa1fb1 admin admin] The token cache is being invalidate because project d139aa7382fd41d19f1f2a74c24c2326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:05:38.476467 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6df767a4-bf50-49f8-a981-f0e949aa1fb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:38.477166 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-6df767a4-bf50-49f8-a981-f0e949aa1fb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:38.482217 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1418/2832] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:05:38 2022] DELETE /identity/v3/projects/d139aa7382fd41d19f1f2a74c24c2326 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:38.506244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c07b91-f32f-4e6b-b9b0-ceb951c78a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:38.508478 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c07b91-f32f-4e6b-b9b0-ceb951c78a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:38.508478 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c07b91-f32f-4e6b-b9b0-ceb951c78a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:38.508478 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c07b91-f32f-4e6b-b9b0-ceb951c78a79 admin admin] PATH_INFO: `/v3/users/d51056e71b10404aa1330c44e38be277` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:38.509298 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c07b91-f32f-4e6b-b9b0-ceb951c78a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d51056e71b10404aa1330c44e38be277)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:38.511629 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c07b91-f32f-4e6b-b9b0-ceb951c78a79 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:38.726396 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-88c07b91-f32f-4e6b-b9b0-ceb951c78a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd51056e71b10404aa1330c44e38be277'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:38.797287 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-88c07b91-f32f-4e6b-b9b0-ceb951c78a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd51056e71b10404aa1330c44e38be277'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:38.804894 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-88c07b91-f32f-4e6b-b9b0-ceb951c78a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd51056e71b10404aa1330c44e38be277'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:38.805582 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-88c07b91-f32f-4e6b-b9b0-ceb951c78a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd51056e71b10404aa1330c44e38be277'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:38.818234 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-88c07b91-f32f-4e6b-b9b0-ceb951c78a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd51056e71b10404aa1330c44e38be277'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:38.824245 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1415/2833] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:05:38 2022] DELETE /identity/v3/users/d51056e71b10404aa1330c44e38be277 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:05:38.828899 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96529898-2fb5-4014-a0fa-98a0003652cc None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:38.829502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96529898-2fb5-4014-a0fa-98a0003652cc None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:38.829502 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96529898-2fb5-4014-a0fa-98a0003652cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:38.848161 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-96529898-2fb5-4014-a0fa-98a0003652cc None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:38.849455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-96529898-2fb5-4014-a0fa-98a0003652cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:38.908336 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1419/2834] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:05:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:38.918735 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c07b91-f32f-4e6b-b9b0-ceb951c78a79 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:38.920196 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-88c07b91-f32f-4e6b-b9b0-ceb951c78a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:38.958392 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:38.979988 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c07b91-f32f-4e6b-b9b0-ceb951c78a79 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:38.983812 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a5656-e51f-48a3-81d0-d504a5488603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:38.984456 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a5656-e51f-48a3-81d0-d504a5488603 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:38.984731 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a5656-e51f-48a3-81d0-d504a5488603 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:38.985004 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a5656-e51f-48a3-81d0-d504a5488603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:38.995422 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a5656-e51f-48a3-81d0-d504a5488603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:38.996841 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a5656-e51f-48a3-81d0-d504a5488603 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:39.006301 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1416/2835] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:05:39.473109 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96529898-2fb5-4014-a0fa-98a0003652cc None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:39.474575 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-96529898-2fb5-4014-a0fa-98a0003652cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:39.491978 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96529898-2fb5-4014-a0fa-98a0003652cc None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:39.506938 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce200e87-1547-41d3-8865-6905d17ea792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:39.508209 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce200e87-1547-41d3-8865-6905d17ea792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:39.508514 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce200e87-1547-41d3-8865-6905d17ea792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:39.508796 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce200e87-1547-41d3-8865-6905d17ea792 admin admin] PATH_INFO: `/v3/projects/d893646e45ef47c586246dfe4d9f6f0a` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:39.510425 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce200e87-1547-41d3-8865-6905d17ea792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d893646e45ef47c586246dfe4d9f6f0a)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:39.512406 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce200e87-1547-41d3-8865-6905d17ea792 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:39.616186 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ce200e87-1547-41d3-8865-6905d17ea792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd893646e45ef47c586246dfe4d9f6f0a', 'request_id': 'req-ce200e87-1547-41d3-8865-6905d17ea792'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:39.623534 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ce200e87-1547-41d3-8865-6905d17ea792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd893646e45ef47c586246dfe4d9f6f0a', 'request_id': 'req-ce200e87-1547-41d3-8865-6905d17ea792'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:39.630372 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ce200e87-1547-41d3-8865-6905d17ea792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd893646e45ef47c586246dfe4d9f6f0a', 'request_id': 'req-ce200e87-1547-41d3-8865-6905d17ea792'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:39.632036 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:39.727733 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ce200e87-1547-41d3-8865-6905d17ea792 admin admin] The token cache is being invalidate because project d893646e45ef47c586246dfe4d9f6f0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:05:39.730747 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ce200e87-1547-41d3-8865-6905d17ea792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:39.730747 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-ce200e87-1547-41d3-8865-6905d17ea792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:39.731152 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1420/2836] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:05:39 2022] DELETE /identity/v3/projects/d893646e45ef47c586246dfe4d9f6f0a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:39.735766 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a5656-e51f-48a3-81d0-d504a5488603 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:39.747325 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a5656-e51f-48a3-81d0-d504a5488603 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:39.805437 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1b240f-fbc9-4762-af23-89a7eb384300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:39.806351 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b240f-fbc9-4762-af23-89a7eb384300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:39.806634 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b240f-fbc9-4762-af23-89a7eb384300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:39.806912 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1b240f-fbc9-4762-af23-89a7eb384300 admin admin] PATH_INFO: `/v3/users/16a4da3d5ac04416a4bed5c4f200c10e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:39.808815 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b240f-fbc9-4762-af23-89a7eb384300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16a4da3d5ac04416a4bed5c4f200c10e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:39.810964 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1b240f-fbc9-4762-af23-89a7eb384300 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:39.999374 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ce1b240f-fbc9-4762-af23-89a7eb384300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16a4da3d5ac04416a4bed5c4f200c10e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:40.071339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ce1b240f-fbc9-4762-af23-89a7eb384300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16a4da3d5ac04416a4bed5c4f200c10e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:40.079168 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ce1b240f-fbc9-4762-af23-89a7eb384300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16a4da3d5ac04416a4bed5c4f200c10e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:40.079943 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ce1b240f-fbc9-4762-af23-89a7eb384300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16a4da3d5ac04416a4bed5c4f200c10e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:40.092681 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ce1b240f-fbc9-4762-af23-89a7eb384300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16a4da3d5ac04416a4bed5c4f200c10e'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:40.099013 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1417/2837] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:05:39 2022] DELETE /identity/v3/users/16a4da3d5ac04416a4bed5c4f200c10e => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:40.485295 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce200e87-1547-41d3-8865-6905d17ea792 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:40.486759 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ce200e87-1547-41d3-8865-6905d17ea792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:40.500810 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce200e87-1547-41d3-8865-6905d17ea792 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:40.562017 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa428a2-da45-4ead-93ee-6b460dcfbb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:40.562805 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa428a2-da45-4ead-93ee-6b460dcfbb69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:40.563088 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa428a2-da45-4ead-93ee-6b460dcfbb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:40.563369 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa428a2-da45-4ead-93ee-6b460dcfbb69 admin admin] PATH_INFO: `/v3/projects/5868c4c4dc8f4692af97c0cbbb6db250` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:40.564559 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa428a2-da45-4ead-93ee-6b460dcfbb69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5868c4c4dc8f4692af97c0cbbb6db250)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:40.566500 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa428a2-da45-4ead-93ee-6b460dcfbb69 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:40.647931 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0aa428a2-da45-4ead-93ee-6b460dcfbb69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5868c4c4dc8f4692af97c0cbbb6db250', 'request_id': 'req-0aa428a2-da45-4ead-93ee-6b460dcfbb69'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:40.654402 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0aa428a2-da45-4ead-93ee-6b460dcfbb69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5868c4c4dc8f4692af97c0cbbb6db250', 'request_id': 'req-0aa428a2-da45-4ead-93ee-6b460dcfbb69'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:40.660108 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0aa428a2-da45-4ead-93ee-6b460dcfbb69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5868c4c4dc8f4692af97c0cbbb6db250', 'request_id': 'req-0aa428a2-da45-4ead-93ee-6b460dcfbb69'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:40.722284 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0aa428a2-da45-4ead-93ee-6b460dcfbb69 admin admin] The token cache is being invalidate because project 5868c4c4dc8f4692af97c0cbbb6db250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:05:40.722585 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0aa428a2-da45-4ead-93ee-6b460dcfbb69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:40.723236 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-0aa428a2-da45-4ead-93ee-6b460dcfbb69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:05:40.724930 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1421/2838] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:05:40 2022] DELETE /identity/v3/projects/5868c4c4dc8f4692af97c0cbbb6db250 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:40.730499 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f7577-0b0d-4e77-80d9-f60e864f6442 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:40.735729 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f7577-0b0d-4e77-80d9-f60e864f6442 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:40.735729 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f7577-0b0d-4e77-80d9-f60e864f6442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:40.749512 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-4d0f7577-0b0d-4e77-80d9-f60e864f6442 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:40.753477 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4d0f7577-0b0d-4e77-80d9-f60e864f6442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:40.801392 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:40.813029 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1418/2839] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:40.822037 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecefe2-48f9-4c6d-9bf9-3be773bdf365 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:40.822687 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecefe2-48f9-4c6d-9bf9-3be773bdf365 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:40.822687 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cecefe2-48f9-4c6d-9bf9-3be773bdf365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:40.842299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-4cecefe2-48f9-4c6d-9bf9-3be773bdf365 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:40.843510 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-4cecefe2-48f9-4c6d-9bf9-3be773bdf365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:40.851933 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1422/2840] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:05:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:40.856900 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f7577-0b0d-4e77-80d9-f60e864f6442 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:40.866824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f7577-0b0d-4e77-80d9-f60e864f6442 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:40.871744 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb71a99-4f97-43b5-9132-83c0a89cbd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:40.872414 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb71a99-4f97-43b5-9132-83c0a89cbd12 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:40.872691 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb71a99-4f97-43b5-9132-83c0a89cbd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:40.872966 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb71a99-4f97-43b5-9132-83c0a89cbd12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:40.873783 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb71a99-4f97-43b5-9132-83c0a89cbd12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:05:40.874083 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb71a99-4f97-43b5-9132-83c0a89cbd12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:40.875694 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb71a99-4f97-43b5-9132-83c0a89cbd12 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:40.888170 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1419/2841] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:05:40.892436 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecefe2-48f9-4c6d-9bf9-3be773bdf365 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:40.902146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cecefe2-48f9-4c6d-9bf9-3be773bdf365 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:40.907429 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc25274-cae3-44fa-8e11-5d63dd632ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:40.908095 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc25274-cae3-44fa-8e11-5d63dd632ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:40.908426 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc25274-cae3-44fa-8e11-5d63dd632ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:40.908747 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc25274-cae3-44fa-8e11-5d63dd632ba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:40.909479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc25274-cae3-44fa-8e11-5d63dd632ba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:40.911369 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc25274-cae3-44fa-8e11-5d63dd632ba0 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:40.992784 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1423/2842] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:05:40 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:05:40.997131 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb71a99-4f97-43b5-9132-83c0a89cbd12 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:41.007163 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb71a99-4f97-43b5-9132-83c0a89cbd12 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:41.063937 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a9da7-180b-4b43-9b9f-9034a26be0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:41.064535 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a9da7-180b-4b43-9b9f-9034a26be0f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:41.064824 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a9da7-180b-4b43-9b9f-9034a26be0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:41.065138 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a9da7-180b-4b43-9b9f-9034a26be0f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:41.065848 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a9da7-180b-4b43-9b9f-9034a26be0f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:41.067771 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5a9da7-180b-4b43-9b9f-9034a26be0f2 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:41.163044 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1420/2843] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:05:40 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:05:41.167225 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc25274-cae3-44fa-8e11-5d63dd632ba0 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:41.177956 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc25274-cae3-44fa-8e11-5d63dd632ba0 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:41.182951 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433e65b-13b8-4df6-b5c4-157a1e94d317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:41.183546 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433e65b-13b8-4df6-b5c4-157a1e94d317 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:41.183838 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433e65b-13b8-4df6-b5c4-157a1e94d317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:41.184122 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433e65b-13b8-4df6-b5c4-157a1e94d317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:41.185003 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433e65b-13b8-4df6-b5c4-157a1e94d317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:41.186649 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e433e65b-13b8-4df6-b5c4-157a1e94d317 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:41.197278 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1424/2844] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:41.201769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a9da7-180b-4b43-9b9f-9034a26be0f2 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:41.211769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a9da7-180b-4b43-9b9f-9034a26be0f2 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:41.217153 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dd6cb-5346-483c-97d0-33b724b651e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:41.217815 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dd6cb-5346-483c-97d0-33b724b651e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:41.218102 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dd6cb-5346-483c-97d0-33b724b651e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:41.218382 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dd6cb-5346-483c-97d0-33b724b651e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:41.219108 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dd6cb-5346-483c-97d0-33b724b651e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:41.220699 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dd6cb-5346-483c-97d0-33b724b651e8 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:41.231215 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1421/2845] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:05:41.235632 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433e65b-13b8-4df6-b5c4-157a1e94d317 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:41.245916 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433e65b-13b8-4df6-b5c4-157a1e94d317 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:41.250511 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd16cba-6b99-4d2d-8b04-907ca414d616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:41.251378 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd16cba-6b99-4d2d-8b04-907ca414d616 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:41.251660 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd16cba-6b99-4d2d-8b04-907ca414d616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:41.251937 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd16cba-6b99-4d2d-8b04-907ca414d616 admin admin] PATH_INFO: `/v3/projects/f8d21ecb63e544848dd5e1d8d53856b9/users/1eecca9883394e74a52e835ad3528630/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:41.266940 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd16cba-6b99-4d2d-8b04-907ca414d616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d21ecb63e544848dd5e1d8d53856b9, user_id=1eecca9883394e74a52e835ad3528630, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:41.269694 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd16cba-6b99-4d2d-8b04-907ca414d616 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:41.392391 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1425/2846] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:05:41 2022] PUT /identity/v3/projects/f8d21ecb63e544848dd5e1d8d53856b9/users/1eecca9883394e74a52e835ad3528630/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:05:41.455928 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8c079-d820-4a39-8385-3249869c0846 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:41.456220 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8c079-d820-4a39-8385-3249869c0846 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:41.456500 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c8c079-d820-4a39-8385-3249869c0846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:41.485366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-51c8c079-d820-4a39-8385-3249869c0846 None None] MFA Rules not processed for user `1eecca9883394e74a52e835ad3528630`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:05:41.486579 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-51c8c079-d820-4a39-8385-3249869c0846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:41.549885 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1422/2847] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:05:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:05:41.562524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd16cba-6b99-4d2d-8b04-907ca414d616 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:05:41.564231 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-ecd16cba-6b99-4d2d-8b04-907ca414d616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:05:41.585308 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:41.623935 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd16cba-6b99-4d2d-8b04-907ca414d616 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:05:41.627678 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f77e686-58ea-4586-9874-3be7fda3915f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:05:41.628328 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77e686-58ea-4586-9874-3be7fda3915f service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:05:41.628614 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77e686-58ea-4586-9874-3be7fda3915f service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:05:41.628895 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77e686-58ea-4586-9874-3be7fda3915f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:05:41.638889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77e686-58ea-4586-9874-3be7fda3915f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:05:41.640367 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f77e686-58ea-4586-9874-3be7fda3915f service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:05:41.651041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1426/2848] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:05:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:05:51.546764 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=74,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:05:51.653889 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=18 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:07.071522 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8c079-d820-4a39-8385-3249869c0846 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:07.135659 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c8c079-d820-4a39-8385-3249869c0846 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:07.140836 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afff16-908b-45f1-accf-3a019389ff55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:07.141757 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afff16-908b-45f1-accf-3a019389ff55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:07.142040 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afff16-908b-45f1-accf-3a019389ff55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:07.142315 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4afff16-908b-45f1-accf-3a019389ff55 admin admin] PATH_INFO: `/v3/users/1eecca9883394e74a52e835ad3528630` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:07.143501 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afff16-908b-45f1-accf-3a019389ff55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eecca9883394e74a52e835ad3528630)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:07.145454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4afff16-908b-45f1-accf-3a019389ff55 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:07.290060 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a4afff16-908b-45f1-accf-3a019389ff55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eecca9883394e74a52e835ad3528630'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:07.355756 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a4afff16-908b-45f1-accf-3a019389ff55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eecca9883394e74a52e835ad3528630'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:07.364435 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a4afff16-908b-45f1-accf-3a019389ff55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eecca9883394e74a52e835ad3528630'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:07.366962 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a4afff16-908b-45f1-accf-3a019389ff55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eecca9883394e74a52e835ad3528630'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:07.377288 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-a4afff16-908b-45f1-accf-3a019389ff55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eecca9883394e74a52e835ad3528630'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:07.383126 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1423/2849] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:06:07 2022] DELETE /identity/v3/users/1eecca9883394e74a52e835ad3528630 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:06:07.387572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f6c5d-0a3b-4694-861c-a9ed57538b09 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:07.388090 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f6c5d-0a3b-4694-861c-a9ed57538b09 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:07.388206 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f6c5d-0a3b-4694-861c-a9ed57538b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:07.404760 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-795f6c5d-0a3b-4694-861c-a9ed57538b09 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:06:07.406542 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-795f6c5d-0a3b-4694-861c-a9ed57538b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:07.465053 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1427/2850] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:06:07.476852 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afff16-908b-45f1-accf-3a019389ff55 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:07.478294 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-a4afff16-908b-45f1-accf-3a019389ff55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:07.536520 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4afff16-908b-45f1-accf-3a019389ff55 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:07.540202 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fad90f-4279-430a-a984-bf37d3f3f08f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:07.540857 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fad90f-4279-430a-a984-bf37d3f3f08f service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:07.541173 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fad90f-4279-430a-a984-bf37d3f3f08f service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:07.541454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fad90f-4279-430a-a984-bf37d3f3f08f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:07.551270 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fad90f-4279-430a-a984-bf37d3f3f08f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:07.552697 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fad90f-4279-430a-a984-bf37d3f3f08f service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:07.562584 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1424/2851] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:06:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:06:07.969199 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f6c5d-0a3b-4694-861c-a9ed57538b09 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:07.973142 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-795f6c5d-0a3b-4694-861c-a9ed57538b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:07.982742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f6c5d-0a3b-4694-861c-a9ed57538b09 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:07.988999 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55978bb-2191-4131-a49c-a653ecdf4031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:07.990242 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55978bb-2191-4131-a49c-a653ecdf4031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:07.991356 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55978bb-2191-4131-a49c-a653ecdf4031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:07.991356 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55978bb-2191-4131-a49c-a653ecdf4031 admin admin] PATH_INFO: `/v3/projects/f8d21ecb63e544848dd5e1d8d53856b9` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:07.992505 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55978bb-2191-4131-a49c-a653ecdf4031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8d21ecb63e544848dd5e1d8d53856b9)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:07.994621 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55978bb-2191-4131-a49c-a653ecdf4031 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:08.088526 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e55978bb-2191-4131-a49c-a653ecdf4031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d21ecb63e544848dd5e1d8d53856b9', 'request_id': 'req-e55978bb-2191-4131-a49c-a653ecdf4031'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:08.095214 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e55978bb-2191-4131-a49c-a653ecdf4031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d21ecb63e544848dd5e1d8d53856b9', 'request_id': 'req-e55978bb-2191-4131-a49c-a653ecdf4031'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:08.101105 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e55978bb-2191-4131-a49c-a653ecdf4031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d21ecb63e544848dd5e1d8d53856b9', 'request_id': 'req-e55978bb-2191-4131-a49c-a653ecdf4031'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:08.145161 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e55978bb-2191-4131-a49c-a653ecdf4031 admin admin] The token cache is being invalidate because project f8d21ecb63e544848dd5e1d8d53856b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80508) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:06:08.145458 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e55978bb-2191-4131-a49c-a653ecdf4031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:08.146111 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-e55978bb-2191-4131-a49c-a653ecdf4031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:08.147953 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1428/2852] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:06:07 2022] DELETE /identity/v3/projects/f8d21ecb63e544848dd5e1d8d53856b9 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:06:08.153351 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858a78b-4ff3-41dc-b52f-50c049692b2c None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:08.153850 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858a78b-4ff3-41dc-b52f-50c049692b2c None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:08.153965 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858a78b-4ff3-41dc-b52f-50c049692b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:08.172309 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-2858a78b-4ff3-41dc-b52f-50c049692b2c None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:06:08.173566 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-2858a78b-4ff3-41dc-b52f-50c049692b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:08.191741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:08.235477 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1425/2853] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:06:08.243564 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757a698-ea65-4d30-94e4-6a3d01bc6fd8 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:08.243856 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757a698-ea65-4d30-94e4-6a3d01bc6fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:08.244140 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8757a698-ea65-4d30-94e4-6a3d01bc6fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:08.265408 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8757a698-ea65-4d30-94e4-6a3d01bc6fd8 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:06:08.266634 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8757a698-ea65-4d30-94e4-6a3d01bc6fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:08.274902 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1429/2854] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:06:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:06:08.279351 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858a78b-4ff3-41dc-b52f-50c049692b2c None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:08.289226 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858a78b-4ff3-41dc-b52f-50c049692b2c None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:08.293809 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd49f0-955a-4e40-9c45-c695e153c670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:08.294473 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd49f0-955a-4e40-9c45-c695e153c670 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:08.294760 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd49f0-955a-4e40-9c45-c695e153c670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:08.295040 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd49f0-955a-4e40-9c45-c695e153c670 admin admin] PATH_INFO: `/v3/domains` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:08.295810 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd49f0-955a-4e40-9c45-c695e153c670 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80507) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:06:08.296123 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd49f0-955a-4e40-9c45-c695e153c670 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:08.297768 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd49f0-955a-4e40-9c45-c695e153c670 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:08.309175 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1426/2855] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:06:08.314389 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757a698-ea65-4d30-94e4-6a3d01bc6fd8 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:08.323847 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8757a698-ea65-4d30-94e4-6a3d01bc6fd8 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:08.328993 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cd8ff-fe2c-4d0f-b976-6b824ed76730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:08.329669 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cd8ff-fe2c-4d0f-b976-6b824ed76730 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:08.329977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cd8ff-fe2c-4d0f-b976-6b824ed76730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:08.330259 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cd8ff-fe2c-4d0f-b976-6b824ed76730 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:08.330948 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20cd8ff-fe2c-4d0f-b976-6b824ed76730 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:08.332836 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20cd8ff-fe2c-4d0f-b976-6b824ed76730 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:08.443375 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1430/2856] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:06:08 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:06:08.447751 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd49f0-955a-4e40-9c45-c695e153c670 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:08.458128 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd49f0-955a-4e40-9c45-c695e153c670 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:08.514591 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae4d57-8188-4c82-8355-2a83e70b3190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:08.515354 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae4d57-8188-4c82-8355-2a83e70b3190 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:08.515638 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae4d57-8188-4c82-8355-2a83e70b3190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:08.515917 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae4d57-8188-4c82-8355-2a83e70b3190 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:08.516613 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae4d57-8188-4c82-8355-2a83e70b3190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:08.518549 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae4d57-8188-4c82-8355-2a83e70b3190 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:08.584962 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1427/2857] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:06:08 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:06:08.589139 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cd8ff-fe2c-4d0f-b976-6b824ed76730 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:08.599873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cd8ff-fe2c-4d0f-b976-6b824ed76730 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:08.604437 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552de5d7-76a3-4613-a6e4-6f5ccbfff482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:08.605140 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552de5d7-76a3-4613-a6e4-6f5ccbfff482 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:08.605436 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552de5d7-76a3-4613-a6e4-6f5ccbfff482 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:08.605716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552de5d7-76a3-4613-a6e4-6f5ccbfff482 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:08.606448 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552de5d7-76a3-4613-a6e4-6f5ccbfff482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:08.608813 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552de5d7-76a3-4613-a6e4-6f5ccbfff482 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:08.619363 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1431/2858] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:06:08.623362 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae4d57-8188-4c82-8355-2a83e70b3190 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:08.634043 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae4d57-8188-4c82-8355-2a83e70b3190 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:08.638901 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308c5e1-5f62-4bbe-9abf-f2f628b5d7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:08.639570 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308c5e1-5f62-4bbe-9abf-f2f628b5d7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:08.639882 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308c5e1-5f62-4bbe-9abf-f2f628b5d7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:08.640150 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308c5e1-5f62-4bbe-9abf-f2f628b5d7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:08.640899 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308c5e1-5f62-4bbe-9abf-f2f628b5d7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:08.642563 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308c5e1-5f62-4bbe-9abf-f2f628b5d7f5 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:08.652823 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1428/2859] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:06:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:06:08.657455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552de5d7-76a3-4613-a6e4-6f5ccbfff482 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:08.667286 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552de5d7-76a3-4613-a6e4-6f5ccbfff482 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:08.672702 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d05d3a-8f46-48e5-bc90-523d7de8ea49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:08.673627 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d05d3a-8f46-48e5-bc90-523d7de8ea49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:08.673908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d05d3a-8f46-48e5-bc90-523d7de8ea49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:08.674185 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d05d3a-8f46-48e5-bc90-523d7de8ea49 admin admin] PATH_INFO: `/v3/projects/a08ad55ed1fe4f2fa1a7ebeab461a117/users/aee1461e8eab4f47b4c75c78eb854f58/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:08.689470 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d05d3a-8f46-48e5-bc90-523d7de8ea49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a08ad55ed1fe4f2fa1a7ebeab461a117, user_id=aee1461e8eab4f47b4c75c78eb854f58, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:08.692102 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d05d3a-8f46-48e5-bc90-523d7de8ea49 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:08.790828 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1432/2860] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:06:08 2022] PUT /identity/v3/projects/a08ad55ed1fe4f2fa1a7ebeab461a117/users/aee1461e8eab4f47b4c75c78eb854f58/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:06:08.802459 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929976ea-72ce-40c2-a548-561c407fd3bf None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:08.802749 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929976ea-72ce-40c2-a548-561c407fd3bf None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:08.803031 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929976ea-72ce-40c2-a548-561c407fd3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:08.831966 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-929976ea-72ce-40c2-a548-561c407fd3bf None None] MFA Rules not processed for user `aee1461e8eab4f47b4c75c78eb854f58`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:06:08.833359 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-929976ea-72ce-40c2-a548-561c407fd3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:08.903141 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1429/2861] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:06:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:06:08.908557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d05d3a-8f46-48e5-bc90-523d7de8ea49 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:08.931395 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:08.973291 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d05d3a-8f46-48e5-bc90-523d7de8ea49 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:08.977974 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10544df6-12b6-4c9a-afd5-2b8caafbc762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:08.980055 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10544df6-12b6-4c9a-afd5-2b8caafbc762 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:08.980055 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10544df6-12b6-4c9a-afd5-2b8caafbc762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:08.980055 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10544df6-12b6-4c9a-afd5-2b8caafbc762 admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:08.980055 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10544df6-12b6-4c9a-afd5-2b8caafbc762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:08.981770 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10544df6-12b6-4c9a-afd5-2b8caafbc762 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:09.060325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1433/2862] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:06:08 2022] POST /identity/v3/projects => generated 385 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:06:09.064724 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929976ea-72ce-40c2-a548-561c407fd3bf None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:09.075806 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929976ea-72ce-40c2-a548-561c407fd3bf None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:09.088640 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:09.145203 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913e0bf-4809-4f3b-9b81-eb33a5a02ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:09.145886 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913e0bf-4809-4f3b-9b81-eb33a5a02ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:09.146171 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913e0bf-4809-4f3b-9b81-eb33a5a02ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:09.146448 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0913e0bf-4809-4f3b-9b81-eb33a5a02ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:09.147140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913e0bf-4809-4f3b-9b81-eb33a5a02ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:09.149126 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0913e0bf-4809-4f3b-9b81-eb33a5a02ce9 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:09.219606 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1430/2863] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:06:09 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:06:09.223695 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10544df6-12b6-4c9a-afd5-2b8caafbc762 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:09.234578 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10544df6-12b6-4c9a-afd5-2b8caafbc762 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:09.239273 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b15f35-2e23-4819-a562-d96e54ecf0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:09.240775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b15f35-2e23-4819-a562-d96e54ecf0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:09.240775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b15f35-2e23-4819-a562-d96e54ecf0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:09.240775 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b15f35-2e23-4819-a562-d96e54ecf0b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:09.241318 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b15f35-2e23-4819-a562-d96e54ecf0b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:09.242921 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b15f35-2e23-4819-a562-d96e54ecf0b7 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:09.253692 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1434/2864] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:06:09.257877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913e0bf-4809-4f3b-9b81-eb33a5a02ce9 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:09.268854 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0913e0bf-4809-4f3b-9b81-eb33a5a02ce9 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:09.273861 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30716313-30ea-4121-a7c9-51cc14ab2f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:09.274531 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30716313-30ea-4121-a7c9-51cc14ab2f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:09.274819 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30716313-30ea-4121-a7c9-51cc14ab2f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:09.275125 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30716313-30ea-4121-a7c9-51cc14ab2f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:09.275887 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30716313-30ea-4121-a7c9-51cc14ab2f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:09.277529 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30716313-30ea-4121-a7c9-51cc14ab2f05 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:09.288369 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1431/2865] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:06:09.292389 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b15f35-2e23-4819-a562-d96e54ecf0b7 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:09.302325 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b15f35-2e23-4819-a562-d96e54ecf0b7 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:09.306860 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e65779-865e-4c98-81dc-fbf36a422539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:09.307735 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e65779-865e-4c98-81dc-fbf36a422539 admin admin] REQUEST_METHOD: `PUT` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:09.308022 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e65779-865e-4c98-81dc-fbf36a422539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:09.308299 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e65779-865e-4c98-81dc-fbf36a422539 admin admin] PATH_INFO: `/v3/projects/b8ddf17363d44735a98dd567ca0176db/users/dd88641cbe1e42499d82f7597aacef11/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:09.323020 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e65779-865e-4c98-81dc-fbf36a422539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ddf17363d44735a98dd567ca0176db, user_id=dd88641cbe1e42499d82f7597aacef11, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:09.325626 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e65779-865e-4c98-81dc-fbf36a422539 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:09.390751 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1435/2866] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:06:09 2022] PUT /identity/v3/projects/b8ddf17363d44735a98dd567ca0176db/users/dd88641cbe1e42499d82f7597aacef11/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:06:09.401135 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3064235-dbdc-4ad6-91fe-6a0200a64ce3 None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:09.401446 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3064235-dbdc-4ad6-91fe-6a0200a64ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:09.401724 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3064235-dbdc-4ad6-91fe-6a0200a64ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:09.427994 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-e3064235-dbdc-4ad6-91fe-6a0200a64ce3 None None] MFA Rules not processed for user `dd88641cbe1e42499d82f7597aacef11`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:06:09.429865 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-e3064235-dbdc-4ad6-91fe-6a0200a64ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:09.501923 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1432/2867] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:06:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:06:09.506768 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e65779-865e-4c98-81dc-fbf36a422539 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:09.570778 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e65779-865e-4c98-81dc-fbf36a422539 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:09.575702 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befafac-aaa4-41b0-be55-015b0068e76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:09.576374 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befafac-aaa4-41b0-be55-015b0068e76f admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:09.576641 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befafac-aaa4-41b0-be55-015b0068e76f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:09.577580 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2befafac-aaa4-41b0-be55-015b0068e76f admin admin] PATH_INFO: `/v3/projects` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:09.579032 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befafac-aaa4-41b0-be55-015b0068e76f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:09.580980 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2befafac-aaa4-41b0-be55-015b0068e76f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:09.648804 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1436/2868] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:06:09 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:06:09.652872 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3064235-dbdc-4ad6-91fe-6a0200a64ce3 None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:09.663769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3064235-dbdc-4ad6-91fe-6a0200a64ce3 None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:09.721684 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac5598-50dd-4535-a94f-45233e758a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:09.722412 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac5598-50dd-4535-a94f-45233e758a3a admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:09.722705 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac5598-50dd-4535-a94f-45233e758a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:09.722977 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac5598-50dd-4535-a94f-45233e758a3a admin admin] PATH_INFO: `/v3/users` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:09.723686 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac5598-50dd-4535-a94f-45233e758a3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:09.725646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac5598-50dd-4535-a94f-45233e758a3a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:09.819650 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1433/2869] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:06:09 2022] POST /identity/v3/users => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:06:09.823793 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befafac-aaa4-41b0-be55-015b0068e76f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:09.835276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2befafac-aaa4-41b0-be55-015b0068e76f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:09.840024 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047affe3-b016-4b38-b35d-69f5a22fc3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:09.840690 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047affe3-b016-4b38-b35d-69f5a22fc3b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:09.840977 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047affe3-b016-4b38-b35d-69f5a22fc3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:09.841330 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047affe3-b016-4b38-b35d-69f5a22fc3b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:09.842069 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047affe3-b016-4b38-b35d-69f5a22fc3b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:09.844779 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047affe3-b016-4b38-b35d-69f5a22fc3b2 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:09.855072 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1437/2870] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:06:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:06:09.860244 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac5598-50dd-4535-a94f-45233e758a3a admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:09.870646 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac5598-50dd-4535-a94f-45233e758a3a admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:09.876330 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127fe48-5285-4f83-8814-37d0b3a539fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:09.877268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127fe48-5285-4f83-8814-37d0b3a539fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:09.877556 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127fe48-5285-4f83-8814-37d0b3a539fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:09.877833 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127fe48-5285-4f83-8814-37d0b3a539fa admin admin] PATH_INFO: `/v3/projects/e4d3c12ddfc840e9b611ea342233e6e6/users/49b196e273154f4c96c8e28e65ea8fef/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:09.891202 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:09.894297 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127fe48-5285-4f83-8814-37d0b3a539fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d3c12ddfc840e9b611ea342233e6e6, user_id=49b196e273154f4c96c8e28e65ea8fef, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:09.896999 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127fe48-5285-4f83-8814-37d0b3a539fa admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:10.025685 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1434/2871] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:06:09 2022] PUT /identity/v3/projects/e4d3c12ddfc840e9b611ea342233e6e6/users/49b196e273154f4c96c8e28e65ea8fef/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:06:10.029698 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047affe3-b016-4b38-b35d-69f5a22fc3b2 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:10.040168 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047affe3-b016-4b38-b35d-69f5a22fc3b2 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:10.082166 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:10.097038 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a0628-5514-4803-b6ee-7f6cb7edd21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:10.097651 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a0628-5514-4803-b6ee-7f6cb7edd21e admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:10.097941 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a0628-5514-4803-b6ee-7f6cb7edd21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:10.098228 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a0628-5514-4803-b6ee-7f6cb7edd21e admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:10.098961 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a0628-5514-4803-b6ee-7f6cb7edd21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:10.100572 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a0628-5514-4803-b6ee-7f6cb7edd21e admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:10.111549 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1438/2872] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:06:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:06:10.115756 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127fe48-5285-4f83-8814-37d0b3a539fa admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:10.126754 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127fe48-5285-4f83-8814-37d0b3a539fa admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:10.131430 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16266aba-239a-423a-9dfc-9363ff9050e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:10.132429 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16266aba-239a-423a-9dfc-9363ff9050e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:10.132745 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16266aba-239a-423a-9dfc-9363ff9050e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:10.133100 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16266aba-239a-423a-9dfc-9363ff9050e1 admin admin] PATH_INFO: `/v3/projects/e4d3c12ddfc840e9b611ea342233e6e6/users/49b196e273154f4c96c8e28e65ea8fef/roles/c2d5d80485df4730903a874937d68aa3` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:10.135178 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16266aba-239a-423a-9dfc-9363ff9050e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d3c12ddfc840e9b611ea342233e6e6, user_id=49b196e273154f4c96c8e28e65ea8fef, role_id=c2d5d80485df4730903a874937d68aa3)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:10.137877 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16266aba-239a-423a-9dfc-9363ff9050e1 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:10.148538 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1435/2873] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:06:10 2022] PUT /identity/v3/projects/e4d3c12ddfc840e9b611ea342233e6e6/users/49b196e273154f4c96c8e28e65ea8fef/roles/c2d5d80485df4730903a874937d68aa3 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:06:10.158791 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468e146-7f09-4dc7-8516-15d3d22fb645 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:10.159082 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468e146-7f09-4dc7-8516-15d3d22fb645 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:10.159364 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f468e146-7f09-4dc7-8516-15d3d22fb645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:10.187276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-f468e146-7f09-4dc7-8516-15d3d22fb645 None None] MFA Rules not processed for user `49b196e273154f4c96c8e28e65ea8fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:06:10.188530 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f468e146-7f09-4dc7-8516-15d3d22fb645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:10.259873 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1439/2874] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:06:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:06:10.272450 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16266aba-239a-423a-9dfc-9363ff9050e1 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:10.274267 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-16266aba-239a-423a-9dfc-9363ff9050e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:10.332020 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16266aba-239a-423a-9dfc-9363ff9050e1 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:10.335790 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776da670-5e1a-4156-99b6-271a93ff2353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:10.336444 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776da670-5e1a-4156-99b6-271a93ff2353 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:10.336732 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776da670-5e1a-4156-99b6-271a93ff2353 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:10.337046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776da670-5e1a-4156-99b6-271a93ff2353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:10.394213 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776da670-5e1a-4156-99b6-271a93ff2353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:10.395612 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776da670-5e1a-4156-99b6-271a93ff2353 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:10.404533 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1436/2875] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:06:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:06:12.407808 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468e146-7f09-4dc7-8516-15d3d22fb645 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:12.409268 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f468e146-7f09-4dc7-8516-15d3d22fb645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:12.421348 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f468e146-7f09-4dc7-8516-15d3d22fb645 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:12.424928 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea8f6d-8865-48db-bf41-2e6d467f82d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:12.425609 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea8f6d-8865-48db-bf41-2e6d467f82d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:12.425900 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea8f6d-8865-48db-bf41-2e6d467f82d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:12.426188 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cea8f6d-8865-48db-bf41-2e6d467f82d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:12.483655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea8f6d-8865-48db-bf41-2e6d467f82d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:12.485142 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cea8f6d-8865-48db-bf41-2e6d467f82d4 service cinder] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:12.494050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1440/2876] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:06:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:06:13.703540 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776da670-5e1a-4156-99b6-271a93ff2353 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:13.712509 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776da670-5e1a-4156-99b6-271a93ff2353 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:13.716374 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7869828a-3fc8-4821-8294-02e95d684e6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:13.717065 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869828a-3fc8-4821-8294-02e95d684e6a service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:13.718034 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869828a-3fc8-4821-8294-02e95d684e6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:13.718314 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7869828a-3fc8-4821-8294-02e95d684e6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:13.729268 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869828a-3fc8-4821-8294-02e95d684e6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:13.730715 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7869828a-3fc8-4821-8294-02e95d684e6a service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:13.741883 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1437/2877] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:06:13 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:06:19.480468 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea8f6d-8865-48db-bf41-2e6d467f82d4 service cinder] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:19.544866 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cea8f6d-8865-48db-bf41-2e6d467f82d4 service cinder] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:19.549737 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22135ec8-fbbc-4500-812f-bfad7311037f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:19.550596 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22135ec8-fbbc-4500-812f-bfad7311037f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:19.550886 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22135ec8-fbbc-4500-812f-bfad7311037f admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:19.551162 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22135ec8-fbbc-4500-812f-bfad7311037f admin admin] PATH_INFO: `/v3/users/aee1461e8eab4f47b4c75c78eb854f58` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:19.552349 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22135ec8-fbbc-4500-812f-bfad7311037f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aee1461e8eab4f47b4c75c78eb854f58)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:19.554319 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22135ec8-fbbc-4500-812f-bfad7311037f admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:19.559691 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=100 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:19.747400 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-22135ec8-fbbc-4500-812f-bfad7311037f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aee1461e8eab4f47b4c75c78eb854f58'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:19.847440 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-22135ec8-fbbc-4500-812f-bfad7311037f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aee1461e8eab4f47b4c75c78eb854f58'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:19.855058 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-22135ec8-fbbc-4500-812f-bfad7311037f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aee1461e8eab4f47b4c75c78eb854f58'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:19.855698 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-22135ec8-fbbc-4500-812f-bfad7311037f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aee1461e8eab4f47b4c75c78eb854f58'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:19.868032 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-22135ec8-fbbc-4500-812f-bfad7311037f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aee1461e8eab4f47b4c75c78eb854f58'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:19.874110 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1441/2878] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:06:19 2022] DELETE /identity/v3/users/aee1461e8eab4f47b4c75c78eb854f58 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:06:19.879576 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f28dd7-60de-4672-bd59-626161cfdd4b None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:19.880117 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f28dd7-60de-4672-bd59-626161cfdd4b None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:19.880233 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f28dd7-60de-4672-bd59-626161cfdd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:19.898800 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-83f28dd7-60de-4672-bd59-626161cfdd4b None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:06:19.900055 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-83f28dd7-60de-4672-bd59-626161cfdd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:19.961474 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1438/2879] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:06:19.971254 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22135ec8-fbbc-4500-812f-bfad7311037f admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:19.972681 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-22135ec8-fbbc-4500-812f-bfad7311037f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:20.030716 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22135ec8-fbbc-4500-812f-bfad7311037f admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:20.034411 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6b2d5-c75d-4004-a1f3-00628c0b3898 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:20.035057 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6b2d5-c75d-4004-a1f3-00628c0b3898 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:20.035342 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6b2d5-c75d-4004-a1f3-00628c0b3898 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:20.035622 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6b2d5-c75d-4004-a1f3-00628c0b3898 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:20.044670 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6b2d5-c75d-4004-a1f3-00628c0b3898 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:20.046146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6b2d5-c75d-4004-a1f3-00628c0b3898 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:20.055815 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1442/2880] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:06:20.580237 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f28dd7-60de-4672-bd59-626161cfdd4b None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:20.581942 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-83f28dd7-60de-4672-bd59-626161cfdd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:20.596070 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f28dd7-60de-4672-bd59-626161cfdd4b None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:20.605373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c81da0-1953-480d-94c4-ee655a301a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:20.605373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c81da0-1953-480d-94c4-ee655a301a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:20.605373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c81da0-1953-480d-94c4-ee655a301a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:20.605373 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c81da0-1953-480d-94c4-ee655a301a6d admin admin] PATH_INFO: `/v3/projects/a08ad55ed1fe4f2fa1a7ebeab461a117` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:20.606366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c81da0-1953-480d-94c4-ee655a301a6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a08ad55ed1fe4f2fa1a7ebeab461a117)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:20.606366 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c81da0-1953-480d-94c4-ee655a301a6d admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:20.623215 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:20.752035 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f7c81da0-1953-480d-94c4-ee655a301a6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a08ad55ed1fe4f2fa1a7ebeab461a117', 'request_id': 'req-f7c81da0-1953-480d-94c4-ee655a301a6d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:20.757419 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f7c81da0-1953-480d-94c4-ee655a301a6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a08ad55ed1fe4f2fa1a7ebeab461a117', 'request_id': 'req-f7c81da0-1953-480d-94c4-ee655a301a6d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:20.763925 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f7c81da0-1953-480d-94c4-ee655a301a6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a08ad55ed1fe4f2fa1a7ebeab461a117', 'request_id': 'req-f7c81da0-1953-480d-94c4-ee655a301a6d'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:20.887013 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f7c81da0-1953-480d-94c4-ee655a301a6d admin admin] The token cache is being invalidate because project a08ad55ed1fe4f2fa1a7ebeab461a117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:06:20.887682 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f7c81da0-1953-480d-94c4-ee655a301a6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:20.887878 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-f7c81da0-1953-480d-94c4-ee655a301a6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:20.889468 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1439/2881] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:06:20 2022] DELETE /identity/v3/projects/a08ad55ed1fe4f2fa1a7ebeab461a117 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:06:20.893841 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6b2d5-c75d-4004-a1f3-00628c0b3898 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:20.903638 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6b2d5-c75d-4004-a1f3-00628c0b3898 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:20.962812 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390d10f-8f65-40a2-b95d-b2144e3604b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:20.963732 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390d10f-8f65-40a2-b95d-b2144e3604b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:20.964020 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390d10f-8f65-40a2-b95d-b2144e3604b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:20.964306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390d10f-8f65-40a2-b95d-b2144e3604b4 admin admin] PATH_INFO: `/v3/users/dd88641cbe1e42499d82f7597aacef11` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:20.965550 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390d10f-8f65-40a2-b95d-b2144e3604b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd88641cbe1e42499d82f7597aacef11)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:20.967498 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3390d10f-8f65-40a2-b95d-b2144e3604b4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:21.106013 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:21.233334 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3390d10f-8f65-40a2-b95d-b2144e3604b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd88641cbe1e42499d82f7597aacef11'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:21.326852 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3390d10f-8f65-40a2-b95d-b2144e3604b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd88641cbe1e42499d82f7597aacef11'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:21.335070 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3390d10f-8f65-40a2-b95d-b2144e3604b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd88641cbe1e42499d82f7597aacef11'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:21.342525 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3390d10f-8f65-40a2-b95d-b2144e3604b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd88641cbe1e42499d82f7597aacef11'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:21.349586 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-3390d10f-8f65-40a2-b95d-b2144e3604b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd88641cbe1e42499d82f7597aacef11'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:21.355587 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1443/2882] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:06:20 2022] DELETE /identity/v3/users/dd88641cbe1e42499d82f7597aacef11 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:06:21.780197 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c81da0-1953-480d-94c4-ee655a301a6d admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:21.800160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-f7c81da0-1953-480d-94c4-ee655a301a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:21.800160 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c81da0-1953-480d-94c4-ee655a301a6d admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:21.856639 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef605701-63d5-4052-b27a-d7c5358b74bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:21.857934 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef605701-63d5-4052-b27a-d7c5358b74bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:21.858224 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef605701-63d5-4052-b27a-d7c5358b74bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:21.858507 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef605701-63d5-4052-b27a-d7c5358b74bf admin admin] PATH_INFO: `/v3/projects/b8ddf17363d44735a98dd567ca0176db` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:21.859721 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef605701-63d5-4052-b27a-d7c5358b74bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8ddf17363d44735a98dd567ca0176db)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:21.862297 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef605701-63d5-4052-b27a-d7c5358b74bf admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:21.968594 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ef605701-63d5-4052-b27a-d7c5358b74bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8ddf17363d44735a98dd567ca0176db', 'request_id': 'req-ef605701-63d5-4052-b27a-d7c5358b74bf'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:21.974522 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ef605701-63d5-4052-b27a-d7c5358b74bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8ddf17363d44735a98dd567ca0176db', 'request_id': 'req-ef605701-63d5-4052-b27a-d7c5358b74bf'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:21.980677 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ef605701-63d5-4052-b27a-d7c5358b74bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8ddf17363d44735a98dd567ca0176db', 'request_id': 'req-ef605701-63d5-4052-b27a-d7c5358b74bf'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:22.057874 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ef605701-63d5-4052-b27a-d7c5358b74bf admin admin] The token cache is being invalidate because project b8ddf17363d44735a98dd567ca0176db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:06:22.058155 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ef605701-63d5-4052-b27a-d7c5358b74bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:22.058785 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ef605701-63d5-4052-b27a-d7c5358b74bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:22.060333 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1440/2883] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:06:21 2022] DELETE /identity/v3/projects/b8ddf17363d44735a98dd567ca0176db => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:06:22.064964 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390d10f-8f65-40a2-b95d-b2144e3604b4 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:22.066439 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3390d10f-8f65-40a2-b95d-b2144e3604b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:22.079951 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390d10f-8f65-40a2-b95d-b2144e3604b4 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:22.140435 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8595506-e0e4-468d-a2a1-7690350ade14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:22.141354 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8595506-e0e4-468d-a2a1-7690350ade14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:22.141643 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8595506-e0e4-468d-a2a1-7690350ade14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:22.142041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8595506-e0e4-468d-a2a1-7690350ade14 admin admin] PATH_INFO: `/v3/users/49b196e273154f4c96c8e28e65ea8fef` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:22.143304 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8595506-e0e4-468d-a2a1-7690350ade14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49b196e273154f4c96c8e28e65ea8fef)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:22.145367 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8595506-e0e4-468d-a2a1-7690350ade14 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:22.335019 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f8595506-e0e4-468d-a2a1-7690350ade14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49b196e273154f4c96c8e28e65ea8fef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:22.384045 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f8595506-e0e4-468d-a2a1-7690350ade14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49b196e273154f4c96c8e28e65ea8fef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:22.391556 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f8595506-e0e4-468d-a2a1-7690350ade14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49b196e273154f4c96c8e28e65ea8fef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:22.392362 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f8595506-e0e4-468d-a2a1-7690350ade14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49b196e273154f4c96c8e28e65ea8fef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:22.404648 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-f8595506-e0e4-468d-a2a1-7690350ade14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49b196e273154f4c96c8e28e65ea8fef'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:22.411373 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1444/2884] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:06:22 2022] DELETE /identity/v3/users/49b196e273154f4c96c8e28e65ea8fef => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:06:22.825621 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef605701-63d5-4052-b27a-d7c5358b74bf admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:22.827117 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-ef605701-63d5-4052-b27a-d7c5358b74bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:22.840981 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef605701-63d5-4052-b27a-d7c5358b74bf admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:22.873729 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:22.900292 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8592eac-8d26-4ade-bf6c-bada6c6e86e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:22.901199 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8592eac-8d26-4ade-bf6c-bada6c6e86e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:22.901473 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8592eac-8d26-4ade-bf6c-bada6c6e86e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:22.901747 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8592eac-8d26-4ade-bf6c-bada6c6e86e7 admin admin] PATH_INFO: `/v3/projects/e4d3c12ddfc840e9b611ea342233e6e6` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:22.902951 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8592eac-8d26-4ade-bf6c-bada6c6e86e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d3c12ddfc840e9b611ea342233e6e6)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:22.904842 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8592eac-8d26-4ade-bf6c-bada6c6e86e7 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:23.014583 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c8592eac-8d26-4ade-bf6c-bada6c6e86e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d3c12ddfc840e9b611ea342233e6e6', 'request_id': 'req-c8592eac-8d26-4ade-bf6c-bada6c6e86e7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:23.020998 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c8592eac-8d26-4ade-bf6c-bada6c6e86e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d3c12ddfc840e9b611ea342233e6e6', 'request_id': 'req-c8592eac-8d26-4ade-bf6c-bada6c6e86e7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:23.027401 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c8592eac-8d26-4ade-bf6c-bada6c6e86e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d3c12ddfc840e9b611ea342233e6e6', 'request_id': 'req-c8592eac-8d26-4ade-bf6c-bada6c6e86e7'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:23.087496 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c8592eac-8d26-4ade-bf6c-bada6c6e86e7 admin admin] The token cache is being invalidate because project e4d3c12ddfc840e9b611ea342233e6e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:06:23.087807 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c8592eac-8d26-4ade-bf6c-bada6c6e86e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:23.088420 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-c8592eac-8d26-4ade-bf6c-bada6c6e86e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:06:23.090026 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1441/2885] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:06:22 2022] DELETE /identity/v3/projects/e4d3c12ddfc840e9b611ea342233e6e6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:06:23.095296 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b724ff-add4-4bf3-b713-e778665f445f None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:23.097456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b724ff-add4-4bf3-b713-e778665f445f None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:23.097456 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b724ff-add4-4bf3-b713-e778665f445f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:23.115521 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-71b724ff-add4-4bf3-b713-e778665f445f None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:06:23.116742 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-71b724ff-add4-4bf3-b713-e778665f445f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:23.137499 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:23.179709 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1445/2886] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:06:23.187678 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa78904-ae59-4e79-8124-9caa6b205baf None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:23.187961 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa78904-ae59-4e79-8124-9caa6b205baf None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:23.188239 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa78904-ae59-4e79-8124-9caa6b205baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:23.207842 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-0fa78904-ae59-4e79-8124-9caa6b205baf None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:06:23.209080 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-0fa78904-ae59-4e79-8124-9caa6b205baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:23.217046 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1442/2887] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:06:23.221557 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b724ff-add4-4bf3-b713-e778665f445f None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:23.231547 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b724ff-add4-4bf3-b713-e778665f445f None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:23.237249 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784a9dc-8914-4bf2-9ffd-7a2e14593fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:23.237917 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784a9dc-8914-4bf2-9ffd-7a2e14593fc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:23.238243 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784a9dc-8914-4bf2-9ffd-7a2e14593fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:23.238558 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784a9dc-8914-4bf2-9ffd-7a2e14593fc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:23.239276 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784a9dc-8914-4bf2-9ffd-7a2e14593fc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80508) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 18 17:06:23.239586 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784a9dc-8914-4bf2-9ffd-7a2e14593fc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:23.241281 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784a9dc-8914-4bf2-9ffd-7a2e14593fc4 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:23.254407 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1446/2888] 10.222.0.76 () {58 vars in 1152 bytes} [Mon Jul 18 17:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 18 17:06:23.258755 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa78904-ae59-4e79-8124-9caa6b205baf None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:23.268703 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa78904-ae59-4e79-8124-9caa6b205baf None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:23.273553 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca6575-14db-4f44-a637-b4753e2e338a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:23.274262 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca6575-14db-4f44-a637-b4753e2e338a admin admin] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:23.274560 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca6575-14db-4f44-a637-b4753e2e338a admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:23.274861 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bca6575-14db-4f44-a637-b4753e2e338a admin admin] PATH_INFO: `/v3/projects` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:23.275568 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca6575-14db-4f44-a637-b4753e2e338a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:23.277490 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bca6575-14db-4f44-a637-b4753e2e338a admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:23.357286 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1443/2889] 10.222.0.76 () {60 vars in 1152 bytes} [Mon Jul 18 17:06:23 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 18 17:06:23.362307 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784a9dc-8914-4bf2-9ffd-7a2e14593fc4 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:23.372455 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784a9dc-8914-4bf2-9ffd-7a2e14593fc4 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:23.429749 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81a484-22e4-423e-be80-1dae2de19776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:23.430345 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81a484-22e4-423e-be80-1dae2de19776 admin admin] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:23.430630 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81a484-22e4-423e-be80-1dae2de19776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:23.430908 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81a484-22e4-423e-be80-1dae2de19776 admin admin] PATH_INFO: `/v3/users` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:23.431593 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81a484-22e4-423e-be80-1dae2de19776 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:23.433530 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81a484-22e4-423e-be80-1dae2de19776 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:23.556129 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1447/2890] 10.222.0.76 () {60 vars in 1143 bytes} [Mon Jul 18 17:06:23 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 18 17:06:23.560364 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca6575-14db-4f44-a637-b4753e2e338a admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:23.572559 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bca6575-14db-4f44-a637-b4753e2e338a admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:23.577396 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d914ec2-37e9-43a2-8d43-64f1389d9191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:23.578339 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d914ec2-37e9-43a2-8d43-64f1389d9191 admin admin] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:23.578488 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d914ec2-37e9-43a2-8d43-64f1389d9191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:23.578656 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d914ec2-37e9-43a2-8d43-64f1389d9191 admin admin] PATH_INFO: `/v3/roles` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:23.579912 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d914ec2-37e9-43a2-8d43-64f1389d9191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:23.581572 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d914ec2-37e9-43a2-8d43-64f1389d9191 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:23.592460 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1444/2891] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:06:23.597726 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81a484-22e4-423e-be80-1dae2de19776 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:23.608386 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81a484-22e4-423e-be80-1dae2de19776 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:23.613288 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ddb7d-ddc6-41dd-b69b-993332aad0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:23.613953 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ddb7d-ddc6-41dd-b69b-993332aad0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:23.614243 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ddb7d-ddc6-41dd-b69b-993332aad0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:23.614524 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ddb7d-ddc6-41dd-b69b-993332aad0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:23.615259 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ddb7d-ddc6-41dd-b69b-993332aad0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:23.617050 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ddb7d-ddc6-41dd-b69b-993332aad0a3 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:23.627905 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1448/2892] 10.222.0.76 () {58 vars in 1121 bytes} [Mon Jul 18 17:06:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 18 17:06:23.632194 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d914ec2-37e9-43a2-8d43-64f1389d9191 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:23.642700 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d914ec2-37e9-43a2-8d43-64f1389d9191 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:23.647269 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1c526-a1b4-4977-95d9-4b8a98c371a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:23.648147 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1c526-a1b4-4977-95d9-4b8a98c371a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:23.648448 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1c526-a1b4-4977-95d9-4b8a98c371a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:23.648721 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1c526-a1b4-4977-95d9-4b8a98c371a8 admin admin] PATH_INFO: `/v3/projects/80a3312c4364471fb98f892fc1461bb7/users/0fdca3c347134bd5a4c327c8b1230773/roles/38ab22e38dfd483dbd2f224b3088f16e` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:23.663409 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1c526-a1b4-4977-95d9-4b8a98c371a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a3312c4364471fb98f892fc1461bb7, user_id=0fdca3c347134bd5a4c327c8b1230773, role_id=38ab22e38dfd483dbd2f224b3088f16e)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:23.666075 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1c526-a1b4-4977-95d9-4b8a98c371a8 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:23.739061 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1445/2893] 10.222.0.76 () {60 vars in 1482 bytes} [Mon Jul 18 17:06:23 2022] PUT /identity/v3/projects/80a3312c4364471fb98f892fc1461bb7/users/0fdca3c347134bd5a4c327c8b1230773/roles/38ab22e38dfd483dbd2f224b3088f16e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:06:23.744278 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0639a6-7609-47b1-ae35-d0e79d6f4145 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:23.744609 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0639a6-7609-47b1-ae35-d0e79d6f4145 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:23.744856 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0639a6-7609-47b1-ae35-d0e79d6f4145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:23.763629 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-3c0639a6-7609-47b1-ae35-d0e79d6f4145 None None] MFA Rules not processed for user `c740c2989cfd4a19b4bb2520a5d2cbf7`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:06:23.764986 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-3c0639a6-7609-47b1-ae35-d0e79d6f4145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:23.826351 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1449/2894] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 18 17:06:23.837043 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1c526-a1b4-4977-95d9-4b8a98c371a8 admin admin] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:23.838772 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-92b1c526-a1b4-4977-95d9-4b8a98c371a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:23.897565 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1c526-a1b4-4977-95d9-4b8a98c371a8 admin admin] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:23.901274 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a140406-aeab-45a4-9bcc-4b19aad10588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:23.901929 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a140406-aeab-45a4-9bcc-4b19aad10588 service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:23.902215 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a140406-aeab-45a4-9bcc-4b19aad10588 service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:23.902496 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a140406-aeab-45a4-9bcc-4b19aad10588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:23.912290 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a140406-aeab-45a4-9bcc-4b19aad10588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:23.913763 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a140406-aeab-45a4-9bcc-4b19aad10588 service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:23.923330 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1446/2895] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:06:25.156479 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134b219-ef37-4cef-a44e-823c4e1b7686 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:25.157041 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134b219-ef37-4cef-a44e-823c4e1b7686 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:25.157167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8134b219-ef37-4cef-a44e-823c4e1b7686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:25.187182 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-8134b219-ef37-4cef-a44e-823c4e1b7686 None None] MFA Rules not processed for user `0fdca3c347134bd5a4c327c8b1230773`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:06:25.188412 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-8134b219-ef37-4cef-a44e-823c4e1b7686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:25.209704 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:25.257665 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1450/2896] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:06:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:06:25.269660 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a140406-aeab-45a4-9bcc-4b19aad10588 service neutron] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:25.271099 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-4a140406-aeab-45a4-9bcc-4b19aad10588 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:25.276551 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:25.344644 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a140406-aeab-45a4-9bcc-4b19aad10588 service neutron] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:25.344644 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cf3a4-4ec7-4473-acbb-6affe8d1aa63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55d75cd269ff4f0daf51a728b159888a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:25.344644 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cf3a4-4ec7-4473-acbb-6affe8d1aa63 service cinder] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:25.344644 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cf3a4-4ec7-4473-acbb-6affe8d1aa63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:25.345230 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8cf3a4-4ec7-4473-acbb-6affe8d1aa63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:25.345230 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8cf3a4-4ec7-4473-acbb-6affe8d1aa63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:25.345230 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8cf3a4-4ec7-4473-acbb-6affe8d1aa63 service cinder] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:25.353275 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1447/2897] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:06:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:06:27.107337 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb0037-09be-47db-8203-d77090ccfa04 None None] REQUEST_METHOD: `POST` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:27.107948 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb0037-09be-47db-8203-d77090ccfa04 None None] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:27.107948 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb0037-09be-47db-8203-d77090ccfa04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:27.125762 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.auth.core [None req-a5eb0037-09be-47db-8203-d77090ccfa04 None None] MFA Rules not processed for user `0fdca3c347134bd5a4c327c8b1230773`. Rule list: `[]` (Enabled: `True`). {{(pid=80508) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:06:27.126981 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-a5eb0037-09be-47db-8203-d77090ccfa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:27.134066 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1451/2898] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:06:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:06:27.171523 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cf3a4-4ec7-4473-acbb-6affe8d1aa63 service cinder] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:27.172949 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-7f8cf3a4-4ec7-4473-acbb-6affe8d1aa63 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:27.232682 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8cf3a4-4ec7-4473-acbb-6affe8d1aa63 service cinder] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:27.236335 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7609068-3af4-435e-94f0-9ed0cb83dbd2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1e1900754214020931b202e98f660a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:27.237194 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7609068-3af4-435e-94f0-9ed0cb83dbd2 service glance] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:27.237489 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7609068-3af4-435e-94f0-9ed0cb83dbd2 service glance] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:27.237769 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7609068-3af4-435e-94f0-9ed0cb83dbd2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:27.239566 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c7609068-3af4-435e-94f0-9ed0cb83dbd2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:27.310664 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7609068-3af4-435e-94f0-9ed0cb83dbd2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:27.312024 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7609068-3af4-435e-94f0-9ed0cb83dbd2 service glance] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:27.323806 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1448/2899] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:06:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 18 17:06:27.530561 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb0037-09be-47db-8203-d77090ccfa04 None None] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:27.540488 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb0037-09be-47db-8203-d77090ccfa04 None None] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:27.544083 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247acdf-cd8b-4106-a359-836fb47a3bac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:27.544732 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247acdf-cd8b-4106-a359-836fb47a3bac service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:27.545042 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247acdf-cd8b-4106-a359-836fb47a3bac service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:27.545332 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e247acdf-cd8b-4106-a359-836fb47a3bac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:27.547129 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-e247acdf-cd8b-4106-a359-836fb47a3bac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:27.556779 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247acdf-cd8b-4106-a359-836fb47a3bac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:27.558275 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e247acdf-cd8b-4106-a359-836fb47a3bac service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:27.567194 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1452/2900] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:06:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:06:27.976261 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7609068-3af4-435e-94f0-9ed0cb83dbd2 service glance] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:06:27.978055 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c7609068-3af4-435e-94f0-9ed0cb83dbd2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:27.991932 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7609068-3af4-435e-94f0-9ed0cb83dbd2 service glance] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:06:27.996441 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ca9a3-b820-4b0b-831f-9b38d4bbbf5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:06:27.997155 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ca9a3-b820-4b0b-831f-9b38d4bbbf5a service neutron] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:06:27.997445 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ca9a3-b820-4b0b-831f-9b38d4bbbf5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:06:27.997723 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ca9a3-b820-4b0b-831f-9b38d4bbbf5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:06:27.999619 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-922ca9a3-b820-4b0b-831f-9b38d4bbbf5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:06:28.016827 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ca9a3-b820-4b0b-831f-9b38d4bbbf5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:06:28.016827 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ca9a3-b820-4b0b-831f-9b38d4bbbf5a service neutron] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:06:28.029813 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1449/2901] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:06:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:06:37.562730 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=27 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:06:38.023002 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=85 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:07:18.555598 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247acdf-cd8b-4106-a359-836fb47a3bac service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:07:18.564894 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e247acdf-cd8b-4106-a359-836fb47a3bac service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:07:18.569648 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee19c26-fdb7-4cbd-ba4f-5f354ff34b27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:07:18.570306 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee19c26-fdb7-4cbd-ba4f-5f354ff34b27 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:07:18.570595 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee19c26-fdb7-4cbd-ba4f-5f354ff34b27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:07:18.570877 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee19c26-fdb7-4cbd-ba4f-5f354ff34b27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:07:18.572686 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-5ee19c26-fdb7-4cbd-ba4f-5f354ff34b27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:07:18.593039 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee19c26-fdb7-4cbd-ba4f-5f354ff34b27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:07:18.594903 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee19c26-fdb7-4cbd-ba4f-5f354ff34b27 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:07:18.605533 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1453/2902] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:07:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:07:28.601526 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=10 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:07:50.561746 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b798af-c532-4981-8818-824b5bee2a1d None None] REQUEST_METHOD: `POST` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:07:50.562272 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b798af-c532-4981-8818-824b5bee2a1d None None] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:07:50.562396 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b798af-c532-4981-8818-824b5bee2a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:07:50.579202 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.auth.core [None req-c3b798af-c532-4981-8818-824b5bee2a1d None None] MFA Rules not processed for user `0fdca3c347134bd5a4c327c8b1230773`. Rule list: `[]` (Enabled: `True`). {{(pid=80507) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 18 17:07:50.580414 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c3b798af-c532-4981-8818-824b5bee2a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:07:50.604089 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1450/2903] 10.222.0.76 () {58 vars in 957 bytes} [Mon Jul 18 17:07:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 18 17:07:50.854655 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee19c26-fdb7-4cbd-ba4f-5f354ff34b27 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:07:50.879249 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee19c26-fdb7-4cbd-ba4f-5f354ff34b27 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:07:50.882992 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ea8d0-d6d2-49f8-9717-48d9042afca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e9dcca05df70446090cd525c0644cfc8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:07:50.883640 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ea8d0-d6d2-49f8-9717-48d9042afca7 service neutron] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:07:50.883932 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ea8d0-d6d2-49f8-9717-48d9042afca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:07:50.884206 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ea8d0-d6d2-49f8-9717-48d9042afca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:07:50.886641 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-f30ea8d0-d6d2-49f8-9717-48d9042afca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:07:50.907268 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ea8d0-d6d2-49f8-9717-48d9042afca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:07:50.908706 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ea8d0-d6d2-49f8-9717-48d9042afca7 service neutron] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:07:50.916728 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1454/2904] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:07:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:08:00.602042 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=11 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:08:00.913146 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=15 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:09:05.119559 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b798af-c532-4981-8818-824b5bee2a1d None None] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:09:05.140815 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-c3b798af-c532-4981-8818-824b5bee2a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:09:05.223685 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b798af-c532-4981-8818-824b5bee2a1d None None] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:09:05.229195 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcefea-8909-42c2-ad97-96af1c909ea5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c8d6afb4ccd41a5972e3241a3eebc7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:09:05.229854 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcefea-8909-42c2-ad97-96af1c909ea5 service placement] REQUEST_METHOD: `GET` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:09:05.230143 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcefea-8909-42c2-ad97-96af1c909ea5 service placement] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:09:05.230427 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fcefea-8909-42c2-ad97-96af1c909ea5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:09:05.232263 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.fernet_utils [None req-d2fcefea-8909-42c2-ad97-96af1c909ea5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80507) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:09:05.244051 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ea8d0-d6d2-49f8-9717-48d9042afca7 service neutron] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:09:05.245688 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcefea-8909-42c2-ad97-96af1c909ea5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:09:05.247301 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fcefea-8909-42c2-ad97-96af1c909ea5 service placement] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:09:05.260212 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1451/2905] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:09:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:09:05.279556 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ea8d0-d6d2-49f8-9717-48d9042afca7 service neutron] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:09:05.285489 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8e92f-8805-46db-8062-806e01dff794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:09:05.286511 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8e92f-8805-46db-8062-806e01dff794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:09:05.286675 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8e92f-8805-46db-8062-806e01dff794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:09:05.286958 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8e92f-8805-46db-8062-806e01dff794 admin admin] PATH_INFO: `/v3/users/0fdca3c347134bd5a4c327c8b1230773` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:09:05.288186 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8e92f-8805-46db-8062-806e01dff794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fdca3c347134bd5a4c327c8b1230773)` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:09:05.290216 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8e92f-8805-46db-8062-806e01dff794 admin admin] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:09:05.500529 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-36e8e92f-8805-46db-8062-806e01dff794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fdca3c347134bd5a4c327c8b1230773'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:09:05.567034 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-36e8e92f-8805-46db-8062-806e01dff794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fdca3c347134bd5a4c327c8b1230773'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:09:05.574923 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-36e8e92f-8805-46db-8062-806e01dff794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fdca3c347134bd5a4c327c8b1230773'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:09:05.575604 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-36e8e92f-8805-46db-8062-806e01dff794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fdca3c347134bd5a4c327c8b1230773'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:09:05.589556 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.notifications [None req-36e8e92f-8805-46db-8062-806e01dff794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fdca3c347134bd5a4c327c8b1230773'} {{(pid=80508) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:09:05.595798 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1455/2906] 10.222.0.76 () {58 vars in 1223 bytes} [Mon Jul 18 17:09:05 2022] DELETE /identity/v3/users/0fdca3c347134bd5a4c327c8b1230773 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 18 17:09:05.842964 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcefea-8909-42c2-ad97-96af1c909ea5 service placement] Authenticating user token {{(pid=80507) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:09:05.854741 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fcefea-8909-42c2-ad97-96af1c909ea5 service placement] Validating token access rules against request {{(pid=80507) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:09:05.916961 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6bc139-30c5-4734-94d7-a76ce773d1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c740c2989cfd4a19b4bb2520a5d2cbf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0e39050787a54caf815f78d2aa8ec514', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80507) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:09:05.917867 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bc139-30c5-4734-94d7-a76ce773d1e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:09:05.918151 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bc139-30c5-4734-94d7-a76ce773d1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:09:05.918454 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6bc139-30c5-4734-94d7-a76ce773d1e9 admin admin] PATH_INFO: `/v3/projects/80a3312c4364471fb98f892fc1461bb7` {{(pid=80507) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:09:05.919652 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bc139-30c5-4734-94d7-a76ce773d1e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a3312c4364471fb98f892fc1461bb7)` {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:09:05.922164 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6bc139-30c5-4734-94d7-a76ce773d1e9 admin admin] RBAC: Authorization granted {{(pid=80507) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:09:06.013121 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ef6bc139-30c5-4734-94d7-a76ce773d1e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a3312c4364471fb98f892fc1461bb7', 'request_id': 'req-ef6bc139-30c5-4734-94d7-a76ce773d1e9'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:09:06.019127 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ef6bc139-30c5-4734-94d7-a76ce773d1e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a3312c4364471fb98f892fc1461bb7', 'request_id': 'req-ef6bc139-30c5-4734-94d7-a76ce773d1e9'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:09:06.025417 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ef6bc139-30c5-4734-94d7-a76ce773d1e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a3312c4364471fb98f892fc1461bb7', 'request_id': 'req-ef6bc139-30c5-4734-94d7-a76ce773d1e9'} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:09:06.028004 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:09:06.134502 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ef6bc139-30c5-4734-94d7-a76ce773d1e9 admin admin] The token cache is being invalidate because project 80a3312c4364471fb98f892fc1461bb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80507) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 18 17:09:06.135140 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ef6bc139-30c5-4734-94d7-a76ce773d1e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:09:06.135465 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG keystone.notifications [None req-ef6bc139-30c5-4734-94d7-a76ce773d1e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80507) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 18 17:09:06.137145 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: [pid: 80507|app: 0|req: 1452/2907] 10.222.0.76 () {58 vars in 1232 bytes} [Mon Jul 18 17:09:05 2022] DELETE /identity/v3/projects/80a3312c4364471fb98f892fc1461bb7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 18 17:09:15.592157 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=36,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:09:16.246759 dv-cinder-837542-6-iscsi devstack@keystone.service[80507]: DEBUG dbcounter [-] [80507] Writing DB stats keystone:DELETE=1,keystone:SELECT=7 {{(pid=80507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 17:10:15.701730 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8e92f-8805-46db-8062-806e01dff794 admin admin] Authenticating user token {{(pid=80508) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 18 17:10:15.703218 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-36e8e92f-8805-46db-8062-806e01dff794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:10:15.776132 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8e92f-8805-46db-8062-806e01dff794 admin admin] Validating token access rules against request {{(pid=80508) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 18 17:10:15.838167 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188cb14-f45c-49c1-bb13-478e92f8157f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c8d6afb4ccd41a5972e3241a3eebc7e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30a4824228ec47519a01574d82879b25', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80508) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 18 17:10:15.838831 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188cb14-f45c-49c1-bb13-478e92f8157f service placement] REQUEST_METHOD: `GET` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 18 17:10:15.839123 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188cb14-f45c-49c1-bb13-478e92f8157f service placement] SCRIPT_NAME: `/identity` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 18 17:10:15.839408 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188cb14-f45c-49c1-bb13-478e92f8157f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80508) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 18 17:10:15.841492 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.fernet_utils [None req-b188cb14-f45c-49c1-bb13-478e92f8157f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80508) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 18 17:10:15.855587 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188cb14-f45c-49c1-bb13-478e92f8157f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 18 17:10:15.857252 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188cb14-f45c-49c1-bb13-478e92f8157f service placement] RBAC: Authorization granted {{(pid=80508) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 18 17:10:15.867857 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: [pid: 80508|app: 0|req: 1456/2908] 10.222.0.76 () {60 vars in 1365 bytes} [Mon Jul 18 17:10:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 18 17:10:25.863279 dv-cinder-837542-6-iscsi devstack@keystone.service[80508]: DEBUG dbcounter [-] [80508] Writing DB stats keystone:SELECT=58 {{(pid=80508) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}